並列タイトル等Human Computer Interaction by Means of Video-based Tongue Protrusion Detection
一般注記We propose a human-computer interaction method based on tongue protrusion. We assumne that the natural location of the tongue is inside the oral cavity. Therefore, the appearance of the tongue on the surface of the mouth is interpreted as the intention of the user to generate an event. The system we propose detects and tracks the tongue by analyzing the changes occurring in the video signal acquired by a regular web camera. Three templates are used: a mouth template; and, a left-half mouth sub-template and a right-half mouth sub-template, which are obtained by dividing the mouth template by half. We use the Normalized Correlation Coefficient (NCC) for tracking the mouth region at each frame, and also for comparing the similarity between the new tracked mouth and the original template. When the NCC falls below a threshold, we assume that the change in the mouth is caused by the tongue protrusion. Then, we analyze both the left and right templates NCCs, and we use this similarity measure for detecting whether the tongue is protruded to the left or right side of the mouth. Subsequently, having a positive detection will generate a simple task in the computer. Experiments show that the system is adaptable to different users by being calibrated according to the user's physical characteristics, and that the communication method is easy to learn and perform.
identifier:oai:t2r2.star.titech.ac.jp:50089134
連携機関・データベース国立情報学研究所 : 学術機関リポジトリデータベース（IRDB）（機関リポジトリ）