2012 Fiscal Year Final Research Report

Research on the non-uttering human interface between multiplelanguages using lips movements

Research Project

Project/Area Number	22500112
Research Category	Grant-in-Aid for Scientific Research (C)
Allocation Type	Single-year Grants
Section	一般
Research Field	Media informatics/Database
Research Institution	Tokai University
Principal Investigator	YAMADA Mitsuho 東海大学, 情報通信学部情報メディア学科, 教授 (60366086)
Project Period (FY)	2010 – 2012
Keywords	ヒューマンインターフェイス / 発話認識
Research Abstract	We found robustness of word recognition by lip movement without audible utterance, not only between the words of different speakers but also between the utterances of the same speaker at different times or on different days. Furthermore, we showed the effectiveness of lip movement for the recognition of the railway station names. Moreover, no matter whether a native English speaker or Japanese person spoke, recognition of the same English word was possible. We also developed a system which can beautomatically performed, from acquisition of lip movements when uttering the word to recognition of the uttered word, and showed the feasibility of the non-uttering human interface in various languages.