| Budget Amount *help |
¥5,460,000 (Direct Cost: ¥4,200,000、Indirect Cost: ¥1,260,000)
Fiscal Year 2014: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2013: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Fiscal Year 2012: ¥2,080,000 (Direct Cost: ¥1,600,000、Indirect Cost: ¥480,000)
|
|---|
| Outline of Final Research Achievements |
The aim of this study is to develop synthesis and measurement interfaces for multimodal interaction. Speech synthesis technique based on speech production process and image processing technique such as eye-gaze estimation, eye-gaze-driven control, and motion capture were combined to create various interfaces which support multimodal interaction. For example, it is revealed that a vocal-tract mapping interface can be a useful measurement tool to judge the dexterity of the finger-nose movement. An attempt to estimate the vocal tract shape from vowel sounds via the vocal-tract mapping interface resulted in successful estimation of the vocal tract shape and visual trajectories on the mapping interface window. Moreover, an eye-gaze interface enabled us to control the motion of a radio-controlled car by eye-gaze.
|
