Integration of auditory and visual information in human communication
| Project/Area Number |
20300080
|
|---|
| Research Category |
Grant-in-Aid for Scientific Research (B)
|
| Allocation Type | Single-year Grants |
|---|
| Section | 一般 |
|---|
| Research Field |
Sensitivity informatics/Soft computing
|
|---|
| Research Institution | Teikyo University |
|---|
Principal Investigator |
|
|---|
| Co-Investigator(Kenkyū-buntansha) |
NAKAMURA Naoto 千葉工業大学, 情報科学部, 教授 (20201676)
OHNISHI Hitoshi 放送大学, ICT活用・遠隔教育センター, 准教授 (40280549)
|
|---|
| Project Period (FY) |
2008 – 2011
|
| Project Status |
Completed (Fiscal Year 2011)
|
| Budget Amount *help |
¥12,220,000 (Direct Cost: ¥9,400,000、Indirect Cost: ¥2,820,000)
Fiscal Year 2011: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
Fiscal Year 2010: ¥2,600,000 (Direct Cost: ¥2,000,000、Indirect Cost: ¥600,000)
Fiscal Year 2009: ¥2,340,000 (Direct Cost: ¥1,800,000、Indirect Cost: ¥540,000)
Fiscal Year 2008: ¥5,070,000 (Direct Cost: ¥3,900,000、Indirect Cost: ¥1,170,000)
|
|---|
| Keywords | 感性認知科学 / 視聴覚統合 / 対人コミュニケーション / 映像音声の同期 / 実験心理学 / 通信品質 / テレコミュニケーション / リップシンク / 知覚音量の変化 |
|---|
| Research Abstract |
We examined the interactions between audio and visual information in human oral communications using the asynchrony detection tasks. We found some cultural factors in asynchrony detection such as native language of speakers and listeners, facial features, and so on. The understandability of the meaning of sentences are also seemed to be important for asynchrony detection. We also found the phenomenon in which the percepted volume of sound decrease when the audio and visual information is no synchronized. Our experiments on the contributions of the visual information to speech understandings shows there is large individual differences in utilization of visual information to speech cognition.
|
Report
(6 results)
Research Products
(53 results)
