Innvestigate on audio-visual integration of speech sound

2016 Fiscal Year Final Research Report

• Project/Area Number: 26750215
• Research Category: Grant-in-Aid for Young Scientists (B)
• Allocation Type: Multi-year Fund
• Research Field: Rehabilitation science/Welfare engineering
• Research Institution: National Rehabilitation Center for Persons with Disabilities
• Principal Investigator: Tomomi Mizuochi-Endo (水落智美) 国立障害者リハビリテーションセンター(研究所), 研究所・脳機能系障害研究部, 特別研究員(RPD) (90568859)
• Project Period (FY): 2014-04-01 – 2017-03-31
• Keywords: 視聴覚統合 / 音声 / 脳波 / 皮質内脳波

Outline of Final Research Achievements

Visual speech cue is important for speech perception. In this study, we focus on formant frequency as acoustic information that visual speech cue conveys. To investigate how to use formant information from articulation, we record EEG and ECoG using synthesized vowels which differs only formant frequency.
In healty adult EEG, there was no significant difference among vowels. On the other hand, ECoG channels on the left posterior superior temporal gyrus showed significant differences among vowels in 200 ms after sound onset in audio-only condition. These significant differences disappeared in audio-visual condition. This result indicated that visual information may change neural response to sound in vicinity of auditory cortex.

Free Research Field

認知神経科学