• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Recording of Brain Activity for Speech Processing Usin Audio-Visual Stimuli.

Research Project

Project/Area Number 07557108
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section試験
Research Field Otorhinolaryngology
Research InstitutionUNIVERSITY OF TOKYO

Principal Investigator

KIRITANI Shigeru  UNIVERSITY OF TOKYO Graduate School of Med., Professor, 大学院・医学系研究科, 教授 (90010032)

Co-Investigator(Kenkyū-buntansha) UMOTO Masato  UNIVERSITY OF TOKYO Graduate School of Med., Res.Associate, 医学部・附属病院, 助手 (30240170)
MORI Koichi  UNIVERSITY OF TOKYO Graduate School of Med., Res.Associate, 大学院・医学系研究科, 助手 (60157857)
IMAIZUMI Satoshi  UNIVERSITY OF TOKYO Graduate School of Med., Associate Prof., 大学院・医学系研究科, 助教授 (80122018)
NIIMI Seiji  UNIVERSITY OF TOKYO Graduate School of Med., Professor, 大学院・医学系研究科, 教授 (00010273)
Project Period (FY) 1995 – 1996
Project Status Completed (Fiscal Year 1996)
Budget Amount *help
¥4,500,000 (Direct Cost: ¥4,500,000)
Fiscal Year 1996: ¥1,000,000 (Direct Cost: ¥1,000,000)
Fiscal Year 1995: ¥3,500,000 (Direct Cost: ¥3,500,000)
KeywordsSpeech / MEG / ERP / Audio-Visual / Brain Activity / 誘発脳波 / 視聴覚統合反応 / 意味判断課題 / 語い判断課題 / 音韻判断課題 / McGurk効果
Research Abstract

The present study aims at establishing a system for recording brain activities (ERP or MEG) for the semantic processing of word meaning. The basic 300 concrete nouns were selected and for these words digitized speech data image data of the characters (Kanji and Hirakana) and the picture data were prepared. A system was constructed for simultareons presentation of audio-visual stimuli with regnired timing control. A set of dynamic video stimuli with antificial timing manipulation of the audio and video signals were also prepared to examine the temporal process of the audio-visual integration. By using these stimuli, following preliminary experiments were conducted to compare the visual and auditory processing of the word meaning and also to analyze the process of audio-visual integration.
1.Comparison of categorical judgment for character and picture stimuli. The words for animal name were presented as standard stimmuli and the words for plant name were presented as rare stimuli. The task was to count the plant name. ERP for the picture stimuli shows characteristic positive shitt at about 400 msec VST.
2.Cpmparison of Audio-Visual mismatch for character and pocture stimuli. Audio and visual stimuli were presented simultaneonsly and mismatched samples were presented infrequently. There was a significant difference in the P 300 latency between charactera nd picture stimuli.
3.Analyzes of audio-visual speech integration. Neural processes relating to audio-visual cue binding were investigated by measuring the electro-magnetic neural activities detecting infrequent changes in the timing of audio-visual speech stimuli. The results suggest the existence of a mechanism which guarntees coherent phonetic categorization by binding parallel but spatio-temporally distributing processes in the auditory and visual cortices.

Report

(3 results)
  • 1996 Annual Research Report   Final Research Report Summary
  • 1995 Annual Research Report
  • Research Products

    (18 results)

All Other

All Publications (18 results)

  • [Publications] S.Imaizumi: "Neural representation of concurrent sounds." Electroencephalography and clinical Neurophysiology. 47. 191-197 (1996)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] S.Imaizumi: "Neural processes of audio-visual speech pereeption." Prephint of the 3rd Joint Meeting of the Acoust. Soc. of Ame. and Jpn.2571-2571 (1996)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] 今泉 敏: "視聴覚情報統合機能の脳磁図による解析" 電子情報通信学会技術報告. SP95-135. 1-6 (1996)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] 森 浩一: "音源定位は第一次聴覚領の外で行われるのか" 日本音響学会聴覚研究会資料. H97-7. 1-8 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Satoshi Imaizumi: "Neural representation of concurrent sounds : A magnetoencephalographic study." Electroencephalographyand Clinical Neurophysiology.47. 191-197 (1996)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Satoshi Imaizumi: "Electro-and magneto-encephalographic observation of audio-visual speech perdeption." Trans.Tech.Com.Psycho.Physio.Acoust.H97-9. 1-7 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Satoshi Imaizumi: "Magnetoencephalographic observation of audio-visual integration." Technical report of IEICE. SP-95-135. 1-6 (1996)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Koichi Mori: "Is sound localization processed in non-primary auditory cortices? Trans." Tech.Com.Psycho.Physio.Acoust.H97-7. 1-8 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Satoshi Imaizumi: "Magneto-and electro-encephalographic analyzes of audio-visual speech integration." MAG-97-55. 57-61 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] S.Imaizumi,: "Neural representation of concurrent sounds." Electroencephalography and Clinical Neurophysiology.47. 191-197 (1996)

    • Related Report
      1996 Annual Research Report
  • [Publications] S.Imaizumi: "Neural processes of audio-visual speech perception" Preprit of the 3^<rd> Joint Meeting of the Acoust.Soc.of Ame.and Jpn.2571-2571 (1996)

    • Related Report
      1996 Annual Research Report
  • [Publications] 今泉敏: "視聴覚情報統合機能の脳磁図による解析" 電子情報通信学会技術報告. SP95-135. 1-6 (1996)

    • Related Report
      1996 Annual Research Report
  • [Publications] 森 浩一: "音源定位は第一次聴覚領の外で行われるのか" 日本音響学会聴覚研究会資料. H-97-7. 1-8 (1997)

    • Related Report
      1996 Annual Research Report
  • [Publications] 林安紀子 他: "乳児の日本語境界の知覚-選好振り向き法を用いた実験的検討" 電子情報通信学会技術研究報告. 105. 9-16 (1995)

    • Related Report
      1995 Annual Research Report
  • [Publications] 桐谷滋 他: "乳児における言語音獲得の過程" 日本音響学会誌. 52(印刷中). (1996)

    • Related Report
      1995 Annual Research Report
  • [Publications] 今泉敏 他: "脳磁図による重畳音響事象の知覚過程の解析" 生体磁気学会誌. 8. 200-203 (1995)

    • Related Report
      1995 Annual Research Report
  • [Publications] 今泉敏 他: "聴覚的情景分析の脳内過程-脳磁図による検討-" 電子情報通信学会技術研究報告. SP94. 1-8 (1995)

    • Related Report
      1995 Annual Research Report
  • [Publications] 今泉敏: "病的音声の声質" 日本音響学会誌. 51. 887-892 (1995)

    • Related Report
      1995 Annual Research Report

URL: 

Published: 1995-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi