• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

An experimental study on the process of audio-visual integration in the perception of words and sentences.

Research Project

Project/Area Number 02610064
Research Category

Grant-in-Aid for General Scientific Research (C)

Allocation TypeSingle-year Grants
Research Field Psychology
Research InstitutionKitasato University

Principal Investigator

SUMI Shigeno  Kitasato University associate professor, 教養部, 助教授 (20162589)

Project Period (FY) 1990 – 1991
Project Status Completed (Fiscal Year 1991)
Budget Amount *help
¥1,600,000 (Direct Cost: ¥1,600,000)
Fiscal Year 1991: ¥600,000 (Direct Cost: ¥600,000)
Fiscal Year 1990: ¥1,000,000 (Direct Cost: ¥1,000,000)
KeywordsMcGurk Effect / Vowel-contingent Effect / Stimulus Order Effect / Absolute Pitch / Audio-visual Integration / Model of Speech Perception / Categorical Perception / 係留効果
Research Abstract

I investigated the McGurk effect, the effect of visual information of articulation upon auditory phonetic judgements, by conducting some discrimination and psychological experiments. The main results obtained from the experiments were as follows.
(1)McGurk effect might occur, at the stage just after the auditory information processing but before the phonetic information processing.
(2)The perception of consonants are defined by the vowel environment. In this case, the most influential factor to define the perception of consonants is not the categories of vowels but their acoustic features.
(3)Stimulus order effect can be observed in the McGurk effect experiments. Several expei iments were fur ther conducted on stimulus order effect. The results snowed that prototypes of vowels acquired through the learning of mother tongue has an important role in speech perception.
(4)Categorical perception on speech sounds were compared with that of musical intervals by absolute pitch possessors. The experimental results suggest that the former is much influenced by context effects but the latter is less or hardly influenced by context effects.
The model of speech perception is further examined by referring to the results obtained from the audio-visual experiments. The model is modified by introducing the stage where the auditory and visual informations are integrated.

Report

(3 results)
  • 1991 Annual Research Report   Final Research Report Summary
  • 1990 Annual Research Report
  • Research Products

    (21 results)

All Other

All Publications (21 results)

  • [Publications] 重野 純: "音韻知覚における文脈効果" 心理学モノグラフ. 20. 1-134 (1990)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] SUMI SHIGENO: "Vowel-contingent anchoring effects on the perception of stop consonants" Proceedings of the International Conference on Spoken Language Processing. 573-576 (1990)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] SUMI SHIGENO: "Assimilation and contrast in the phonetic perception of vowels" Journal of the Acoustical Society of America. 90. 103-111 (1991)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] 重野 純: "絶対音感保持者の音高知覚と時間知覚の間の相互作用" 日本音響学会聴覚研究会資料. Hー91ー53. 1-8 (1991)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] 重野 純: "母音知覚における文脈効果" 音声言語医学.

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] SUMI SHIGENO (Y.Tohkura,E.Vetikios-Bateson,Y.Sagisaka(Eds.)): "Speech Perception,Production and Linguistic Structure "Assimilation and contrast in vowel perception"(pp.3-20)" Ohmsha,IOS Press, (1992)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] 重野 純(鳥居 修晃編): "知覚の機序ー第5章音声言語の知覚における視聴覚情報の統合過程" 培風館,

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Sumi Shigeno: "Context effects in speech perception." Japanese Psychological Monographs. 20. 1-134 (1990)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Sumi Shigeno: "Vowel-contingent anchoring effects on the perception of stop consonants." Proceedings of the International Conference on Spoken Language Processing. 573-576 (1990)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Sumi Shigeno: "Assimilation and contrast in the phonetic perception of vowels." Journal of the Acoustical Society of America. 90. 103-111 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Sumi Shigeno: "Interdependence of temporal auditory judgements by absolute pitch possessors." Transaction of the Committee on Auditory Research, Acoustical Society of Japan. H-91-53. 1-8 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Sumi Shigeno: "Context effects in vowel perception." Journal of Logopedics and Phoniatrics.

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Sumi Shigeno: "Assimilation and contrast in vowel perception." Speech Perception, Production and Linguistic Structure. IOS Press. 3-20 (1992)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Sumi Shigeno: "Integration process of audio-visual information in speech perception." Mechanisms of Perception.Baihukan.

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] SUMI SHIGENO: "Assimilation and contrast in the phonetic perception of vowels." Journal of the Acoustical Society of America. 90. 103-111 (1991)

    • Related Report
      1991 Annual Research Report
  • [Publications] 重野 純: "絶対音感保持者の音高知覚と時間知覚の間の相互作用" 日本音響学会聴覚研究会資料. Hー91ー53. 1-8 (1991)

    • Related Report
      1991 Annual Research Report
  • [Publications] 重野 純: "母音知覚における文脈効果" 音声言語医学.

    • Related Report
      1991 Annual Research Report
  • [Publications] SUMI SHIGENO(Y.Tohkura,E.VetikiosーBateson,Y.Sagisaka(Eds.)): "Speech Perception,Production and Linguistic structure “Assimilation and contrast in vowel perception"(pp.3ー20)" Ohmsha,IOS Press, 463 (1992)

    • Related Report
      1991 Annual Research Report
  • [Publications] 重野 純(鳥居 修晃編): "知覚の機序ー第5章音声言語の知覚における視聴覚情報の統合過程" 培風館,

    • Related Report
      1991 Annual Research Report
  • [Publications] 重野 純: "音韻知覚における文脈効果" 心理学モノグラフ. 20. 1-134 (1990)

    • Related Report
      1990 Annual Research Report
  • [Publications] SUMI SHIGENO: "Vowelーcontingent anchoring effects on the perception of stop consonants" Proceedings of the International Corference on Spoken Language Processing. 573-576 (1990)

    • Related Report
      1990 Annual Research Report

URL: 

Published: 1990-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi