• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Speech Perception by Face and Voice in Older and Young People

Research Project

Project/Area Number 18530563
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Experimental psychology
Research InstitutionKumamoto University

Principal Investigator

SEKIIYAMA Kaoru  Kumamoto University, Faculty of Letters, Professor (70216539)

Project Period (FY) 2006 – 2007
Project Status Completed (Fiscal Year 2007)
Budget Amount *help
¥3,840,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥240,000)
Fiscal Year 2007: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2006: ¥2,800,000 (Direct Cost: ¥2,800,000)
KeywordsSpeech Perception / Development / Aging / Auditory-Vsiaul Integration / Hearing Level / Lipreading / 視聴覚
Research Abstract

The purpose of this research project was to examine developmental changes in integrating auditory (voice)and visual (face) information about speech. In face-to-face speech communication, it is known that people utilize visual articulating information for perceiving speech with a process of multimodal integration of auditory and visual cues. It was hypothesized that weighting of auditory and visual cues in the integration process is modified according to the individual's characteristics of sensory processing of unimodal information, thus, younger children with poor lipreading ability would depend on audition more and the elderly with age-related deterioration of hearing would depend on vision more. In this project, older people were focused on. Older (60 years to 65 years) and young (around 20 years) participants, both with normal hearing and normal or corrected to normal vision, were compared on auditory-visual speech perception. Older people were influenced by visual information more than the young when compared at a signal-to-noise ratio (SNR) where auditory-only hearing was 90% correct. Separately, each participant's hearing level was measured. The older group's threshold was significantly higher than the young, indicating some deterioration due to aging.
The next experiment was intended to measure reaction time (RT). To do so, a calibration was conducted for the hearing deterioration, thus, the older group was presented auditory speech at higher SNR by 4 dB. The results showed that even after auditory calibration, the older group used the visual cues more than the young. Moreover, RTs revealed that the older people process auditory cues more slowly than the young whereas the two groups were almost equally fast in processing visual cues. It was discussed that the slowed auditory processing of the old leads to greater possibility of the influence of the visual cues.

Report

(3 results)
  • 2007 Annual Research Report   Final Research Report Summary
  • 2006 Annual Research Report
  • Research Products

    (32 results)

All 2008 2007 2006

All Journal Article (16 results) (of which Peer Reviewed: 3 results) Presentation (15 results) Book (1 results)

  • [Journal Article] Impact of language on development of auditory-visual speech perception2008

    • Author(s)
      Sekiyama, K., Burnham, D.
    • Journal Title

      Developmental Science 11(2)

      Pages: 308-320

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Impact of language on development of auditory-visual speech perception2008

    • Author(s)
      Sekiyama, K., Burnham, D
    • Journal Title

      Developmental Science 11(2)

      Pages: 308-320

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Investigating auditory-visual speech perception development using the ontogenetic and differential language methods2008

    • Author(s)
      Burnham, D., Sekiyama, K
    • Journal Title

      In Vatikiotis-Bateson, Advances in auditory-visual speech processing MIT Press : Cambridge, MA(E., Perrier, P., & Bailly, G.(Eds.)) (in press)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Impact of language on development of auditory-visual speech perception.2008

    • Author(s)
      Sekiyama, K. & Burnham, D.
    • Journal Title

      Developmental Science 11(2)

      Pages: 308-320

    • Related Report
      2007 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 耳の衰えは処理速度に出る:視聴覚音声知覚の加齢変化2007

    • Author(s)
      積山 薫・坂本 真一
    • Journal Title

      日本音響学会聴覚研究会資料 37(10)

      Pages: 799-804

    • NAID

      40015881771

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Journal Article] 事象関連電位による視聴覚音声知覚の予備的検討2007

    • Author(s)
      久永 聡子・積山 薫
    • Journal Title

      日本音響学会聴覚研究会資料 37(10)

      Pages: 793-798

    • NAID

      40015881770

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Journal Article] bearing deterioration indicated by reaction time Trans. Tech.Comm. Psychol. Psysiol. Acoust.2007

    • Author(s)
      Sekiyama, K., Sakamoto, S
    • Journal Title

      The Acoust. Soc. Japan 37(10)

      Pages: 799-804

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] A preliminary examination of audiovisual speech perception by event-related potentials2007

    • Author(s)
      Hisanaga, S., Sekiyama, K
    • Journal Title

      Prans. Tech.Comm. Psychol. Psysiol. Acoust., The Acoust. Soc. Japan 37(10)

      Pages: 793-798

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Dynamic spatial cognition:Components,functions,and modifiability of body schema.2006

    • Author(s)
      Sekiyama, K.
    • Journal Title

      Japanese Psychological Research 48(3)

      Pages: 141-157

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] 加齢が視聴覚音声知覚に及ぼす影響2006

    • Author(s)
      高橋 裕司・積山 薫・坂本 真一
    • Journal Title

      日本音響学会聴覚研究会資料 36(4)

      Pages: 357-362

    • NAID

      40020289278

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Dynamic spatial cognition : Components, functions, and modifiability of body schema2006

    • Author(s)
      Sekiyama, K
    • Journal Title

      Japanese Psychological Research 48

      Pages: 141-157

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Aging related changes in audiovisual speech perception Trans. Tech.Comm. Psychol. Psysiol. Acoust.2006

    • Author(s)
      Takahashi, Y., Sekiyama, K., Sakamoto, S
    • Journal Title

      The Acoust. Soc. Japan 36(4)

      Pages: 357-362

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] 加齢が視聴覚音声知覚に及ぼす影響2006

    • Author(s)
      高橋裕司, 積山薫, 坂本真一
    • Journal Title

      日本音響学会聴覚研究会資料 36(4)

      Pages: 357-362

    • NAID

      40020289278

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Dynamic spatial cognition : Components, functions, and modifiability of body schema.2006

    • Author(s)
      Kaoru Sekiyama
    • Journal Title

      Japanese Psychological Research 48(3)

      Pages: 141-157

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 視聴覚音声知覚の発達に及ぼす言語の影響 : 反応時間の分析2006

    • Author(s)
      積山薫, Denis Burnham
    • Journal Title

      日本心理学会第70回大会発表論文集

      Pages: 1144-1144

    • NAID

      130007392552

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Auditory and visual characteristics of infant-directed speech by Japanese and Australian mothers.2006

    • Author(s)
      Denis Burnham, Kimiko Tsukada, Kaoru Sekiyama
    • Journal Title

      Program of XVth Biennial International Conference on Infant Studies (ICIS2006)

      Pages: 36-36

    • Related Report
      2006 Annual Research Report
  • [Presentation] 視聴覚音声知覚の発達と脳機能の特殊化2007

    • Author(s)
      積山 薫
    • Organizer
      日本音響学会秋季研究発表会スペシャル・セッション
    • Place of Presentation
      山梨大学
    • Year and Date
      2007-09-21
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Development and specialization of the brain in auditory-visual speech perception2007

    • Author(s)
      Sekiyama, K
    • Organizer
      Fall Meeting of the Acoust.Soc. Japan, 2007.
    • Place of Presentation
      Yamanashi Univ.
    • Year and Date
      2007-09-21
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] 視聴覚音声知覚の発達と脳機能の特殊化2007

    • Author(s)
      積山 薫
    • Organizer
      日本音響学会秋季研究発表会 スペシャル・セッション
    • Place of Presentation
      山梨大学
    • Year and Date
      2007-09-21
    • Related Report
      2007 Annual Research Report
  • [Presentation] 加齢による視聴覚音声知覚め変化2007

    • Author(s)
      積山 薫・坂本 真一
    • Organizer
      日本心理学会第71回大会
    • Place of Presentation
      東洋大学
    • Year and Date
      2007-09-18
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Age-related changes in auditory-visual speech perception2007

    • Author(s)
      ekiyama, SK, Sakamoto, S
    • Organizer
      71st Meeting of Jpn. Psychol. Assoc.
    • Place of Presentation
      Toyo Univ.
    • Year and Date
      2007-09-18
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] 加齢による視聴覚音声知覚の変化2007

    • Author(s)
      積山 薫・坂本 真一
    • Organizer
      日本心理学会第71回大会
    • Place of Presentation
      東洋大学
    • Year and Date
      2007-09-18
    • Related Report
      2007 Annual Research Report
  • [Presentation] Inter-language differences in auditory-visual speech perception:A developmental examination.2007

    • Author(s)
      Sekiyama, K., Burnham, D.
    • Organizer
      8tth International Multimodal Research Forum
    • Place of Presentation
      Sydney,Australia
    • Year and Date
      2007-07-07
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Inter-lahguage differences in auditory-visual speech perception : A developmental examination2007

    • Author(s)
      Sekiyama, K., Burnham, D
    • Organizer
      8th International Multimodal Res. Forum
    • Place of Presentation
      Sydney Univ., Australia
    • Year and Date
      2007-07-07
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Inter-language differences in auditory-visual speech perception: A developmental examination.2007

    • Author(s)
      Sekiyama, K. & Burnham, D.
    • Organizer
      8tth International Multimodal Research Forum
    • Place of Presentation
      Sydney,Australia
    • Year and Date
      2007-07-07
    • Related Report
      2007 Annual Research Report
  • [Presentation] Body image in children examined by mental rotation of hands.2007

    • Author(s)
      Sekiyama, K., Kinoshita, T.
    • Organizer
      Biennial Conference of Society for Research in Child Development
    • Place of Presentation
      Boston,USA
    • Year and Date
      2007-03-30
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Body image in children examined by mental rotation of hands2007

    • Author(s)
      Sekiyama, K., Kinoshita, T
    • Organizer
      Bineeial Conf. of Soo. Res. Child Devlopm
    • Place of Presentation
      Boston, USA.
    • Year and Date
      2007-03-30
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] 視聴覚音声知覚の発達に及ぼす言語の影響:反応時間の分析2006

    • Author(s)
      積山 薫・Burnham, D.
    • Organizer
      日本心理学会第70回大会
    • Place of Presentation
      福岡国際会議場
    • Year and Date
      2006-11-05
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Linguistic influence on development of auditory-visual speech perception2006

    • Author(s)
      Sekiyama, K., Burnham, D
    • Organizer
      70th Meeting of Jpn. Psychol. Assoc.
    • Place of Presentation
      Fukuoka
    • Year and Date
      2006-09-05
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Auditory and visual characteristics of infant-directed speech by Japanese and Australian mothers.2006

    • Author(s)
      Burnham, D., Sekiyama, K., Tsukada, K.
    • Organizer
      XVth Biennial International Conference on Infant Studies(ICIS 2006)
    • Place of Presentation
      Kyoto,Japan
    • Year and Date
      2006-06-21
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Auditory and visual characteristics of infant-directed speech by Japanese and Australian mothers2006

    • Author(s)
      Burnham, D., Sekiyama, K., Tsukada, K
    • Organizer
      XVth Internat. Conf. on Infant Studeis
    • Place of Presentation
      Kyoto
    • Year and Date
      2006-06-21
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Book] Vatikiotis-Bateson, E., Perrier, P., &Bailly, G.(Eds.), Advances in auditory-visual speech processing2008

    • Author(s)
      Burnham, D., Sekiyama, K.
    • Publisher
      MIT Press:Cambridge,MA(in press)
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary

URL: 

Published: 2006-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi