• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

An examination of the cognitive patterns and neural basis underlying the individual differences in the McGurk effect.

Research Project

Project/Area Number 19K20650
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 90030:Cognitive science-related
Research InstitutionRikkyo University (2022)
Ritsumeikan University (2021)
Chukyo University (2019-2020)

Principal Investigator

Ujiie Yuta  立教大学, 現代心理学部, 助教 (60781789)

Project Period (FY) 2019-04-01 – 2023-03-31
Project Status Completed (Fiscal Year 2022)
Budget Amount *help
¥2,990,000 (Direct Cost: ¥2,300,000、Indirect Cost: ¥690,000)
Fiscal Year 2021: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2020: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2019: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Keywords視聴覚統合 / McGurk効果 / 個人差 / 脳機能測定 / 自閉スペクトラム / 自閉症傾向 / 多様性
Outline of Research at the Start

本研究では、顔が関わる視聴覚統合であるマガーク効果を用いて、観察者側の認知様式の多様性とその背景となる神経基盤を検討する。マガーク効果では、欧米や東アジアといった文化の違いにかかわらず、話者の口元への注視がマガーク効果の強さ(視覚モダリティの重み付け)を説明することが、近年の行動実験により明らかとなっている。他方、fMRI研究では左上側頭溝(STS)の働きがマガーク効果の神経基盤として知られている。そこで本研究では行動実験(眼球運動計測など)と脳機能計測から、マガーク効果の多様性(個人差)の背景として想定される、口元への注視率と左STSの働きとの関連を明らかにすることを試みる。

Outline of Final Research Achievements

This project examined the factors contributing to individual differences in the McGurk effect in relation to autistic traits, specifically focusing on the influence of observers' cognitive styles and their neural basis. A series of experiments revealed the following insights. First, individual differences in the McGurk effect were associated with variations in brain activity, such as the left superior temporal sulcus, during observing the McGurk stimuli. Second, the individual differences in the McGurk effect were not attributed to visual face processing. Third, these individual differences were attributed to variations in the weighting of sensory information during the integration process. However, these differences may be situation-dependent. Overall, our findings provide valuable insights into understanding the underlying mechanisms of diversity in audiovisual speech integration.

Academic Significance and Societal Importance of the Research Achievements

マガーク効果の研究は、1976年にMcGurk & MacDonaldによる報告から40年以上経つ現在も、年間100報以上の論文が出されており、認知科学、心理学、音声工学、脳科学、精神病理学など様々な領域から注目を集めるテーマである。ヒトの音声知覚の特性を反映する錯覚のため、その生起メカニズムの解明はヒトがどのように顔と音声を統合するのか、そのメカニズムの理解に寄与できる。さらに、本研究は、自閉スペクトラムとの関連からマガーク効果の個人差を解明しようという試みであり、その成果により、知覚的側面から、自閉スペクトラムを持つ人の対人コミュニケーション困難性の理解に貢献できる可能性があるといえる。

Report

(5 results)
  • 2022 Annual Research Report   Final Research Report ( PDF )
  • 2021 Research-status Report
  • 2020 Research-status Report
  • 2019 Research-status Report
  • Research Products

    (45 results)

All 2023 2022 2021 2020 2019

All Journal Article (17 results) (of which Int'l Joint Research: 9 results,  Peer Reviewed: 12 results,  Open Access: 11 results) Presentation (28 results) (of which Int'l Joint Research: 5 results,  Invited: 1 results)

  • [Journal Article] Validation of the Japanese version of the Interoception Sensory Questionnaire for individuals with autism spectrum disorder2022

    • Author(s)
      Itoi Chihiro、Ujiie Yuta、Matsushima Kanae、Takahashi Kohske、Ide Masakazu
    • Journal Title

      Scientific Reports

      Volume: 12 Issue: 1 Pages: 1-9

    • DOI

      10.1038/s41598-022-25883-y

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Association of personality with habituation of physical and non-physical activities among Japanese adults: Results from questionnaire research before COVID-19 pandemic2022

    • Author(s)
      Ujiie Yuta、Takahashi Kohske
    • Journal Title

      Dialogues in Health

      Volume: 1 Pages: 1-6

    • DOI

      10.1016/j.dialog.2022.100076

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Subjective Sensitivity to Exteroceptive and Interoceptive processing in Highly Sensitive Person2022

    • Author(s)
      Ujiie Yuta、Takahashi Kohske
    • Journal Title

      Psychological Reports

      Volume: online first Issue: 1 Pages: 1-17

    • DOI

      10.1177/00332941221119403

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Own-race faces promote integrated audiovisual speech information2022

    • Author(s)
      Ujiie Yuta、Takahashi Kohske
    • Journal Title

      Quarterly Journal of Experimental Psychology

      Volume: 75 Issue: 5 Pages: 924-935

    • DOI

      10.1177/17470218211044480

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Associations between self-reported social touch avoidance, hypersensitivity, and autistic traits: Results from questionnaire research among typically developing adults2022

    • Author(s)
      Ujiie Yuta、Takahashi Kohske
    • Journal Title

      Personality and Individual Differences

      Volume: 184 Pages: 111186-111186

    • DOI

      10.1016/j.paid.2021.111186

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] アニマシー感と不快感がパターン検出に与える影響の検討2022

    • Author(s)
      喜田悠功、氏家悠太、髙橋康介
    • Journal Title

      映情学技報

      Volume: 46 Pages: 17-20

    • Related Report
      2021 Research-status Report
  • [Journal Article] The other-race effect on the McGurk effect in infancy2021

    • Author(s)
      Ujiie Yuta、Kanazawa So、Yamaguchi Masami K.
    • Journal Title

      Attention, Perception, & Psychophysics

      Volume: 83 Issue: 7 Pages: 2924-2936

    • DOI

      10.3758/s13414-021-02342-w

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] オンライン視知覚実験の現状と課題2021

    • Author(s)
      高橋康介、氏家悠太
    • Journal Title

      映像情報メディア学会誌

      Volume: 75 Pages: 463-468

    • Related Report
      2021 Research-status Report
  • [Journal Article] Weaker McGurk effect for Rubin's vase-type speech in people with high autistic traits.2021

    • Author(s)
      Ujiie Yuta, & Takahashi Kohske
    • Journal Title

      Multisensory Research

      Volume: published online Issue: 6 Pages: 1-17

    • DOI

      10.1163/22134808-bja10047

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Psychometric properties of the Family Allocentrism Scale among Japanese adults2021

    • Author(s)
      Ujiie Yuta, & Takahashi Kohske
    • Journal Title

      Heliyon

      Volume: 7 Issue: 1 Pages: e05871-e05871

    • DOI

      10.1016/j.heliyon.2020.e05871

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Development of the multisensory perception of water in infancy2020

    • Author(s)
      Ujiie Yuta, Kanazawa So, & Yamaguchi Masami K.
    • Journal Title

      Journal of Vision

      Volume: 20 Issue: 8 Pages: 1-7

    • DOI

      10.1167/jov.20.8.5

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Acute administration of methylphenidate differentially affects cortial processing of emotional facial expressions in ADHD children as studied by functional near infrared spectroscopy.2020

    • Author(s)
      Kobayashi M, Ikeda T, Tokuda T, Monden Y, Nagashima M, Mizushima SG, Inoue T, Shimamura K, UjiieY, Arakawa A, Kuroiwa C, Ishijima M, Kishimoto Y, Kanazawa S, Yamagata T, Yamaguchi MK, Sakuta R, Dan I
    • Journal Title

      Neurophotonics

      Volume: Apr;7 Issue: 02 Pages: 025003-025003

    • DOI

      10.1117/1.nph.7.2.025003

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] The Other-Race-Effect on Audiovisual Speech Integration in Infants: A NIRS Study2020

    • Author(s)
      Ujiie Yuta、Kanazawa So、Yamaguchi Masami K.
    • Journal Title

      Frontiers in Psychology

      Volume: 11 Pages: 971-971

    • DOI

      10.3389/fpsyg.2020.00971

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] 短文テキストへの絵文字付加がメッセージの印象と記憶に与える影響2020

    • Author(s)
      鈴木萌々香,榊原優南,氏家悠太,髙橋康介
    • Journal Title

      電子情報通信学会技術研究報告

      Volume: 120(218) Pages: 12-17

    • Related Report
      2020 Research-status Report
  • [Journal Article] 劣化音声の知覚的明瞭度に対する視覚プライムの左右差の検討2020

    • Author(s)
      西川琴美,氏家悠太,髙橋康介
    • Journal Title

      電子情報通信学会技術研究報告

      Volume: 120(218) Pages: 22-25

    • Related Report
      2020 Research-status Report
  • [Journal Article] 「素材質感」の視聴覚統合の脳内機構とその発達過程2020

    • Author(s)
      氏家悠太
    • Journal Title

      発達研究

      Volume: 34 Pages: 27-34

    • NAID

      40022317508

    • Related Report
      2020 Research-status Report
  • [Journal Article] Intact Lip-reading and Weak McGurk Effect in Individuals with High Autistic Traits.2019

    • Author(s)
      Ujiie, Y. & Wakabayashi, A.
    • Journal Title

      International Journal of Developmental Disabilities.

      Volume: - Issue: 1 Pages: 47-55

    • DOI

      10.1080/20473869.2019.1699350

    • Related Report
      2021 Research-status Report 2019 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] Subjective Sensitivity to Exteroceptive and Interoceptive processing in Highly Sensitive Person.2023

    • Author(s)
      Ujiie Yuta、Takahashi Kohske
    • Organizer
      The 2023 SPSP Virtual Annual Convention.
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 内受容感覚の主観評価と心拍知覚課題での定型・非定型発達の違い2023

    • Author(s)
      糸井千尋、氏家悠太、大石悠貴、柏野牧夫
    • Organizer
      第13回多感覚研究会
    • Related Report
      2022 Annual Research Report
  • [Presentation] Perception of audiovisual speech synchrony for familiar and unfamiliar ethnic speakers.2022

    • Author(s)
      Ujiie Yuta、Takahashi Kohske
    • Organizer
      The 44th European Conference on Visual Perception
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] No influence of color and contrast on Flashed Face Distortion Effect.2022

    • Author(s)
      Suzuki Momoka、Ujiie Yuta、Takahashi Kohske
    • Organizer
      The 44th European Conference on Visual Perception
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 外受容・内受容感覚への主観的な過敏さと感覚処理感受性との関連2022

    • Author(s)
      氏家悠太、髙橋康介
    • Organizer
      日本パーソナリティ心理学会第31回大会
    • Related Report
      2022 Annual Research Report
  • [Presentation] ニマシーを喚起するドット型ヘビ様刺激のパラメータに関する検討2022

    • Author(s)
      喜田悠功、氏家悠太、髙橋康介
    • Organizer
      HIP研究会
    • Related Report
      2022 Annual Research Report
  • [Presentation] 色コントラストが連続提示顔の変形効果に及ぼす影響2022

    • Author(s)
      鈴木萌々香、氏家悠太、髙橋康介
    • Organizer
      フォーラム顔学2022
    • Related Report
      2022 Annual Research Report
  • [Presentation] 長期フィールドワーカーの心理特性2022

    • Author(s)
      高橋康介、氏家悠太、小島康生、松浦直毅、島田将喜
    • Organizer
      日本心理学会第86回大会
    • Related Report
      2022 Annual Research Report
  • [Presentation] 日本語版Interoception Sensory Questionnaire (ISQ-J)の作成および信頼性・妥当性の検討2022

    • Author(s)
      糸井千尋、氏家悠太、松島佳苗、髙橋康介、井手正和
    • Organizer
      日本心理学会第86回大会
    • Related Report
      2022 Annual Research Report
  • [Presentation] アニマシー感と不快感がパターン検出に与える影響の検討2022

    • Author(s)
      喜田悠功、氏家悠太、髙橋康介
    • Organizer
      HI研究会
    • Related Report
      2021 Research-status Report
  • [Presentation] 連続提示顔の変形効果に影響する顔部位の検討2022

    • Author(s)
      鈴木萌々香、氏家悠太、髙橋康介
    • Organizer
      注意と認知研究会
    • Related Report
      2021 Research-status Report
  • [Presentation] Rubinの壺型刺激を用いた発話認識と自閉傾向との関連2022

    • Author(s)
      氏家悠太、髙橋康介
    • Organizer
      第12回多感覚研究会
    • Related Report
      2021 Research-status Report
  • [Presentation] 連続提示顔の変形効果に影響する顔部位の検討2022

    • Author(s)
      鈴木萌々香、氏家悠太、髙橋康介
    • Organizer
      日本認知心理学会第19回大会
    • Related Report
      2021 Research-status Report
  • [Presentation] 顔と声の同時性判断における話者の親近性の影響の検討2022

    • Author(s)
      氏家悠太、髙橋康介
    • Organizer
      日本認知心理学会第19回大会
    • Related Report
      2021 Research-status Report
  • [Presentation] Associations between self-reported social touch avoidance, hypersensitivity, and autistic traits: Results from questionnaire research among typically developing adult.2022

    • Author(s)
      Ujiie, Y. & Takahashi, K
    • Organizer
      the 2022 SPSP Virtual Annual Convention
    • Related Report
      2021 Research-status Report
  • [Presentation] 感覚処理感受性と錯視の主観的強度2022

    • Author(s)
      高橋康介、酒井政佳、鈴木理久人、堀田兼吾、山下棟健、氏家悠太
    • Organizer
      日本視覚学会2022年冬季大会
    • Related Report
      2021 Research-status Report
  • [Presentation] 自閉スペクトラム症における感覚過敏性と社会的接触の回避との関連2021

    • Author(s)
      氏家悠太、髙橋康介
    • Organizer
      日本パーソナリティ心理学会第30回大会
    • Related Report
      2021 Research-status Report
  • [Presentation] 仮面の顔らしさと魅力に関する心理学的検討2021

    • Author(s)
      髙橋康介、氏家悠太
    • Organizer
      第26回日本顔学会(フォーラム顔学2021)
    • Related Report
      2021 Research-status Report
  • [Presentation] Familiar faces induce a stronger McGurk effect than unfamiliar faces.2021

    • Author(s)
      Ujiie, Y. & Takahashi, K
    • Organizer
      The 43rd European Conference on Visual Perception
    • Related Report
      2021 Research-status Report
  • [Presentation] Cultural difference in young infants’ visual scanning of faces: Converging evidence from two independent studies.2021

    • Author(s)
      Xiao, N., Ujiie, Y., Liu, S., Quinn, P., Yamaguchi, M., Kanazawa, S., Lee, K., Tawfik, R., & Panesar, D
    • Organizer
      The 2021 SRCD Virtual Biennial
    • Related Report
      2021 Research-status Report
  • [Presentation] Autistic traits and influence of degraded facial speech on audiovisual speech perception2021

    • Author(s)
      Ujiie, Y. & Takahashi, K.
    • Organizer
      The 2021 SPSP Virtual Annual Convention
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] 劣化音声の知覚的明瞭度に対する視覚プライムの左右差の検討2020

    • Author(s)
      西川琴美,氏家悠太,髙橋康介
    • Organizer
      HCS研究会
    • Related Report
      2020 Research-status Report
  • [Presentation] 短文テキストへの絵文字付加がメッセージの印象と記憶に与える影響2020

    • Author(s)
      鈴木萌々香,榊原優南,氏家悠太,髙橋康介
    • Organizer
      HCS研究会
    • Related Report
      2020 Research-status Report
  • [Presentation] 運動の習慣化を妨げる心理特性の検討2020

    • Author(s)
      氏家悠太,西川琴美,横幕加奈,髙橋康介
    • Organizer
      日本心理学会第84回大会
    • Related Report
      2020 Research-status Report
  • [Presentation] Infants’ perceptual insensitivity to the other-race-face in multisensory speech perception.2019

    • Author(s)
      Ujiie Y., Kanazawa, S., & Yamaguchi, M.K.
    • Organizer
      The 15th Asia-Pacific Conference on Vision
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] 視聴覚統合における他人種効果.2019

    • Author(s)
      氏家悠太・高橋康介
    • Organizer
      日本基礎心理学会第38回大会
    • Related Report
      2019 Research-status Report
  • [Presentation] 視聴覚統合における他人種効果‐日本人大学生を対象とした検討‐.2019

    • Author(s)
      氏家悠太・高橋康介
    • Organizer
      第11回多感覚研究会
    • Related Report
      2019 Research-status Report
  • [Presentation] 発達障害の見る世界2019

    • Author(s)
      氏家悠太
    • Organizer
      東京都立心身障害者口腔保健センター 2019年度教育研修事業
    • Related Report
      2019 Research-status Report
    • Invited

URL: 

Published: 2019-04-18   Modified: 2024-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi