Investigation of the differences between phonetic and phonemic perception using mismatch negativity (MMN) responses

• Project/Area Number: 19K13169
• Research Category: Grant-in-Aid for Early-Career Scientists
• Allocation Type: Multi-year Fund
• Review Section: Basic Section 02060:Linguistics-related
• Research Institution: Waseda University
• Principal Investigator: 篠原 靖明 早稲田大学, 商学学術院, 准教授 (10732737)
• Project Period (FY): 2019-04-01 – 2024-03-31
• Project Status: Granted (Fiscal Year 2022)
• Budget Amount: ¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000); Fiscal Year 2022: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000); Fiscal Year 2021: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000); Fiscal Year 2020: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000); Fiscal Year 2019: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
• Keywords: 音声知覚 / 音素認識 / ミスマッチ陰性電位（MMN） / 事象関連電位（ERP) / ミスマッチ陰性電位（MMN) / ミスマッチ陰性電位

Outline of Research at the Start

脳が言語音をどのように認知するかという問いに関して、これまで数十年に渡り多くの研究がなされてきた。その中で、ヒトが言語音を認知する際、音響、音声、音韻といった知覚の段階が存在するといわれてきた。本研究では、行動実験と脳波計測実験の両面から、この音声と音韻の知覚段階の違いとその境界について調査する。また、これまでの研究で使われてきた実験方法の妥当性も検証する。

Outline of Annual Research Achievements

本研究では、ヒトが言語音を音声として知覚した際、また音素として認識した際に表れる脳波をそれぞれ計測し、その違いを明確化することを目的としている。本課題４年目にあたる2022年度には、前年度に録音した音声を使って、日本語話者が日本語音声(音素)を知覚している際の脳波計測を遂行した。三条件下におけるミスマッチ陰性電位（MMN）の振幅やそのタイミングを計測し、比較した結果、ヒトが言語音を音素として認識する際、MMNの振幅が大きくなること、またそのタイミングが他の条件と異なることが分かった。本研究結果は、脳の言語音声処理メカニズムを解明することに貢献する。2023年度には、本結果を国際学会で発表する予定であり、さらに論文として国際ジャーナルへ投稿することを予定している。

Current Status of Research Progress

3: Progress in research has been slightly delayed.

Reason

コロナウイルス感染症拡大の影響により、本研究のデータ収集の開始時期に遅れが生じた。

Strategy for Future Research Activity

2022年度に収集したデータを2023年度も継続して分析する。その結果を国際学会で発表し、さらに国際ジャーナルへ論文として投稿する予定である。

Research Products

• [Int'l Joint Research] City University of New York/University of Delaware(米国)
• [Int'l Joint Research] The Education University of Hong Kong(香港)
• [Int'l Joint Research] University of Glasgow(英国)
• [Int'l Joint Research] University of Delaware(米国)
• [Int'l Joint Research] University College London(英国)
• [Int'l Joint Research] University of Delaware(米国)
• [Int'l Joint Research] University College London(英国)
• [Int'l Joint Research] University of Delaware(米国)
• [Journal Article] Perception of noise-vocoded sine-wave speech of Japanese pitch-accent words (2022)
  • Author(s): Yasuaki SHINOHARA
  • Journal Title: JASA Express Letters Volume: 2 Issue: 8
  • DOI: 10.1121/10.0013423
  • Peer Reviewed / Open Access
• [Journal Article] Non-native length contrast perception by Japanese and Cantonese speakers (2022)
  • Author(s): Albert LEE, Yasuaki SHINOHARA, Tsz Ching MUT
  • Journal Title: Proceedings of Meetings on Acoustics Volume: 45 Pages: 060003-060003
  • DOI: 10.1121/2.0001529
  • Peer Reviewed / Open Access / Int'l Joint Research
• [Journal Article] Discriminability and prototypicality of nonnative vowels (2022)
  • Author(s): Yasuaki SHINOHARA, Chao HAN, Arild HESTVIK
  • Journal Title: Studies in Second Language Acquisition Volume: - Issue: 5 Pages: 1-19
  • DOI: 10.1017/s0272263121000978
  • Peer Reviewed / Open Access / Int'l Joint Research
• [Journal Article] The effect of age on English /r/-/l/ perceptual training outcomes for Japanese speakers (2021)
  • Author(s): Yasuaki SHINOHARA, Paul IVERSON
  • Journal Title: Journal of Phonetics Volume: 89 Pages: 1-24
  • DOI: 10.1016/j.wocn.2021.101108
  • Peer Reviewed / Open Access / Int'l Joint Research
• [Journal Article] Audiovisual English /r/-/l/ identification training for Japanese-speaking adults and children (2021)
  • Author(s): Yasuaki SHINOHARA
  • Journal Title: Journal of Speech, Language, and Hearing Research Volume: 64 Issue: 7 Pages: 2529-2538
  • DOI: 10.1044/2021_jslhr-20-00506
  • Peer Reviewed / Open Access
• [Journal Article] Abstractness of human speech sound representations (2019)
  • Author(s): Hestvik A, Shinohara Y, Durvasula K, Verdonschot R, Sakai H
  • Journal Title: Brain Research Volume: 1732 Pages: 146664-146664
  • DOI: 10.1016/j.brainres.2020.146664
  • Peer Reviewed / Open Access / Int'l Joint Research
• [Journal Article] Effects of perceptual assimilation: The perception of English /æ/, /ʌ/, and /ɑ/ by Japanese speakers (2019)
  • Author(s): Yasuaki SHINOHARA, Chao HAN, Arild HESTVIK
  • Journal Title: Proc. the 19th International Congress of Phonetic Sciences Volume: - Pages: 2344-2348
  • Peer Reviewed / Open Access / Int'l Joint Research
• [Presentation] Japanese pitch-accent perception of noise-vocoded sine-wave speec (2022)
  • Author(s): Yasuaki Shinohara
  • Organizer: The 183rd meeting of the Acoustical Society of America, Nashville, Tennessee USA
  • Int'l Joint Research
• [Presentation] 自閉スペクトラム症児の音韻カテゴリ知覚 (2020)
  • Author(s): Mariko UCHIDA, Yasuaki SHINOHARA, Tomoko MATSUI, Kazunari IKEDA, Hiroshi FUJINO, Yoshikuni TOJO, Koichiro HAKARINO
  • Organizer: The 31st Annual Meeting for the Japan Society of Developmental Psychology (JSDP 2020)
• [Presentation] Effects of perceptual assimilation: The perception of English /æ/, /ʌ/, and /ɑ/ by Japanese speakers (2019)
  • Author(s): Yasuaki SHINOHARA, Chao HAN, Arild HESTVIK
  • Organizer: The 19th International Congress of Phonetic Sciences (ICPhS) 2019
  • Int'l Joint Research
• [Presentation] Effects of perceptual assimilation and vowel peripherality in perceiving non-native vowels (2019)
  • Author(s): Yasuaki SHINOHARA, Chao HAN, Arild HESTVIK
  • Organizer: New Sounds 2019
  • Int'l Joint Research
• [Presentation] Examination of theoretical models in second-language (L2) speech perception: The Perceptual Assimilation Model (PAM) and the Natural Referent Vowel (NRV) framework (2019)
  • Author(s): Yasuaki SHINOHARA
  • Organizer: Research Workshop of Institute of Language and Speech Science, Waseda University
• [Remarks] Publications - Yasuaki SHINOHARA
  • URL: http://www.f.waseda.jp/y.shinohara/publications.html
• [Remarks] Publications
  • URL: http://www.f.waseda.jp/y.shinohara/publications.html