Simultaneous eye-tracking recording of multiple participants and eye-tracking technology applications in English learning

• Project/Area Number: 15H05381
• Research Category: Grant-in-Aid for Young Scientists (A)
• Allocation Type: Single-year Grants
• Research Field: Foreign language education
• Research Institution: The University of Tokyo
• Principal Investigator: Nakamura Chie 東京大学, 大学院総合文化研究科, 学術研究員 (30726823)
• Project Period (FY): 2015-04-01 – 2019-03-31
• Project Status: Completed (Fiscal Year 2018)
• Budget Amount: ¥20,020,000 (Direct Cost: ¥15,400,000、Indirect Cost: ¥4,620,000); Fiscal Year 2018: ¥2,860,000 (Direct Cost: ¥2,200,000、Indirect Cost: ¥660,000); Fiscal Year 2017: ¥5,720,000 (Direct Cost: ¥4,400,000、Indirect Cost: ¥1,320,000); Fiscal Year 2016: ¥7,020,000 (Direct Cost: ¥5,400,000、Indirect Cost: ¥1,620,000); Fiscal Year 2015: ¥4,420,000 (Direct Cost: ¥3,400,000、Indirect Cost: ¥1,020,000)
• Keywords: 第二言語習得 / 眼球運動計測 / プロソディー / 動詞情報 / 心理言語学 / アイトラッキング / プライミング / 文処理 / 眼球運動 / 視覚世界パラダイム / 第二言語 / 英語教育

Outline of Final Research Achievements

In a series of visual world eye-tracking experiments, this study examined how L2 learner's knowledge of the target language, such as verb subcategorization information and prosodic information, is referenced during online sentence processing. The results revealed the qualitative difference between native speakers and language learners in building structural representation of a sentence; L2 leaners were sensitive to linguistic information and used the information in constructing structural analysis. However, unlike native speakers who showed anticipatory use of linguistic information in sentence processing, L2 learners did not show anticipatory effects. The results suggest the possibility that L2 leaners do not make strong predictions about upcoming sentence structure.

Academic Significance and Societal Importance of the Research Achievements

本研究は、人間が聴覚情報や視覚情報を処理する際の眼球運動という時間解像度に優れたデータの分析から第二言語学習者に内在する認知メカニズムの解明を行った。これにより、語彙の意味情報, 音声のプロソディー情報, さらには統語的プライミング（先行する特定の文型が後続の処理を促進または抑制する効果）などの認知現象が文のインプットに即して行われる漸次的処理過程(incremental processing)にどう影響を与えるかを明らかにした。これらの成果は、心理言語学実験を広い範囲の母集団を対象に行うための技術整備と眼球運動計測技術を教育に応用する環境開発を行うための重要な資料となった。

Research Products

• [Int'l Joint Research] Massachusetts Institute of Technology/University of California Los Angeles(米国)
• [Int'l Joint Research] National Center for Scientific Research(フランス)
• [Int'l Joint Research] Massachusetts Institute of Technology/University of California Los Angeles(米国)
• [Journal Article] Listener's belief influences prosodic adaptation: Anticipatory use of contrastive accent during visual search (2019)
  • Author(s): Nakamura, C., Harris, J. A., & Jun, S. A.
  • Journal Title: Proceedings of International Congress of Phonetic Sciences 2019 Volume: 未定
  • Peer Reviewed / Open Access / Int'l Joint Research
• [Journal Article] L2 adaptation to unreliable prosody during structural analysis: A visual world study (2019)
  • Author(s): Nakamura, C., Harris, J. A., & Jun, S. A.
  • Journal Title: BUCLD 43 Proceedings Volume: 未定
  • Peer Reviewed / Open Access / Int'l Joint Research
• [Journal Article] 日本人英語学習者の曖昧文理解における動詞下位範疇化情報の使用: 統語的プライミング効果に見られる母語話者との違い (2019)
  • Author(s): 中村智栄・新井学・原田康也
  • Journal Title: 言語研究 Volume: 未定
  • NAID: 130007723497
  • Peer Reviewed / Open Access
• [Journal Article] Predicting native language from gaze (2017)
  • Author(s): Berzak, Y. Nakamura, C. Flynn, S. & Katz, B.
  • Journal Title: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics Volume: なし Pages: 541-551
  • Peer Reviewed / Open Access / Int'l Joint Research
• [Journal Article] Prosody helps L1 speakers but confuses L2 learners: Influence of L+H* pitch accent on referential ambiguity resolution (2016)
  • Author(s): Nakamura, C., Arai, M. Hirose, Y., & Flynn, S.
  • Journal Title: Proceedings of Speech Prosody 8 Volume: -
  • Peer Reviewed / Open Access / Int'l Joint Research
• [Journal Article] It's harder to break a relationship when you commit long (2016)
  • Author(s): Arai, M. and Nakamura, C.
  • Journal Title: Plos One Volume: 11 Issue: 6 Pages: e0156482-e0156482
  • DOI: 10.1371/journal.pone.0156482
  • Peer Reviewed
• [Journal Article] 日本人英語学習者の関係節文理解におけるプロソディー情報の影響 (2015)
  • Author(s): 中村智栄・新井学・原田康也
  • Journal Title: 日本英語教育学会第44回年次研究集会論文集 Volume: なし Pages: 61-68
  • Peer Reviewed / Open Access
• [Journal Article] Predicting the verb in comprehending Japanese (2015)
  • Author(s): Arai, M., Nakamura, C. & Hirose, Y.
  • Journal Title: IEICE Technical Report Volume: 115 Pages: 19-22
• [Journal Article] Word order priming in Japanese -The role of verb repetition- (2015)
  • Author(s): Deng, Y. & Nakamura, C.
  • Journal Title: IEICE Technical Report Volume: 115 Pages: 61-64
• [Presentation] Listeners' belief about the speaker and adaptation to the deviant use of prosody (2019)
  • Author(s): Nakamura, C., Harris, J. A., & Jun, S. A.
  • Organizer: 32nd Annual CUNY Conference on Human Sentence Processing
  • Int'l Joint Research
• [Presentation] Prosody-meaning mismatches in PP ambiguity: Incremental processing with pupillometry (2019)
  • Author(s): Harris, J. A., Nakamura, C., Bethany Sturman, & Jun, S. A.
  • Organizer: 32nd Annual CUNY Conference on Human Sentence Processing
  • Int'l Joint Research
• [Presentation] Adaptation to speaker-specific prosody during visual search (2018)
  • Author(s): Nakamura, C., Harris, J. A., & Jun, S. A.
  • Organizer: California Meeting on Psycholinguistics 2018
  • Int'l Joint Research
• [Presentation] L2 adaptation to unreliable prosody during structural analysis: A visual world study (2018)
  • Author(s): Nakamura, C., Harris, A. J., Jun, S. A., & Hirose, Y.
  • Organizer: 43rd Annual Boston University Conference on Language Development
  • Int'l Joint Research
• [Presentation] Cue reliability affects anticipatory use of prosody in processing globally ambiguous sentences (2018)
  • Author(s): Nakamura, C., Harris, A.J., & Jun, S.A.
  • Organizer: Annual CUNY Sentence Processing Conference
  • Int'l Joint Research
• [Presentation] Predictive processing and reliability in the influence of prosody in L2 structural analysis (2018)
  • Author(s): Nakamura, C., Harris, A.J., Jun, S.A., & Hirose, Y.
  • Organizer: Annual CUNY Sentence Processing Conference
  • Int'l Joint Research
• [Presentation] Anticipatory effects and the reliability of prosody in processing globally ambiguous structures (2017)
  • Author(s): Nakamura, C., Harris, J., & Jun, S.A.
  • Organizer: California Meeting on Psycholinguistics
  • Int'l Joint Research
• [Presentation] The use of prosody by children, adults, and learners: Similarities and differences. (2017)
  • Author(s): Nakamura, C.
  • Organizer: Japan Society for Language Sciences 19th Annual International Conference
  • Int'l Joint Research / Invited
• [Presentation] Predicting native language from gaze (2017)
  • Author(s): Berzak, Y. Nakamura, C. Flynn, S. & Katz, B.
  • Organizer: Annual Meeting of the Association for Computational Linguistics
  • Int'l Joint Research
• [Presentation] It needs to be specific: Contribution of semantic information in L2 learners' processing of English relative clause structures (2016)
  • Author(s): Nakamura, C., & Flynn, S.
  • Organizer: 35th Second Language Research Forum
  • Place of Presentation: ニューヨーク（アメリカ）
  • Year and Date: 2016-09-22
  • Int'l Joint Research
• [Presentation] Semantic ambiguity makes it difficult for L2 learners to understand English relative clause sentences (2016)
  • Author(s): Nakamura, C., & Flynn, S.
  • Organizer: 10th International Conference on Multilingualism and Third Language Acquisition
  • Place of Presentation: ウィーン（オーストリア）
  • Year and Date: 2016-09-01
  • Int'l Joint Research
• [Presentation] Priming from a previously predicted but unseen verb (2016)
  • Author(s): Arai, M., Nakamura, C., & Hirose, Y.
  • Organizer: 22nd Annual Conference on Architectures and Mechanisms for Language Processing
  • Place of Presentation: バスク（スペイン）
  • Year and Date: 2016-09-01
  • Int'l Joint Research
• [Presentation] Language switching costs in picture naming: Evidence from highly proficient Chinese learners of Japanese (2016)
  • Author(s): Ying, D. & Nakamura, C.
  • Organizer: 9th International Workshop on Language Production
  • Place of Presentation: サンディエゴ（アメリカ）
  • Year and Date: 2016-07-25
  • Int'l Joint Research
• [Presentation] Prosody helped L1 speakers but confuses L2 learners: Influence of L+H* pitch accent on referential ambiguity resolution (2016)
  • Author(s): Nakamura, C., Arai, M., Hirose, Y.
  • Organizer: Speech Prosody 2016
  • Place of Presentation: ボストン（アメリカ）
  • Year and Date: 2016-05-31
  • Int'l Joint Research
• [Presentation] Restricted fine-grained parsing in second language: Influence of lexically specific information in L2 processing (2016)
  • Author(s): Nakamura, C., Arai, M., Hirose, Y., & Flynn, S.
  • Organizer: International Symposium on Bilingual and L2 Processing in Adults and Children
  • Place of Presentation: カイザースラウテルン（ドイツ）
  • Year and Date: 2016-04-14
  • Int'l Joint Research
• [Presentation] Restricted fine-grained parsing in second language: Influence of lexically specific information in L2 processing (2016)
  • Author(s): Nakamura, C., Arai, M., Hirose, Y., & Flynn, S.
  • Organizer: International Symposium on Bilingual and L2 Processing in Adults and Children
  • Place of Presentation: Malta University, Malta
  • Year and Date: 2016-04-14
  • Int'l Joint Research
• [Presentation] Grain problem in L2 sentence processing: Evidence for L2 learner's use of lexically specific information (2015)
  • Author(s): Nakamura, C., Arai, M., Hirose, Y., & Harada, Y.
  • Organizer: The 21st Annual Conference on Architectures and Mechanisms for Language Processing
  • Place of Presentation: Malta University, Malta
  • Year and Date: 2015-09-03
  • Int'l Joint Research
• [Presentation] Verb repetition boosts priming of voice but not word order: Evidence from transitive sentence production in Japanese (2015)
  • Author(s): Deng, Y. & Nakamura, C.
  • Organizer: The 21st Annual Conference on Architectures and Mechanisms for Language Processing
  • Place of Presentation: University of Kaiserslautern, Germany
  • Year and Date: 2015-09-03
  • Int'l Joint Research
• [Remarks] Chie Nakamura, Ph.D. Publications
  • URL: https://sites.google.com/site/carumakan/home/publication