Investigating the role of eye movement and visual input in social cognition

• Project/Area Number: 16K13599
• Research Category: Grant-in-Aid for Challenging Exploratory Research
• Allocation Type: Multi-year Fund
• Research Field: Special needs education
• Research Institution: Waseda University (2018-2019); Osaka University (2016-2017)
• Principal Investigator: ISOMURA TOMOKO 早稲田大学, 理工学術院, 招聘研究員 (20771926)
• Project Period (FY): 2016-04-01 – 2020-03-31
• Project Status: Completed (Fiscal Year 2019)
• Budget Amount: ¥3,250,000 (Direct Cost: ¥2,500,000、Indirect Cost: ¥750,000); Fiscal Year 2018: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000); Fiscal Year 2017: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000); Fiscal Year 2016: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
• Keywords: 視線 / アイトラッキング / アイコンタクト / コミュニケーション / 社会認知機能 / 自閉症スペクトラム / 共感性 / 社会性認知 / 社会的認知 / 表情認知 / 視覚入力

Outline of Final Research Achievements

This research aimed to understand how visual input impacts our socio-cognitive information processing in the social interactions. We combined eye-tracking with face recognition based on machine learning and provided a tool for automatic analysis of mutual eye contact in naturalistic social interactions. We also found that eye contact enhances our perception to the sensations from the inside of the body such as heartbeats.

Academic Significance and Societal Importance of the Research Achievements

本研究の成果は、人間の社会的知性を支える認知メカニズムの解明につながる他、自閉症スペクトラム等の障害に対する介入、サポートに役立つことが期待される。また、人間同士の円滑なコミュニケーションに関わる視線のやり取りを明らかにすることで、人間と円滑にやり取りすることができるロボットの開発といった研究開発にも貢献しうる。

Research Products

• [Int'l Joint Research] Royal Holloway, University of London(英国)
• [Int'l Joint Research] DFKI(ドイツ)
• [Int'l Joint Research] ロンドン大学ロイヤルホロウェイ校(英国)
• [Journal Article] Direct gaze enhances interoceptive accuracy (2020)
  • Author(s): Isomura Tomoko, Watanabe Katsumi
  • Journal Title: Cognition Volume: 195 Pages: 104113-104113
  • DOI: 10.1016/j.cognition.2019.104113
  • Peer Reviewed / Open Access
• [Journal Article] MutualEyeContact: A conversation analysis tool with focus on eye contact (2020)
  • Author(s): Schafer Alexander, Isomura Tomoko, Reis Gerd, Watanabe Katsumi, Stricker Didier
  • Journal Title: ETRA '20 Short Papers: ACM Symposium on Eye Tracking Research and Applications Volume: 1 Pages: 1-5
  • DOI: 10.1145/3379156.3391340
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] 目の表情変化の検出が笑顔の真偽判断に及ぼす影響 (2020)
  • Author(s): 中島璃子, 磯村朋子, 石井辰典, 渡邊克巳
  • Journal Title: 信学技報 Volume: 120 Pages: 1-6
• [Presentation] MutualEyeContact: A conversation analysis tool with focus on eye contact (2020)
  • Author(s): Schafer Alexander, Isomura Tomoko, Reis Gerd, Watanabe Katsumi, Stricker Didier
  • Organizer: The 12th ACM Symposium on Eye Tracking Research & Applications
  • Int'l Joint Research
• [Presentation] 目の表情変化の検出が笑顔の真偽判断に及ぼす影響 (2020)
  • Author(s): 中島璃子, 磯村朋子, 石井辰典, 渡邊克巳
  • Organizer: ヒューマンコミュニケーション基礎(HCS)研究会 2020年5月研究会
• [Presentation] Cardiac timing modulates subjective perception of faces (2020)
  • Author(s): Tomoko Isomura, Manos Tsakiris, Katsumi Watanabe
  • Organizer: 顔・身体学 心理班合同ワークショップ
• [Presentation] Interoceptive modulation of facial emotion recognition (2019)
  • Author(s): Tomoko Isomura, Manos Tsakiris
  • Organizer: NEURO2019
• [Presentation] Local Features in Angry Faces Capture Attention in Children with Autism Spectrum Disorders Exhibiting Local-Biased Perceptual Characteristics (2019)
  • Author(s): Tomoko Isomura, Shino Ogawa, and Nobuo Masataka
  • Organizer: 11th International Conference on Knowledge and Smart Technology (KST), IEEE
  • Int'l Joint Research
• [Presentation] The role of interoception in emotion recognition (2018)
  • Author(s): Tomoko Isomura and Manos Tsakiris
  • Organizer: ESCAN (European Society for Cognitive Affective Neuroscience) 2018
  • Int'l Joint Research
• [Presentation] 表情模倣から探る社会認知の発達 (2017)
  • Author(s): 磯村朋子
  • Organizer: 第161回生命機能研究科研究交流会