• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Assessment of nonverbal communication using EEG hyperscanning

Research Project

Project/Area Number 17K20020
Research Category

Grant-in-Aid for Challenging Research (Exploratory)

Allocation TypeMulti-year Fund
Research Field Human informatics and related fields
Research InstitutionNational Institute of Advanced Industrial Science and Technology

Principal Investigator

Iwaki Sunao  国立研究開発法人産業技術総合研究所, 情報・人間工学領域, 副研究部門長 (70356525)

Co-Investigator(Kenkyū-buntansha) 梅村 浩之  国立研究開発法人産業技術総合研究所, 情報・人間工学領域, 研究チーム長 (10356587)
Project Period (FY) 2017-06-30 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥6,370,000 (Direct Cost: ¥4,900,000、Indirect Cost: ¥1,470,000)
Fiscal Year 2019: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2018: ¥2,990,000 (Direct Cost: ¥2,300,000、Indirect Cost: ¥690,000)
Fiscal Year 2017: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
Keywords脳波 / ハイパースキャン / 非言語的コミュニケーション / 脳波ハイパースキャン / 自発脳活動 / 脳波同期 / 被験者間脳活動同期 / 非侵襲脳機能計測 / 非言語コミュニケーション
Outline of Final Research Achievements

The purpose of this study was to develop a technique to simultaneously measure brain activity signals from two participants who are performing a face-to-face nonverbal communication (hyper-scanning), to analyze the relationship of neural activity between the two participants, and to develop an evaluation technique for face-to-face communication in a virtual reality (VR) space. We confirmed that it is possible to measure the activity of the mirror neuron system as the basis of communication during eye contact, and to evaluate the allocation of cognitive resources of both participants for task execution based on the correlation of spontaneous brain activity between them while engaged in nonverbal cooperative tasks. The results showed that it is possible to evaluate the cooperative status of the two participants.

Academic Significance and Societal Importance of the Research Achievements

非言語的コミュニケーションや協調作業を効率的に行うには,参加者間の協調の姿勢が欠かせない.これまでも,他者の行為や周囲環境の観察にともなって自己の運動が変化する現象などが明らかになっているが,参加者間の行為と認知のループの中での非言語的情報交換の神経学的メカニズムはまったく明らかにされていない.本研究の学術的意義は,非言語的協調作業を行っている二者間の協調の状態を,自発脳活動の相関関係を用いた両者の認知リソースの配分状況の時間的変化の観点から評価可能にする点にある.

Report

(6 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Research-status Report
  • 2019 Research-status Report
  • 2018 Research-status Report
  • 2017 Research-status Report
  • Research Products

    (32 results)

All 2022 2021 2019 2018 2017 Other

All Journal Article (8 results) (of which Int'l Joint Research: 4 results,  Peer Reviewed: 6 results,  Open Access: 2 results) Presentation (21 results) (of which Int'l Joint Research: 16 results,  Invited: 3 results) Remarks (3 results)

  • [Journal Article] Putative ratios of facial attractiveness in a deep neural network2021

    • Author(s)
      Tong S., Liang X., Kumada T., Iwaki S
    • Journal Title

      Vision Research

      Volume: 178 Pages: 86-99

    • DOI

      10.1016/j.visres.2020.10.001

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Parietal gamma-band activity during mental rotation task reflects individual performance in vehicle driving2019

    • Author(s)
      Iwaki S
    • Journal Title

      Perception

      Volume: 48(25) Issue: 2_suppl Pages: 211-222

    • DOI

      10.1177/0301006619863862

    • Related Report
      2019 Research-status Report
    • Peer Reviewed
  • [Journal Article] Golden ratio: the attributes of facial attractiveness learned by CNN2019

    • Author(s)
      Liang X., Tong S., Kumada T., Iwaki S.,
    • Journal Title

      Proceedings of 2019 IEEE International Conference on Image Processing (ICIP)

      Volume: 2019 Pages: 2124-2128

    • DOI

      10.1109/icip.2019.8803166

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] 医療現場を支える電気技術2019

    • Author(s)
      岩木 直
    • Journal Title

      電気総合誌オーム

      Volume: 106 Pages: 10-13

    • Related Report
      2018 Research-status Report
  • [Journal Article] Multimodal Neuroimaging to Visualize Brain Networks for 3-D Object Perception2018

    • Author(s)
      S. Iwaki, J.W. Belliveau
    • Journal Title

      IDW '18 Proceedings of the International Display Workshops

      Volume: 25 Pages: 964-967

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] サービス・製造プロセス分析のための脳活動センシング技術2017

    • Author(s)
      岩木 直
    • Journal Title

      電子情報通信学会誌

      Volume: 100 Pages: 301-305

    • Related Report
      2017 Research-status Report
    • Peer Reviewed
  • [Journal Article] MEG-fMRI multimodal integration to investigate neural dynamics while perceiving 3-D object shape from motion2017

    • Author(s)
      Sunao Iwaki, John W. Belliveau
    • Journal Title

      Advances in Neuroinformatics V

      Volume: V

    • DOI

      10.14931/aini2017.osiv.2

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] 脳波を用いた運転支援システム利用中の注意リソース配分評価2017

    • Author(s)
      岩木 直
    • Journal Title

      車載テクノロジー

      Volume: 5-3 Pages: 52-55

    • Related Report
      2017 Research-status Report
  • [Presentation] 自発脳波同期に基づいた没入型VR 環境における協調作業パフォーマンスの定量的評価2022

    • Author(s)
      佐藤 駿,岩木 直
    • Organizer
      第32回実社会におけるマルチモーダル脳情報応用技術研究会
    • Related Report
      2021 Annual Research Report
  • [Presentation] EEG gamma-band synchrony predicts driving performance2021

    • Author(s)
      S .Iwaki
    • Organizer
      3rd International Ergonomics Conference
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Effect of 2D and 3D perspective on spatial cognition representation2021

    • Author(s)
      X. Zhang, S. Iwaki
    • Organizer
      27th Annual Meeting of the Organization for Human Brain Mapping
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Acute changes in default-mode functional connectivity by cognitive fatigue2021

    • Author(s)
      S. Iwaki, T. Fujiwara
    • Organizer
      50th annual meeting of the Society for Neuroscience
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Reduced alpha-band synchrony during EEG hyperscanning of cooperative cognitive task performance2021

    • Author(s)
      岩木 直
    • Organizer
      第60回日本生体医工学会大会
    • Related Report
      2021 Annual Research Report
  • [Presentation] Cognitive fatigue induces changes in resting-state functional connectivity2021

    • Author(s)
      Iwaki S., Fujiwara T.
    • Organizer
      Society for Neuroscience Global Connectome A Virtual Event
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] 外的報酬・アンダーマイニング効果・自己決定性との関係2021

    • Author(s)
      岩崎香具矢, 岩木直
    • Organizer
      第30回日本生体医工学会実社会におけるマルチモーダル脳情報応用技術研究会
    • Related Report
      2020 Research-status Report
  • [Presentation] EEG hyperscanning during cooperative and competitive tasks2019

    • Author(s)
      Iwaki S
    • Organizer
      2019 Annual Meeting of the Organization for Human Brain Mapping
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] The strategy in the brain: the microstructural correlations predict the hyperdirect pathway and 'hub' in the reactive inhibition2018

    • Author(s)
      Fan Zhang, S. Iwaki
    • Organizer
      Society for Neuroscience 2018 Annual Meeting
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Intersubject EEG coherence during cooperative/competitive task performance2018

    • Author(s)
      S. Iwaki
    • Organizer
      Society for Neuroscience 2018 Annual Meeting
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Multimodal neuroimaging to visualize brain networks for 3-D object perception2018

    • Author(s)
      S. Iwaki, J.W. Belliveau
    • Organizer
      The 25th International Display Workshop
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Gamma-band brain activities during perception of 3-D object shape from motion2018

    • Author(s)
      S. Iwaki
    • Organizer
      21st International Conference on Biomagnetism
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] 脳活動の計測技術と疲労・ストレス評価への応用の可能性2018

    • Author(s)
      岩木 直
    • Organizer
      非侵襲ストレス計測技術の開発とその評価
    • Related Report
      2018 Research-status Report
    • Invited
  • [Presentation] Switch from proactive to reactive inhibition2018

    • Author(s)
      Fan Zhang, S. Iwaki
    • Organizer
      41st Annual Meeting of Japan Neuroscience Society
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] EEG hyper-scanning during cooperative/competitive task performance2018

    • Author(s)
      S. Iwaki
    • Organizer
      41st Annual Meeting of Japan Neuroscience Society
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Effective connectivity in the cognitive control network2018

    • Author(s)
      Fan Zhang, Sunao Iwaki
    • Organizer
      2018 Annual Meeting of the Cognitive Neuroscience Society
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Correlation between gamma-band activity and perceptual decision confidence during 3-D SFM2017

    • Author(s)
      Sunao Iwaki
    • Organizer
      2017 Annual Meeting of the Organization for Human Brain Mapping
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Individual differences in locus of control correlates with white matter integrity in the posterior cingulate and the precuneus2017

    • Author(s)
      Sunao Iwaki, Takatsune Kumada
    • Organizer
      第40回日本神経科学大会
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] White matter integrity is associated with individual difference in locus of control2017

    • Author(s)
      Sunao Iwaki, Zhoumao Duo, Takatsune Kumada
    • Organizer
      47th annual meeting of the Society for Neuroscience
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] EEGを用いた認知資源配分の評価2017

    • Author(s)
      岩木 直
    • Organizer
      Biomagnetic Sendai2017
    • Related Report
      2017 Research-status Report
  • [Presentation] MEG-fMRI multimodal integration to investigate neural dynamics while perceiving 3-D object shape from motio2017

    • Author(s)
      Sunao Iwaki
    • Organizer
      Advances in Neuroinformatics (AINI) 2017
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research / Invited
  • [Remarks] https://staff.aist.go.jp/s.iwaki/

    • Related Report
      2021 Annual Research Report
  • [Remarks] 岩木ウェブページ

    • URL

      https://staff.aist.go.jp/s.iwaki/

    • Related Report
      2018 Research-status Report
  • [Remarks] 岩木ウェブページ

    • URL

      http://staff.aist.go.jp/s.iwaki/

    • Related Report
      2017 Research-status Report

URL: 

Published: 2017-07-21   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi