• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Brain decoding of impressions induced by diverse sensory stimuli

Research Project

Project/Area Number 17K12771
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeMulti-year Fund
Research Field Kansei informatics
Research InstitutionAdvanced Telecommunications Research Institute International

Principal Investigator

Horikawa Tomoyasu  株式会社国際電気通信基礎技術研究所, 脳情報通信総合研究所, 主任研究員 (60721876)

Project Period (FY) 2017-04-01 – 2020-03-31
Project Status Completed (Fiscal Year 2019)
Budget Amount *help
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2019: ¥520,000 (Direct Cost: ¥400,000、Indirect Cost: ¥120,000)
Fiscal Year 2018: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2017: ¥2,340,000 (Direct Cost: ¥1,800,000、Indirect Cost: ¥540,000)
Keywords脳情報デコーディング / 感情 / fMRI / ブレイン・デコーディング / 脳活動予測 / 感覚モダリティ / 深層ニューラルネットワーク / 感性情報学 / デコーディング / 印象 / 情動
Outline of Final Research Achievements

To investigate how information about impressions and emotions in the brain, we analyzed fMRI responses to a total of 2185 emotionally evocative videos, which are annotated with scores of 34 emotional categories and 14 affective dimensions, using data-driven analytical approaches. Our analyses demonstrated that (1) dozens of video-evoked emotions were accurately predicted from fMRI patterns in multiple brain regions with different regional configurations for individual emotions, (2) emotion categories better predicted cortical and subcortical responses than affective dimensions, outperforming visual and semantic covariates in transmodal regions, and (3) emotion-related fMRI responses had a cluster-like organization efficiently characterized by distinct categories. These results demonstrated the feasibility to decode diverse emotional states from the brain, illuminating its neural foundations distributed across transmodal regions.

Academic Significance and Societal Importance of the Research Achievements

本研究によって、感情に関わる多様な感性的情報を脳計測信号から精度良く解読可能であることが明らかになり、脳を介した感性評価技術の発展に寄与することができた。また、個々の感情が皮質上の複数の脳部位において分散的に表現されていることを明らかにしたことは、感情が局所的な脳部位で表現されているとする従来の知見を更新し、感情の意識体験に関わる神経基盤を明らかにすることに貢献するものである。さらに、感覚刺激の感性的情報が脳内で視覚的情報や意味的情報に対してより高次の部位において表現されているという知見は、今後映像などの入力情報に基づいて感情を認識する機械やロボットの開発にも活用されることが期待される。

Report

(4 results)
  • 2019 Annual Research Report   Final Research Report ( PDF )
  • 2018 Research-status Report
  • 2017 Research-status Report
  • Research Products

    (14 results)

All 2020 2019 2018 2017 Other

All Int'l Joint Research (1 results) Journal Article (5 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 4 results,  Open Access: 5 results) Presentation (8 results) (of which Int'l Joint Research: 7 results,  Invited: 4 results)

  • [Int'l Joint Research] University of California, Berkeley(米国)

    • Related Report
      2019 Annual Research Report
  • [Journal Article] The neural representation of visually evoked emotion is high-dimensional, categorical, and distributed across transmodal brain regions2020

    • Author(s)
      Horikawa Tomoyasu、Cowen Alan S.、Keltner Dacher、Kamitani Yukiyasu
    • Journal Title

      iScience

      Volume: 23 Issue: 5 Pages: 101060-101060

    • DOI

      10.1016/j.isci.2020.101060

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] The neural representation of visually evoked emotion is high-dimensional, categorical, and distributed across transmodal brain regions2019

    • Author(s)
      Horikawa Tomoyasu、Cowen Alan S.、Keltner Dacher、Kamitani Yukiyasu
    • Journal Title

      bioRxiv

      Volume: -

    • DOI

      10.1101/872192

    • Related Report
      2019 Annual Research Report
    • Open Access / Int'l Joint Research
  • [Journal Article] Deep image reconstruction from human brain activity2019

    • Author(s)
      Shen Guohua、Horikawa Tomoyasu、Majima Kei、Kamitani Yukiyasu
    • Journal Title

      PLOS Computational Biology

      Volume: 15 Issue: 1 Pages: 1-23

    • DOI

      10.1371/journal.pcbi.1006633

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Characterization of deep neural network features by decodability from human brain activity2019

    • Author(s)
      Horikawa Tomoyasu、Aoki Shuntaro C.、Tsukamoto Mitsuaki、Kamitani Yukiyasu
    • Journal Title

      Scientific Data

      Volume: 6 Issue: 1 Pages: 190012-190012

    • DOI

      10.1038/sdata.2019.12

    • NAID

      120006713554

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] End-to-End Deep Image Reconstruction From Human Brain Activity2019

    • Author(s)
      Shen Guohua、Dwivedi Kshitij、Majima Kei、Horikawa Tomoyasu、Kamitani Yukiyasu
    • Journal Title

      Frontiers in Computational Neuroscience

      Volume: 13 Pages: 1-11

    • DOI

      10.3389/fncom.2019.00021

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access
  • [Presentation] Attention biases neural representations of hierarchical visual features2019

    • Author(s)
      Tomoyasu Horikawa, Yukiyasu Kamitani
    • Organizer
      Cognitive Computational Neuroscience
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Inter-individual deep image reconstruction2019

    • Author(s)
      Tomoyasu Horikawa, Yukiyasu Kamitani
    • Organizer
      The 15th Asia-Pacific Conference on Vision (APCV2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Neural Decoding of What’s Not There from Human Brain Activity2019

    • Author(s)
      Tomoyasu Horikawa
    • Organizer
      A Workshop of Hallucinations, Dreams, Imaginations, and Virtual Reality. Experiencing What's Not There.
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 心的イメージの脳情報デコーディング2019

    • Author(s)
      堀川友慈
    • Organizer
      日本生理人類学会「感性・脳科学研究部会&睡眠研究部会」合同会合
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Brain decoding of sound-induced cortical activity with deep neural network features2018

    • Author(s)
      Jong Yun Park, Tomoyasu Horikawa, Kei Majima, Yukiyasu Kamitani
    • Organizer
      2018 Annual Meeting of Korean Society for Cognitive Science
    • Related Report
      2018 Research-status Report
  • [Presentation] 深層ニューラルネットワークを介した心的イメージの解読2018

    • Author(s)
      Tomoyasu Horikawa
    • Organizer
      生理研SPMトレーニングコース招待講演
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Decoding of seen and imagined contents from the human brain via deep neural network representation2018

    • Author(s)
      Tomoyasu Horikawa
    • Organizer
      第28回日本神経回路学会全国大会
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Deep image reconstruction from human brain activity2017

    • Author(s)
      Shen G., Horikawa T., Majima K., Kamitani Y.
    • Organizer
      Cognitive Computational Neuroscience
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2017-04-28   Modified: 2021-02-19  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi