• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

An Integrated Neuro-semantic Computational Model to Predict Brain fMRI Responses to Sentence Comprehension

Research Project

Project/Area Number 19K12727
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 90030:Cognitive science-related
Research InstitutionTokyo Institute of Technology

Principal Investigator

Akama Hiroyuki  東京工業大学, リベラルアーツ研究教育院, 准教授 (60242301)

Co-Investigator(Kenkyū-buntansha) 粟津 俊二  実践女子大学, 人間社会学部, 教授 (00342684)
Project Period (FY) 2019-04-01 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2021: ¥390,000 (Direct Cost: ¥300,000、Indirect Cost: ¥90,000)
Fiscal Year 2020: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Fiscal Year 2019: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
KeywordsfMRI / 深層学習 / 機械学習 / 自然言語モデル / 脳機能的連結性 / 文理解 / 脳科学 / 計算神経言語学 / 機能的連結性
Outline of Research at the Start

脳のfMRI賦活情報から言語思考を予測する機械学習は、単語や単純な文に関しては可能であり、個人内では高度に有意な精度が得られている。しかし、1)個人差の克服と個人間モデリング、2)より複雑な文・文章への適用という面では課題が多い。本研究では個人プロファイルやメタ分析からの情報も入れて、特定の個人の脳内における意味理解の機微を計算可能なものとする。これは意味障害など言語疾患の症例理解にも重要な知見を与えるかもしれず、脳認知科学に新たな貢献をもたらしうる。将来的には、脳外科手術において影響を受ける言語機能も語用レベルで細かく推定できるようになる可能性を秘めている。

Outline of Final Research Achievements

In machine learning for predicting verbal thoughts from fMRI activation information of the brain, our research has been challenging in terms of 1) overcoming individual differences and inter-individual modeling, and 2) application to more complex sentences and texts. The challenge was to take advantage of the benefits of deep learning. In this study, we were able to construct a method for reconstructing stimulus sentences directly from neural representations of the brain alone. In 1), we also proposed several deep learning algorithms for understanding brain disease cases in order to make the subtleties of cognitive responses in the brain of a specific individual computable, thus making a new contribution to brain cognitive science.

Academic Significance and Societal Importance of the Research Achievements

本研究が提案する計算神経言語学は、文レベルでの脳内意味処理モデルを構築し、意味の神経表象を生成することで、意味障害に苦しむ患者の言語世界を明らかにしたり、脳外科手術において影響を受ける言語機能も細かく推定できたりするなど、医療など多方面に応用可能である。さらに個人差の克服という視点で開発した深層学習アルゴリズムは、脳のfMRIデータを用い、個別の患者に合った治療法の確立を可能にする。

Report

(6 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Research-status Report
  • 2021 Research-status Report
  • 2020 Research-status Report
  • 2019 Research-status Report
  • Research Products

    (19 results)

All 2023 2022 2021 2020 2019

All Journal Article (11 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 7 results,  Open Access: 9 results) Presentation (8 results) (of which Invited: 1 results)

  • [Journal Article] Reconstruction of stimulus sentences using deep sentence generation model2023

    • Author(s)
      四辻 嵩直、赤間 啓之
    • Journal Title

      Cognitive Studies: Bulletin of the Japanese Cognitive Science Society

      Volume: 30 Issue: 4 Pages: 465-478

    • DOI

      10.11225/cs.2023.041

    • ISSN
      1341-7924, 1881-5995
    • Year and Date
      2023-12-01
    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Deep Learning Modeling for Prediction of Cognitive Task Related Features from Resting-state fMRI Data2023

    • Author(s)
      Tokuhiro Takaki、Onoda Keiichi、Takamura Masahiro、Yamaguchi Shuhei、Akama Hiroyuki
    • Journal Title

      Qeios

      Volume: なし

    • DOI

      10.32388/gdwcbk

    • Related Report
      2023 Annual Research Report
    • Open Access
  • [Journal Article] Prediction and Analysis of Structural Brain Health Indicators Using Deep Learning Models with Functional Brain Images as Input2023

    • Author(s)
      Shimojo Sakaki、Akama Hiroyuki
    • Journal Title

      Qeios

      Volume: なし Issue: 5

    • DOI

      10.32388/rwzh4y

    • Related Report
      2023 Annual Research Report
    • Open Access
  • [Journal Article] Complex of global functional network as the core of consciousness2023

    • Author(s)
      Onoda Keiichi、Akama Hiroyuki
    • Journal Title

      Neuroscience Research

      Volume: 190 Pages: 67-77

    • DOI

      10.1016/j.neures.2022.12.007

    • Related Report
      2022 Research-status Report
    • Peer Reviewed
  • [Journal Article] Comparing Deep Learning Models for Age Prediction Based on the Resting State fMRI Dataset from the “Brain Dock” Service in Japan2022

    • Author(s)
      Minowa Yutaka、Onoda Keiichi、Takamura Masahiro、Yamaguchi Shuhei、Okamoto Naoki、Akama Hiroyuki
    • Journal Title

      bioRxiv

      Volume: -

    • DOI

      10.1101/2022.08.14.503923

    • Related Report
      2022 Research-status Report
  • [Journal Article] Neural substrates of brand equity: applying a quantitative meta-analytical method for neuroimage studies2022

    • Author(s)
      Watanuki Shinya、Akama Hiroyuki
    • Journal Title

      Heliyon

      Volume: 8 Issue: 6 Pages: e09702-e09702

    • DOI

      10.1016/j.heliyon.2022.e09702

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Extended Invariant Information Clustering is Effective for Leave-One-Site-Out Cross-Validation in Resting State Functional Connectivity Modelling2021

    • Author(s)
      Naoki Okamoto, Hiroyuki Akama
    • Journal Title

      Frontiers in Neuroinformatics

      Volume: -

    • DOI

      10.3389/fninf.2021.709179

    • NAID

      120007175098

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Task‐induced brain functional connectivity as a representation of schema for mediating unsupervised and supervised learning dynamics in language acquisition2021

    • Author(s)
      Akama Hiroyuki、Yuan Yixin、Awazu Shunji
    • Journal Title

      Brain and Behavior

      Volume: 11 Issue: 6

    • DOI

      10.1002/brb3.2157

    • NAID

      120007039216

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Evaluation of Task fMRI Decoding with Deep Learning on a Small Sample Dataset2021

    • Author(s)
      Sunao Yotsutsuji, Miaomei Lei, Hiroyuki Akama
    • Journal Title

      Frontiers in Neuroinformatics

      Volume: -

    • DOI

      10.3389/fninf.2021.577451

    • NAID

      120007124435

    • Related Report
      2021 Research-status Report 2020 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Area-specific Biased Global Efficiency in Functional Connectivity Provides Features Negatively Correlated with Age2020

    • Author(s)
      Hiroyuki Akama and Airi Ota
    • Journal Title

      BioExiv Neuroscience

      Volume: なし

    • DOI

      10.1101/2020.04.22.054627

    • NAID

      120006936922

    • Related Report
      2020 Research-status Report
    • Open Access
  • [Journal Article] Neural Substrates of Brand Love: An Activation Likelihood Estimation Meta-Analysis of Functional Neuroimaging Studies2020

    • Author(s)
      Shiny Watanuki and Hiroyuki Akama
    • Journal Title

      Frontiers in Neuroscience

      Volume: なし Pages: 534671-534671

    • DOI

      10.3389/fnins.2020.534671

    • NAID

      120007124438

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access
  • [Presentation] 機能的連結性から探る物語聴取者の脳機能の特徴について2023

    • Author(s)
      菅原壱成、四辻嵩直、赤間啓之
    • Organizer
      第40回日本認知科学会
    • Related Report
      2023 Annual Research Report
  • [Presentation] アルツハイマー病の進行による安静時機能的連結性の個人的特徴の変化について2023

    • Author(s)
      中谷太河、赤間啓之
    • Organizer
      第40回日本認知科学会
    • Related Report
      2023 Annual Research Report
  • [Presentation] fMRIメタ分析データを予測する機械学習モデル及びその出力理解に資するインタラクション可能な脳3Dビューワーの開発2023

    • Author(s)
      赤間啓之、永嶋大稔、大門優介、菅原壱成、中谷大河、四辻嵩直
    • Organizer
      第40回日本認知科学会
    • Related Report
      2023 Annual Research Report
  • [Presentation] 認知症予防のための脳ドック--ブレインヘルスケアから見たバイリンガル脳の認知予備力について2020

    • Author(s)
      赤間啓之
    • Organizer
      日本脳ドック学会・キャノンスポンサードシンポジウム
    • Related Report
      2020 Research-status Report
    • Invited
  • [Presentation] 国産3T-MRIにおける安静時脳機能画像(rs-fMRI)によるデフォルト・モード・ネットワーク(DMN)描出の検討2019

    • Author(s)
      谷脇 孝博, 市川 元, 安藤 孝昌, 氏家 弘, 松井 孝嘉, 太田 藍李, 赤間啓之
    • Organizer
      第22回日本臨床脳神経外科学会
    • Related Report
      2019 Research-status Report
  • [Presentation] 概念理解に関する脳fMRIデータおよび言語コーパスによる機械学習モデルと正準相関分析2019

    • Author(s)
      赤間啓之, 岡本直己, 四辻嵩直, 松本将和
    • Organizer
      第47回日本行動計量学会大会抄録集.
    • Related Report
      2019 Research-status Report
  • [Presentation] バイリンガル話者の言語切替における脳の機能的連結性について2019

    • Author(s)
      赤間啓之, ペ セオフイ, ライビョウビ
    • Organizer
      日本認知科学会第36回大会発表論文集.
    • Related Report
      2019 Research-status Report
  • [Presentation] 脳内に張り巡らされるネットワークー機能的連結性から読み取れること2019

    • Author(s)
      小沢由衣, 赤間啓之
    • Organizer
      第47回文理シナジー学会令和元年度秋の発表会要旨集.
    • Related Report
      2019 Research-status Report

URL: 

Published: 2019-04-18   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi