• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Developing a brain-integrated AI system with personality

Research Project

Project/Area Number 18K18141
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 61060:Kansei informatics-related
Research InstitutionNational Institute of Information and Communications Technology

Principal Investigator

Nishida Satoshi  国立研究開発法人情報通信研究機構, 脳情報通信融合研究センター脳情報通信融合研究室, 主任研究員 (90751933)

Project Period (FY) 2018-04-01 – 2021-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2020: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2019: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2018: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Keywords人工知能 / 脳情報 / 個性 / 深層学習 / 畳み込みニューラルネット / 感性 / fMRI / 脳解読 / 転移学習 / 自然言語処理 / 脳 / 機械学習 / パターン認識 / 意味認知 / 知覚
Outline of Final Research Achievements

Toward the realization of the AI system that shows human-like behavior and personality, this study developed a technique that integrates personal brain information modeled from brain activity into a convolutional neural network (CNN). In the validation of the technique using real data, the technique more highly improves the estimation performance of CNNs in various pattern recognition tasks when brain information was more important for the estimation in the tasks. In addition, the estimation of the brain-integrated CNNs reflected the individual variability of human perception. These results suggest that the brain-integration technique we developed has the potential to make AI behavior more human-like and give personality to AI.

Academic Significance and Societal Importance of the Research Achievements

本研究で開発した技術は、特定の認識課題に特化した従来の脳情報融合技術と異なり、多様な認識問題へ適用可能な汎用的技術である点に独自性がある。また脳情報の個性を反映したAIシステムを構築した点も世界初であり、開発技術の学術的価値は極めて高い。人間とAIが調和する未来の情報社会を実現するために、人間らしい振る舞いを行う個性を有したAIの誕生が望まれる。本研究成果はそのようなAIを実現するための基盤技術として、情報社会の発展に大きな貢献をもたらす。

Report

(4 results)
  • 2020 Annual Research Report   Final Research Report ( PDF )
  • 2019 Research-status Report
  • 2018 Research-status Report
  • Research Products

    (34 results)

All 2021 2020 2019 2018 Other

All Journal Article (6 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 4 results,  Open Access: 5 results) Presentation (27 results) (of which Int'l Joint Research: 12 results,  Invited: 5 results) Remarks (1 results)

  • [Journal Article] Expert Programmers Have Fine-Tuned Cortical Representations of Source Code2020

    • Author(s)
      Ikutani Yoshiharu、Kubo Takatomi、Nishida Satoshi、Hata Hideaki、Matsumoto Kenichi、Ikeda Kazushi、Nishimoto Shinji
    • Journal Title

      eneuro

      Volume: 8 Issue: 1 Pages: 1-16

    • DOI

      10.1523/eneuro.0405-20.2020

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Expert programmers have fine-tuned cortical representations of source code2020

    • Author(s)
      Ikutani Yoshiharu、Kubo Takatomi、Nishida Satoshi、Hata Hideaki、Matsumoto Kenichi、Ikeda Kazushi、Nishimoto Shinji
    • Journal Title

      bioRxiv

      Volume: - Pages: 1-19

    • DOI

      10.1101/2020.01.28.923953

    • Related Report
      2019 Research-status Report
    • Open Access
  • [Journal Article] Relational Network of People Constructed on the Basis of Similarity of Brain Activities2019

    • Author(s)
      Shinkuma Ryoichi、Nishida Satoshi、Kado Masataka、Maeda Naoya、Nishimoto Shinji
    • Journal Title

      IEEE Access

      Volume: 7 Pages: 110258-110266

    • DOI

      10.1109/access.2019.2933990

    • NAID

      120006954916

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Brain-mediated Transfer Learning of Convolutional Neural Networks2019

    • Author(s)
      Satoshi Nishida, Yusuke Nakano, Antoine Blanc, Naoya Maeda, Masataka Kado, Shinji Nishimoto
    • Journal Title

      arXiv

      Volume: -

    • Related Report
      2019 Research-status Report
    • Open Access
  • [Journal Article] Describing Semantic Representations of Brain Activity Evoked by Visual Stimuli2018

    • Author(s)
      Matsuo Eri、Kobayashi Ichiro、Nishimoto Shinji、Nishida Satoshi、Asoh Hideki
    • Journal Title

      Proceedings of 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC)

      Volume: - Pages: 576-583

    • DOI

      10.1109/smc.2018.00107

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Decoding naturalistic experiences from human brain activity via distributed representations of words.2018

    • Author(s)
      Nishida S, Nishimoto S
    • Journal Title

      NeuroImage

      Volume: - Pages: 232-242

    • DOI

      10.1016/j.neuroimage.2017.08.017

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] 予測符号化を模倣する深層生成学習モデル構築に向けた基礎的検討2021

    • Author(s)
      黒田 彗莉, 西本 伸志, 西田 知史, 小林 一郎
    • Organizer
      情報処理学会 第83回全国大会
    • Related Report
      2020 Annual Research Report
  • [Presentation] Disorganized representational structures of semantic information in schizophrenia brains2020

    • Author(s)
      Nishida S, Matsumoto Y, Yoshikawa N, Son S, Murakami A, Hayashi R, Takahashi H, Nishimoto S
    • Organizer
      The 12th FENS Forum of Neuroscience
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 脳情報を組み込んだ単語分散表現による文章からの印象・好感度推定2020

    • Author(s)
      西田知史, 中野裕介, Blanc Antoine, 前田直哉, 角将高, 西本伸志
    • Organizer
      第34回人工知能学会全国大会
    • Related Report
      2020 Annual Research Report
  • [Presentation] Brain-mediated Transfer Learning of Convolutional Neural Networks2020

    • Author(s)
      Nishida S
    • Organizer
      第2回脳科学サロン「脳とAI」
    • Related Report
      2020 Annual Research Report
  • [Presentation] 予測符号化を模倣する深層生成学習モデル構築に向けた取り組み2020

    • Author(s)
      黒田 彗莉, 西本 伸志, 西田 知史, 小林 一郎
    • Organizer
      第23回情報論的学習理論ワークショップ (IBIS2020)
    • Related Report
      2020 Annual Research Report
  • [Presentation] Brain-mediated Transfer Learning of Convolutional Neural Networks2020

    • Author(s)
      Nishida S, Nakano Y, Blanc, A, Maeda N, Kado M, Nishimoto S
    • Organizer
      Thirty-Fourth AAAI Conference on Artificial Intelligence
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] DX時代の最先端技術 消費者感性を予測する脳解読基盤「NeuroAI」: 脳情報とAIの融合2020

    • Author(s)
      西田知史
    • Organizer
      NTT DATA Innovation Conference 2020
    • Related Report
      2019 Research-status Report
    • Invited
  • [Presentation] 統合失調症における脳内意味ネットワーク異常:エンコーディングモデルとグラフ理論解析を用いて2020

    • Author(s)
      松本有紀子, 西田知史, 孫樹洛, 村上晶郎, 吉川長伸, 林隆介, 西本伸志, 高橋英彦
    • Organizer
      脳と心のメカニズム第20回冬のワークショップ
    • Related Report
      2019 Research-status Report
  • [Presentation] Toward Identifying the Neural Basis of Programming Expertise: an fMRI Study with Expert Programmers2020

    • Author(s)
      Ikutani Y, Kubo T, Nishida S, Hata H, Matsumoto K, Ikeda K, Nishimoto S
    • Organizer
      脳と心のメカニズム第20回冬のワークショップ
    • Related Report
      2019 Research-status Report
  • [Presentation] Deep transfer learning mediated by human brain information2020

    • Author(s)
      Nishida S, Nakano Y, Blanc A, Maeda N, Kado M, Nishimoto S
    • Organizer
      脳と心のメカニズム第20回冬のワークショップ
    • Related Report
      2019 Research-status Report
  • [Presentation] Towards the decoding of human natural perception for real-world applications2019

    • Author(s)
      Nishida S
    • Organizer
      Applying Neuroscience to Business
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] A Study on a Correlation between a Predictive Model of Motion Pictures Imitating the Predictive Coding of the Cerebral Cortex and Brain Activity2019

    • Author(s)
      Fujiyama C, Nishimoto S, Nishida S, Asoh H, Kobayashi I
    • Organizer
      2019 Conference on Cognitive Computational Neuroscience
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Analysis of Correspondence Relationship between Brain Activity and Semantic Representation2019

    • Author(s)
      Ozaki K, Nishida S, Nishimoto S, Asoh H, Kobayashi I
    • Organizer
      2019 Conference on Cognitive Computational Neuroscience
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Toward Identifying the Neural Basis of Programming Expertise: an fMRI Study with Expert Programmers2019

    • Author(s)
      Ikutani Y, Kubo T, Nishida S, Hata H, Matsumoto K, Ikeda K, Nishimoto S
    • Organizer
      APSIPA BioSiPS Workshop 2019
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Abnormal semantic network in the schizophrenia brain: an encoding modeling and graph theoretic approach2019

    • Author(s)
      Matsumoto Y, Nishida S, Son S, Murakami A, Yoshikawa N, Hayashi R, Nishimoto S, Takahashi H
    • Organizer
      第42回日本神経科学大会
    • Related Report
      2019 Research-status Report
  • [Presentation] Genetic contribution to inter-individual differences in human natural audio-visual experiences2019

    • Author(s)
      Toyoda S, Nishida S, Honda C, Watanabe M, Ollikainen M, Vuoksimaa E, Kaprio J, Osaka Twin Research Group, Nishimoto S
    • Organizer
      The 2019 Behavior Genetics Association Meeting
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Functional subdivisions around FEF revealed by multi-modal modeling of movie-evoked activity2019

    • Author(s)
      Yamaguchi H, Nishida S, Nakai T, Nishimoto S
    • Organizer
      2019 Organization for Human Brain Mapping Annual Meeting
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Schizophrenia reduces intra- and inter-individual diversity of semantic representations in the brain2019

    • Author(s)
      Nishida S, Matsumoto Y, Yoshikawa N, Son S, Murakami A, Hayashi R, Takahashi H, Nishimoto S
    • Organizer
      2019 Organization for Human Brain Mapping Annual Meeting
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] 脳内情報表現の融合による深層学習ネットワークの認識能力向上2019

    • Author(s)
      西田知史, 西本伸志
    • Organizer
      第33回人工知能学会全国大会
    • Related Report
      2019 Research-status Report
  • [Presentation] 深層学習を用いた動画刺激時の脳活動データからの文生成2019

    • Author(s)
      張嘉瑩, 西田知史, 西本伸志, 小林 一郎
    • Organizer
      第33回人工知能学会全国大会
    • Related Report
      2019 Research-status Report
  • [Presentation] 自然な知覚状況下におけるヒト脳内情報の可視化とその応用2019

    • Author(s)
      西田知史
    • Organizer
      本田技術研究所 講演会
    • Related Report
      2018 Research-status Report
    • Invited
  • [Presentation] Brain decoding of human natural perception using statistical language modeling2019

    • Author(s)
      Nishida S
    • Organizer
      The 5th CiNet Conference: Computation and representation in brains and machines
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] 脳情報の可視化とその応用2019

    • Author(s)
      西田知史
    • Organizer
      神戸大学計算科学教育センター遠隔講義 計算生命科学の基礎V 計算科学・データサイエンスと生命科学の融合 基礎から医療・創薬への応用まで
    • Related Report
      2018 Research-status Report
    • Invited
  • [Presentation] fMRI evidence for the disorganization of semantic representation in the schizophrenia brain2019

    • Author(s)
      Nishida S, Matsumoto Y, Yoshikawa N, Son S, Murakami A, Hayashi R, Takahashi H, Nishimoto S
    • Organizer
      脳と心のメカニズム第19回冬のワークショップ
    • Related Report
      2018 Research-status Report
  • [Presentation] Modeling human visual responses with a U-shaped deep neural network for motion flow-field estimation2018

    • Author(s)
      Atsushi Wada, Satoshi Nishida, Hiroshi Ando, Shinji Nishimoto
    • Organizer
      2018 Conference on Cognitive Computational Neuroscience
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] U字型深層ニューラルネットワークを用いたヒト視覚応答のモデル化2018

    • Author(s)
      和田充史, 西田知史, 安藤広志, 西本伸志
    • Organizer
      日本視覚学会2018年夏季大会
    • Related Report
      2018 Research-status Report
  • [Presentation] Genetic contributions to individuality of natural audio-visual experiences2018

    • Author(s)
      Shunsuke Toyoda, Satoshi Nishida, Chika Honda, Mikio Watanabe, Osaka Twin Research Group, Shinji Nishimoto
    • Organizer
      Toward Understanding “INDIVIDUALITY“
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Remarks] 西田 知史 (Satoshi Nishida)

    • URL

      https://sites.google.com/site/satnishida/

    • Related Report
      2019 Research-status Report

URL: 

Published: 2018-04-23   Modified: 2022-01-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi