• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Decision making model based on hierarchical networks and its applications to brain machine interface

Research Project

Project/Area Number 16H02873
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Soft computing
Research InstitutionKyoto University

Principal Investigator

Ishii Shin  京都大学, 情報学研究科, 教授 (90294280)

Project Period (FY) 2016-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥15,860,000 (Direct Cost: ¥12,200,000、Indirect Cost: ¥3,660,000)
Fiscal Year 2018: ¥5,200,000 (Direct Cost: ¥4,000,000、Indirect Cost: ¥1,200,000)
Fiscal Year 2017: ¥5,850,000 (Direct Cost: ¥4,500,000、Indirect Cost: ¥1,350,000)
Fiscal Year 2016: ¥4,810,000 (Direct Cost: ¥3,700,000、Indirect Cost: ¥1,110,000)
Keywords脳型人工知能 / ブレイン・マシン・インターフェース / 順逆強化学習 / 模倣学習 / ソフトコンピューティング / ブレイン・マシン・インタ-フェ-ス
Outline of Final Research Achievements

By applying hierarchical inverse reinforcement learning techniques to worm and human behavioral data, we found worms (C. elegans) has two kinds of adaptation strategies, exploration and exploitation, enabling adaptation to dynamic environments, and human has hierarchical decision makers to make appropriate decisions in uncertain environments. By performing decoding studies based on human EEG and fMRI data, we found saliency features of movies can be decoded from human EEG, and moreover, DTI-based transformation is effective in subject-transfer decoding of visual attentions.

Academic Significance and Societal Importance of the Research Achievements

動物や人間の環境適応能力の同定は、自然科学のみならず、人間と共存する機械(人工知能)の開発(工学)において重要である。本研究では、動物の見まね学習を数理モデル化した「順逆強化学習」のアルゴリズムを導出し、それを、動物および人間の行動データに適用することに成功した。また、モデルを用いたデコーディング法を開発し、視覚注意課題に適用した。その成果は、脳と機械を直接つなぐブレイン・マシン・インターフェースの開発につながる。

Report

(4 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Annual Research Report
  • 2016 Annual Research Report
  • Research Products

    (30 results)

All 2019 2018 2017 2016

All Journal Article (9 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 9 results,  Open Access: 3 results,  Acknowledgement Compliant: 1 results) Presentation (21 results) (of which Int'l Joint Research: 11 results,  Invited: 4 results)

  • [Journal Article] Semi-supervised learning of brain tissue segmentation2019

    • Author(s)
      Ito, R., Nakae, K., Hata, J., Okano, H., & Ishii, S
    • Journal Title

      Neural Networks

      Volume: 116 Pages: 25-34

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Identification of animal behavioral strategies by inverse reinforcement learning.2018

    • Author(s)
      Yamaguchi S, Honda N*, Ikeda M, Tsukada Y, Nakano S, Mori I and Ishii S
    • Journal Title

      PLoS Computational Biology

      Volume: 14(5) Issue: 5 Pages: e1006122-e1006122

    • DOI

      10.1371/journal.pcbi.1006122

    • NAID

      120006469168

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Characterization of electroencephalography signals for estimating saliency features in videos2018

    • Author(s)
      Liang, Z., Hamada, Y., Oba, S. & Ishii, S
    • Journal Title

      Neural Networks

      Volume: 105 Pages: 52-64

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Zero-shot fMRI decoding with three-dimensional registration based on diffusion tensor imaging2018

    • Author(s)
      Fuchigami, T., Shikauchi, Y., Nakae, K., Shikauchi, M., Ogawa, T., & Ishii, S
    • Journal Title

      Scientific Reports

      Volume: 8 Issue: 1 Pages: 12342-12342

    • DOI

      10.1038/s41598-018-30676-3

    • NAID

      120006652973

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learning2018

    • Author(s)
      Miyato, T., Maeda, S., Koyama, M., & Ishii, S
    • Journal Title

      IEEE Transactions on Pattern Analysis and Machine Intelligence

      Volume: - Issue: 8 Pages: 1979-1993

    • DOI

      10.1109/tpami.2018.2858821

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Binary classifiers ensemble based on Bregman divergence for multi-class classification2017

    • Author(s)
      Takenouchi, T., & Ishii, S
    • Journal Title

      Neurocomputing

      Volume: 273 Pages: 424-434

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Constructing a meta-tracker using dropout to imitate the behavior of an arbitrary black-box tracker2017

    • Author(s)
      Meshgi, K., Maeda, S., Oba, S., & Ishii, S
    • Journal Title

      Neural Networks

      Volume: 87 Pages: 132-148

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Constructing a meta-tracker using dropout to imitate the behavior of an arbitrary black-box tracker.2017

    • Author(s)
      Meshgi, K., Maeda, S., Oba, S., & Ishii, S.
    • Journal Title

      Neural Networks

      Volume: 87 Pages: 132-148

    • DOI

      10.1016/j.neunet.2016.12.009

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Robust encoding of scene anticipation during human spatial navigation.2016

    • Author(s)
      Shikauchi, Y., & Ishii, S.
    • Journal Title

      Scientific Reports

      Volume: 6 Issue: 1 Pages: 37599-37599

    • DOI

      10.1038/srep37599

    • NAID

      120005954472

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Presentation] Decoding the scene prediction and its confidence during maze exploration2019

    • Author(s)
      Katayama, R., Yoshida, W., & Ishii, S
    • Organizer
      第19回脳と心のメカニズム冬のワークショップ
    • Related Report
      2018 Annual Research Report
  • [Presentation] Artificial intelligence methods for identification of large-scale brain structures2019

    • Author(s)
      Ishii, S
    • Organizer
      International Symposium of Brain/MINDS
    • Related Report
      2018 Annual Research Report
    • Invited
  • [Presentation] 計測と情報科学の融合による新しいサイエンスの展望2019

    • Author(s)
      石井 信
    • Organizer
      SPRUC 第1回 BLs アップグレード検討ワークショップ
    • Related Report
      2018 Annual Research Report
    • Invited
  • [Presentation] Efficient diverse ensemble for discriminative co-tracking2018

    • Author(s)
      Meshgi, K., Oba, S., & Ishii, S
    • Organizer
      Computer Vision and Pattern Recognition 2018 (CVPR)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Inherent feature connection (I-Con) Map for linking emotion detection: an EEG study2018

    • Author(s)
      Liang, Z., Oba, S., & Ishii, S
    • Organizer
      32nd Human Computer Interaction Conference (BHCI 2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Reproducing the cognitive function with the robustness against the brain structure and with the efficient learning algorithm2018

    • Author(s)
      Fujita, Y., & Ishii, S
    • Organizer
      Computational Neuroscience 2018
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Deep Q-network regularized by adversarial examples2018

    • Author(s)
      Sasaki, W., Yasui, Y., Nakanishi, K., & Ishii, S
    • Organizer
      The 28th Annual Conference of the Japanese Neural Network Society
    • Related Report
      2018 Annual Research Report
  • [Presentation] Saliencyに基づく動画観視時の事象関連電位解析2017

    • Author(s)
      濱田恭行, 石井 信
    • Organizer
      電子情報通信学会ニューロコンピューティング研究会
    • Place of Presentation
      機械振興会館
    • Year and Date
      2017-03-13
    • Related Report
      2016 Annual Research Report
  • [Presentation] 行動履歴データによる行動方策学習者の探索戦略変化の推定2017

    • Author(s)
      内田滋穂里, 大羽成征, 石井 信
    • Organizer
      電子情報通信学会ニューロコンピューティング研究会
    • Place of Presentation
      機械振興会館
    • Year and Date
      2017-03-13
    • Related Report
      2016 Annual Research Report
  • [Presentation] Active discriminative tracking using collective memory2017

    • Author(s)
      Meshgi, K., Oba, S., & Ishii, S
    • Organizer
      IAPR International Conference on Machine Vision Applications
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Efficient version-space reduction for visual tracking2017

    • Author(s)
      Meshgi, K., Oba, S., & Ishii, S
    • Organizer
      14th Conference on Computer and Robot Vision
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Efficient asymmetric co-tracking using uncertainty sampling2017

    • Author(s)
      Meshgi, K., Mizaei, M. S., Oba, S., & Ishii, S
    • Organizer
      International Conference on Signal and Image Analysis Applications
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Individual identification by resting-state EEG using common dictionary learning2017

    • Author(s)
      Nishimoto, T., Morioka, H., & Ishii, S
    • Organizer
      Artificial Neural Networks and Machine Learning-ICANN 2017
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Estimation of the change of agent’s behavioral strategy using state-action history2017

    • Author(s)
      Uchida, S., Oba, S., & Ishii, S
    • Organizer
      Artificial Neural Networks and Machine Learning-ICANN 2017
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Saliencyに基づく動画観視時の事象関連電位解析2017

    • Author(s)
      濱田 恭行, 石井 信
    • Organizer
      電子情報通信学会技術報告
    • Related Report
      2017 Annual Research Report
  • [Presentation] 行動履歴データによる行動方策学習者の探索戦略変化の推定2017

    • Author(s)
      内田 滋穂里, 大羽 成征, 石井 信
    • Organizer
      電子情報通信学会技術報告
    • Related Report
      2017 Annual Research Report
  • [Presentation] Data-driven mimicking neural encoding/decoding systems2017

    • Author(s)
      Ishii, S
    • Organizer
      CRCNS 2017
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Decoding neural decision making2017

    • Author(s)
      Ishii, S
    • Organizer
      Okinawa Computational Neuroscience Course 2017
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] データベースに基づくブレインマシンインタフェース2017

    • Author(s)
      石井 信
    • Organizer
      電子情報通信学会音声研究会
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] Robust discriminative tracking via query-by-bagging2016

    • Author(s)
      Meshgi, K., Oba, S., & Ishii, S
    • Organizer
      AVSS2016
    • Place of Presentation
      Colorado, USA
    • Year and Date
      2016-08-23
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Brain decoding can be improved by diffusion imaging based registration2016

    • Author(s)
      Fuchigami, T., Shikauchi, Y., Nakae, K., Shikauchi, M., & Ishii, S
    • Organizer
      4th AINI 2016 and 14th INCF Nodes Workshop
    • Place of Presentation
      RIKEN, Wako,Japan
    • Year and Date
      2016-05-28
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research

URL: 

Published: 2016-04-21   Modified: 2020-03-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi