Uncovering neural correlates in human decision making based on brain decoding

• Project/Area Number: 24300114
• Research Category: Grant-in-Aid for Scientific Research (B)
• Allocation Type: Partial Multi-year Fund
• Section: 一般
• Research Field: Bioinformatics/Life informatics
• Research Institution: Kyoto University
• Principal Investigator: ISHII Shin 京都大学, 情報学研究科, 教授 (90294280)
• Project Period (FY): 2012-04-01 – 2015-03-31
• Project Status: Completed (Fiscal Year 2014)
• Budget Amount: ¥17,940,000 (Direct Cost: ¥13,800,000、Indirect Cost: ¥4,140,000); Fiscal Year 2014: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000); Fiscal Year 2013: ¥10,400,000 (Direct Cost: ¥8,000,000、Indirect Cost: ¥2,400,000); Fiscal Year 2012: ¥6,370,000 (Direct Cost: ¥4,900,000、Indirect Cost: ¥1,470,000)
• Keywords: 意思決定 / ブレインデコーディング / ブレインマシンインターフェース / 非侵襲脳活動計測 / 強化学習

Outline of Final Research Achievements

We performed a decoding study of next scenes to be predicted by human subjects from their frontal-parietal fMRI activities when the subjects were performing a navigation task in partially observable maze environments. We performed a decoding study of various kinds of cognitive tasks by a deep neural network trained by large-scale fMRI data, and visualized high-dimensional features embedded in the trained deep network. Moreover, we constructed an online decoding system of spatial attention based on EEG (electroencephalography), which is applicable to real-world navigation. Using resting-state activities, we could calibrate the difference in neural correlates between human subjects.

Research Products

• [Journal Article] The state-of-the-art in handling occlusions for visual object tracking. (2015)
  • Author(s): Meshigi, K., & Ishii, S.
  • Journal Title: IEICE Transactions on Information & Systems Volume: 印刷中
  • NAID: 130005086162
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Learning a common dictionary for subject-transfer decoding with resting calibration (2015)
  • Author(s): Morioka, H., Kanemura, A., Hirayama, J., Shikauchi, M., Ogawa, T., Ikeda, S., Kawanabe, M., and Ishii, S.
  • Journal Title: NeuroImage Volume: 111 Pages: 167-178
  • DOI: 10.1016/j.neuroimage.2015.02.015
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] A computational model of afterimage rotation in the peripheral drift illusion based on retinal ON/OFF responses. (2014)
  • Author(s): Hayashi, Y., Ishii, S., & Urakubo, H.
  • Journal Title: PLoS ONE Volume: 9 Issue: 12 Pages: e115464-e115464
  • DOI: 10.1371/journal.pone.0115464
  • Peer Reviewed / Open Access
• [Journal Article] <b>Proposal of New Reinforcement Learning with a State-independent Policy</b> (2014)
  • Author(s): 中野大智, 前田新一, 石井信.
  • Journal Title: Transactions of the Institute of Systems, Control and Information Engineers Volume: 27 Issue: 8 Pages: 327-332
  • DOI: 10.5687/iscie.27.327
  • NAID: 130004707732
  • ISSN: 1342-5668, 2185-811X
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] 潜在空間モデリングによる時系列からの再構成. (2014)
  • Author(s): 平山淳一郎, 石井信.
  • Journal Title: 電子情報通信学会誌 Volume: 97 Pages: 399-404
  • Peer Reviewed
• [Journal Article] Decoding spatial attention by using cortical currents estimated from electroencephalography with near-infrared spectroscopy prior information (2014)
  • Author(s): Morioka, H., Kanemura, A., Morimoto, S., Yoshioka, T., Oba, S., Kawanabe, M., and Ishii, S.
  • Journal Title: NeuroImage Volume: 90 Pages: 128-139
  • DOI: 10.1016/j.neuroimage.2013.12.035
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Asymptotic analysis of value prediction in well-specified and misspecified model (2012)
  • Author(s): Ueno, T., Maeda, S., Ishii, S.
  • Journal Title: Neural Networks Volume: 31 Pages: 88-92
  • Peer Reviewed
• [Journal Article] Astate-space modeling approach for localization of focal current sources from ME (2012)
  • Author(s): Fukushima M, Yamashita O, Kanemura A, Ishii S, Kawato M, Sato MA.
  • Journal Title: IEEE Transactions on Biomedical Engineering. Volume: 59 Pages: 1561-1571
  • Peer Reviewed
• [Journal Article] Low-dimensional feature representation for instrument identification (2012)
  • Author(s): Ihara, M., Maeda, S., Ikeda, K., Ishii, S.,
  • Journal Title: SICE Journal of Control, Measurement, and System Integation Volume: 5 Pages: 249-258
  • NAID: 10031140141
  • Peer Reviewed
• [Presentation] Principal sensitivity analysis. (2015)
  • Author(s): Koyamada, S., Nakae, K., Koyama, M., & Ishii, S.
  • Organizer: Pacific-Asia conference on knowledge discovery and data mining
  • Place of Presentation: Ho Chi Minh( Vietnam)
  • Year and Date: 2015-05-19 – 2015-05-22
• [Presentation] Detecting representation of the view expectation in mPFC and posterior parietal cortex. (2015)
  • Author(s): Shikauchi, Y. & Ishii, S.
  • Organizer: Computational and Systems Neuroscience (Cosyne) 2015
  • Place of Presentation: Salt Lake City（The United States of America）
  • Year and Date: 2015-03-05 – 2015-03-08
• [Presentation] Data-driven brain decoding techniques. (2015)
  • Author(s): Ishii, S.
  • Organizer: 10th AEARU Workshop on Computer Science and Web Technology
  • Place of Presentation: 筑波大学国際会議室（茨城県つくば市）
  • Year and Date: 2015-02-25 – 2015-02-27
  • Invited
• [Presentation] Knowledge discovery for nonlinear classifier in functional neuroimaging. (2015)
  • Author(s): Koyamada, S., Shikauchi, Y., Nakae, K., Koyama, M., & Ishii, S.
  • Organizer: 10th AEARU Workshop on Computer Science and Web Technology
  • Place of Presentation: 筑波大学国際会議室（茨城県つくば市）
  • Year and Date: 2015-02-25 – 2015-02-27
• [Presentation] A study on knowledge acquisition with artificial neural networks. (2015)
  • Author(s): Miyato, T., Oba, S., & Ishii, S.
  • Organizer: 10th AEARU Workshop on Computer Science and Web Technology
  • Place of Presentation: 筑波大学国際会議室（茨城県つくば市）
  • Year and Date: 2015-02-25 – 2015-02-27
• [Presentation] Subject-transfer decoding by learning a common dictionary from multisubject dataset. (2015)
  • Author(s): Morioka, H., Kanemura, A., Hirayama, J., Shikauchi, M., Ogawa, T., Ikeda, S., Kawanabe, M., & Ishii, S.
  • Organizer: 10th AEARU Workshop on Computer Science and Web Technology
  • Place of Presentation: 筑波大学国際会議室（茨城県つくば市）
  • Year and Date: 2015-02-25 – 2015-02-27
• [Presentation] Data-driven brain computer interface in real environments. (2015)
  • Author(s): Ishii, S.
  • Organizer: The 3rd International Winter Conference on Brain-Computer Interface
  • Place of Presentation: Gangwon Province (South Korea)
  • Year and Date: 2015-01-12 – 2015-01-14
  • Invited
• [Presentation] Robust representation of the view expectation during active navigation. (2015)
  • Author(s): Shikauchi, Y., & Ishii, S.
  • Organizer: 第15回脳と心のメカニズム冬のワークショップ
  • Place of Presentation: ルスツリゾート（北海道虻田郡）
  • Year and Date: 2015-01-07 – 2015-01-09
• [Presentation] Construction of subject-independent brain decoders for human fMRI with deep learning. (2014)
  • Author(s): Koyamada, S., Shikauchi, Y., Nakae, K., & Ishii, S.
  • Organizer: International Conference on Data Mining, Internet Computing, and Big Data
  • Place of Presentation: Kuala Lumpur(Malaysia)
  • Year and Date: 2014-11-17 – 2014-11-19
• [Presentation] Decoding daily-life bahavioral signatures in the real environment: portable NIRS signal using behavior labels. (2014)
  • Author(s): Ogawa, T., Gupta, K. P., Yano, K., Abdur-Rahim, J. A., Morioka, H., Hirayama, J., Yamaguchi, S., Ishikawa, A., Inoue, Y., Kawanabe, M., & Ishii, S.
  • Organizer: Neuroscience 2014
  • Place of Presentation: パシフィコ横浜（神奈川県横浜市）
  • Year and Date: 2014-09-11 – 2014-09-13
• [Presentation] Subject-independent BM through sparse learning of spatial bases common across sessions and subjects. (2014)
  • Author(s): Morioka, H., Kanemura, A., Hirayama, J., Shikauchi, M., Ogawa, T., Ikeda, S., Kawanabe, M., & Ishii, S.
  • Organizer: Neuroscience 2014
  • Place of Presentation: パシフィコ横浜（神奈川県横浜市）
  • Year and Date: 2014-09-11 – 2014-09-13
• [Presentation] Learning the subject independent discriminative features from the large-scale fMRI database. (2014)
  • Author(s): Koyamada, S., Shikauchi, Y., Nakae, K., & Ishii, S.
  • Organizer: Neuroscience 2014
  • Place of Presentation: パシフィコ横浜（神奈川県横浜市）
  • Year and Date: 2014-09-11 – 2014-09-13
• [Presentation] 機械学習を用いた脳波からの情動反応の 読み取り (2014)
  • Author(s): 安田 恒, 石井 信, 大須 理英子.
  • Organizer: 日本心理学会
  • Place of Presentation: 同志社大学今出川キャンパス（京都府京都市）
  • Year and Date: 2014-09-10 – 2014-09-12
• [Presentation] データベースに基づくブレイン・マシン・インターフェース. (2014)
  • Author(s): 石井 信.
  • Organizer: 第37回日本神経科学大会サテライトシンポジウム「脳情報の産業応用に向けた動向と社会 基盤整備」
  • Place of Presentation: TKP横浜ガーデンシティ（神奈川県横浜市）
  • Year and Date: 2014-09-10
• [Presentation] 脳内で予測された次時刻シーンのデコーディング (2013)
  • Author(s): 鹿内友美, 石井信
  • Organizer: 電子情報通信学会ニューロコンピューティグ研究会
  • Place of Presentation: 玉川大学(東京)
  • Year and Date: 2013-03-15
• [Presentation] Network-based BMI : toward brain machine interface in real envionments (2013)
  • Author(s): Ishii, S
  • Organizer: IPAM Workshop on Multimodal Neuroimaging
  • Place of Presentation: University of California, Los Angeles (アメリカ)(招待講演)
  • Year and Date: 2013-03-07
• [Presentation] 経路積分強化学習による猫ひねり運動の制御 (2013)
  • Author(s): 中野太智, 前田新一, 石井信
  • Organizer: 電子情報通信学会ニューロコンピューティグ研究会
  • Place of Presentation: 北海道大学(北海道)
  • Year and Date: 2013-01-24
• [Presentation] 協調行動学習における非定常性の重要性 (2013)
  • Author(s): 田和明洋, 前田新一, 石井信
  • Organizer: 電子情報通信学会ニューロコンピューティグ研究会
  • Place of Presentation: 北海道大学(北海道)
  • Year and Date: 2013-01-24
• [Presentation] NIRSを事前情報としEEGから推定された皮質電流からの空間注意のデコーディング (2013)
  • Author(s): 森岡博史
  • Organizer: 第13回脳と心のメカニズム冬のワークショップ
  • Place of Presentation: ルスツリゾート(北海道)
  • Year and Date: 2013-01-09
• [Presentation] 三次元ナビゲーション環境におけるシーン予測のデコーディング (2013)
  • Author(s): 鹿内友美
  • Organizer: 第13回脳と心のメカニズム冬のワークショップ
  • Place of Presentation: ルスツリゾート(北海道)
  • Year and Date: 2013-01-09
• [Presentation] Control of a free-falling cat by policy-based reinforcement learning (2012)
  • Author(s): Nakano, D., Maeda, S. -i., Ishii, S
  • Organizer: International Conference on Artificial Neural Networks
  • Place of Presentation: ローザンヌ大学(スイス)
  • Year and Date: 2012-09-14
• [Presentation] Modeling and simulation of neuronal morphology (2012)
  • Author(s): Ishii, S.
  • Organizer: Okinawa Computational Neuroscience Course
  • Place of Presentation: Okinawa Institute of Science and Technology (沖縄県)(招待講演)
  • Year and Date: 2012-06-13
• [Presentation] 状態非依存の方策を用いた新しい強化学習手法の提案
  • Author(s): 中野 太智, 前田 新一, 石井 信
  • Organizer: 第57回システム制御情報学会研究発表講演会
  • Place of Presentation: 兵庫県民会館 （兵庫県）
• [Presentation] 吸収係数のエネルギー依存性を考慮したX線CTアルゴリズムの提案
  • Author(s): 吉川 大悟, 前田 新一, 石井 信
  • Organizer: 第57回システム制御情報学会研究発表講演会
  • Place of Presentation: 兵庫県民会館 （兵庫県）
• [Presentation] 脳磁図を用いた日常動作における手先の動きの再構成 (Decoding hand movements in everyday activities from magnetoencephalography)
  • Author(s): 平山 淳一郎, 鹿内 友美, 中村 泰, 前田 新一, 竹之内 高志, 兼村 厚範, 川鍋 一晃, 石井 信
  • Organizer: Neuro2013
  • Place of Presentation: 京都国際会館 (京都府)
• [Presentation] NIRSを事前情報としEEGから推定された皮質電流からの空間注意のデコーディング (Decoding of spatial attention from cortical currents estimated from EEG with NIRS prior)
  • Author(s): 森岡 博史, 兼村 厚範, 森本 智志, 吉岡 琢, 川鍋 一晃, 石井 信
  • Organizer: Neuro2013
  • Place of Presentation: 京都国際会館 (京都府)
• [Presentation] 意思決定に関わるシーン予測のデコーディング (Decoding scene prediction associated with decision making)
  • Author(s): 鹿内 友美, 石井 信
  • Organizer: Neuro2013
  • Place of Presentation: 京都国際会館 (京都府)
• [Presentation] 心的な視標運動追跡課題遂行中のMEGデータにおける脳活動とアーチファクトの分離 (Source separation of cortical and extra-brain source activities in real MEG data during covert pursuit eye movements)
  • Author(s): 森重 健一, 吉岡 琢, 石井 信, 佐藤 雅昭, 川人 光男
  • Organizer: Neuro2013
  • Place of Presentation: 京都国際会館 (京都府)
• [Presentation] 硬式テニス運動想像時の熟練者と初心者の脳活動の違い (Differences in brain activity between tennis experts and novices during motor imagery)
  • Author(s): 山下 歩, 石井 信, 今水 寛
  • Organizer: Neuro2013
  • Place of Presentation: 京都国際会館 (京都府)
• [Presentation] 意思決定における報酬と痛みの主観的価値の統合に関するfMRI研究 (Integration of appetitive and aversive values in decision making: An fMRI study)
  • Author(s): 丸山 雅紀, 吉田 和子, 石井 信, Ben Seymour
  • Organizer: Neuro2013
  • Place of Presentation: 京都国際会館 (京都府)
• [Presentation] Brain machine interface and decoding in mobile environments
  • Author(s): Ishii, S.
  • Organizer: Modeling Neural Activity: Statistics, Dynamical Systems, and Networks
  • Place of Presentation: Kauai Resort Marriott (アメリカ)
  • Invited
• [Presentation] System identification of cellular information processing
  • Author(s): Ishii, S.
  • Organizer: IEEEEMBC Workshop on Systems Biology of Cellular Signaling
  • Place of Presentation: Osaka International Convention Center (大阪府)
  • Invited
• [Presentation] Prediction was predictable from human brain activity in frontal-parietal cortex
  • Author(s): Shikauchi, Y., Ishii, S.
  • Organizer: CNS 2013
  • Place of Presentation: University of Paris Descartes (フランス)
• [Presentation] Fast approximation method for Gaussian process regression using hash function for non-uniformly distributed data
  • Author(s): Okadome, Y., Nakamura, Y., Shikauchi, Y., Ishii, S., & Ishiguro, H.
  • Organizer: 23rd International Conference on Artificial Neural Networks
  • Place of Presentation: Technical University of Sofia (ブルガリア)
• [Presentation] ベイズ法に基づく顕微鏡画像超解像
  • Author(s): 石井 信
  • Organizer: 第22回日本バイオイメージング学会学術集会
  • Place of Presentation: 東京大学 （東京都）
  • Invited
• [Presentation] fMRI 脳活動から prior belief を読み出す
  • Author(s): 鹿内 友美, 石井 信
  • Organizer: 脳と心のメカニズム 第14回 冬のワークショップ
  • Place of Presentation: ルスツリゾート （北海道）
• [Presentation] 大規模fMRIデータベースからの脳活動表現の学習
  • Author(s): 小山田 創哲, 鹿内 友美, 石井 信
  • Organizer: 脳と心のメカニズム 第14回 冬のワークショップ
  • Place of Presentation: ルスツリゾート （北海道）
• [Presentation] Deep Neural Netを用いた脳波デコーディング
  • Author(s): 宮戸 岳, 大羽 成征, 森岡 博史, 石井 信
  • Organizer: 脳と心のメカニズム 第14回 冬のワークショップークショップ
  • Place of Presentation: ルスツリゾート （北海道）
• [Presentation] BMIによるヘリコプター操縦のための相互学習
  • Author(s): 櫻井 俊輔, 大羽 成征, 石井 信
  • Organizer: ニューロコンピューティング研究会
  • Place of Presentation: 玉川大学 (東京都)
• [Presentation] 不完全情報ゲームに対する階層化したモンテカルロ探索とそのぷよぷよへの適用
  • Author(s): 大月 龍, 前田 新一, 石井 信
  • Organizer: ニューロコンピューティング研究会
  • Place of Presentation: 玉川大学 (東京都)
• [Presentation] 遮蔽識別付きベイズ追跡器を用いたカラー画像と深度画像からの複数特徴量の統合
  • Author(s): メシギ クロシ, 前田 新一, 大羽 成征, 石井 信
  • Organizer: ニューロコンピューティング研究会
  • Place of Presentation: 玉川大学 (東京都)
• [Presentation] 構造化階層的隠れマルコフモデルとスケルトンデータを用いた行動認識
  • Author(s): 澤田 智治, 前田 新一, 石井 信
  • Organizer: ニューロコンピューティング研究会
  • Place of Presentation: 玉川大学 (東京都)
• [Presentation] A system identification-based approach to neural system
  • Author(s): Ishii, S.
  • Organizer: Nagoya International Symposium on Neural Circuit
  • Place of Presentation: Nagoya University (愛知県)
  • Invited
• [Remarks] 研究代表者（石井信）ホームページ
  • URL: http://ishiilab.jp/member/ishii/publications/