• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Co-adaptive BMI by reinforcement learning based on prediction of users' latent mental states

Research Project

Project/Area Number 24300093
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypePartial Multi-year Fund
Section一般
Research Field Sensitivity informatics/Soft computing
Research InstitutionAdvanced Telecommunications Research Institute International

Principal Investigator

KAWANABE Motoaki  株式会社国際電気通信基礎技術研究所, 認知機構研究所, 主任研究員 (30272389)

Co-Investigator(Kenkyū-buntansha) KANEMURA Atsunori  独立行政法人産業技術総合研究所, ヒューマンライフテクノロジー研究部門, 研究員 (50580297)
UENO Tsuyoshi  大阪大学, 産業科学研究所, 招聘研究員 (90615824)
Co-Investigator(Renkei-kenkyūsha) WASHIO Takashi  大阪大学, 産業科学研究所, 教授 (00192815)
Project Period (FY) 2012-04-01 – 2015-03-31
Project Status Completed (Fiscal Year 2014)
Budget Amount *help
¥17,940,000 (Direct Cost: ¥13,800,000、Indirect Cost: ¥4,140,000)
Fiscal Year 2014: ¥5,330,000 (Direct Cost: ¥4,100,000、Indirect Cost: ¥1,230,000)
Fiscal Year 2013: ¥6,240,000 (Direct Cost: ¥4,800,000、Indirect Cost: ¥1,440,000)
Fiscal Year 2012: ¥6,370,000 (Direct Cost: ¥4,900,000、Indirect Cost: ¥1,470,000)
Keywordsブレイン・マシン・インタフェース / 強化学習
Outline of Final Research Achievements

Toward a real-time co-adaptive BMI algorithm for providing flexible feedback schemes based on users' latent mental states, we developed reinforcement learning procedures to construct BMI decoders and representations for brain activities to infer the mental states. For the former topic, based on the weighted likelihood, we establish a theoretical framework to determine the optimal state modeling, namely the dimension of the mental states and their transition rule, to design an appropriate policy model, and to execute reinforcement learning simultaneously. For the latter topic, we proposed various generalizations of the standard feature extraction method CSP (common spatial pattern) to construct robust features against subject-to-subject variability and non-stationarity in brain signals. By integrating these element technologies, we implemented a BMI feedback device with portable EEG and a ball lamp, and tested its usefulness with a few subjects in a real-world environment.

Report

(4 results)
  • 2014 Annual Research Report   Final Research Report ( PDF )
  • 2013 Annual Research Report
  • 2012 Annual Research Report

Research Products

(40 results)

All 2015 2014 2013 2012

All Journal Article (14 results) (of which Peer Reviewed: 14 results,  Acknowledgement Compliant: 2 results) Presentation (26 results) (of which Invited: 7 results)

  • [Journal Article] Learning a common dictionary for subject-transfer decoding with resting calibration2015

    • Author(s)
      Morioka, H., Kanemura, A., Hirayama, J., Shikauchi, M., Ogawa, T., Ikeda, S., Kawanabe, M., and Ishii, S.
    • Journal Title

      Neuroimage

      Volume: 111 Pages: 167-178

    • DOI

      10.1016/j.neuroimage.2015.02.015

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Dynamic Connectivity Factorization: Interpretable decompositions of non-stationarity2014

    • Author(s)
      Hyvarinen, A., Hirayama, J. and Kawanabe, M.
    • Journal Title

      Proc. of 4th International Workshop on Pattern Recognition in Neuroimaging (PRNI2014)

      Volume: - Pages: 1-4

    • DOI

      10.1109/prni.2014.6858524

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 極大クリーク列挙技術のビジネス応用とソフトウェアツール2014

    • Author(s)
      羽室行信,植野剛,鷲尾隆
    • Journal Title

      電子情報通信学会誌

      Volume: 97 Pages: 1103-1109

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Decoding spatial attention by using cortical currents estimated from electroencephalography with near-infrared spectroscopy prior information2014

    • Author(s)
      Morioka, H., Kanemura, A., Morimoto, S., Yoshioka, T., Oba, S., Kawanabe, M., and Ishii, S.
    • Journal Title

      Neuroimage

      Volume: 90 Pages: 128-139

    • DOI

      10.1016/j.neuroimage.2013.12.035

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Robust common spatial filters with a maxmin approach2014

    • Author(s)
      Kawanabe, M., Samek, W., Mueller, K.-R., and Vidaurre, C.
    • Journal Title

      Neural Computation

      Volume: 26 Pages: 349-376

    • DOI

      10.1162/neco_a_00544

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Divergence-based framework for common spatial patterns algorithms2014

    • Author(s)
      Samek, W., Kawanabe, M., and Mueller, K.-R.
    • Journal Title

      IEEE Reviews in Biomedical Engineering

      Volume: 7 Pages: 50-72

    • DOI

      10.1109/rbme.2013.2290621

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Active learning for noisy oracle via density power divergence2013

    • Author(s)
      Sogawa, Y., Ueno, T., Kawahara, Y., and Washio, T.
    • Journal Title

      Neural Networks

      Volume: 46 Pages: 133-143

    • DOI

      10.1016/j.neunet.2013.05.007

    • Related Report
      2013 Annual Research Report 2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 統計学習の観点から見たTD学習2013

    • Author(s)
      植野剛,前田新一,川鍋一晃
    • Journal Title

      計測と制御

      Volume: 52 Pages: 277-283

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Enhanced representation and multi-task learning for image annotation2013

    • Author(s)
      Binder, A., Samek, W., Mueller, K.-R., Kawanabe, M.
    • Journal Title

      Computer Vision and Image Understanding

      Volume: 117 Pages: 466-478

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Brain-computer interfacing in discriminative and stationary subspaces2012

    • Author(s)
      Samek, W., Mueller, K.-R.Kawanabe, M., Vidaurre, C.
    • Journal Title

      International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)

      Pages: 2873-2876

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Weighted Likelihood Policy Search with Model Selection2012

    • Author(s)
      Ueno, T. , Hayashi, K., Washio, T.Kawahara, Y.
    • Journal Title

      Advances in Neural Information Processing Systems

      Volume: 25 Pages: 2366-2374

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Density Power Divergenceを用いたロバスト能動回帰学習2012

    • Author(s)
      十河康弘,植野剛,河原吉伸,鷲尾隆
    • Journal Title

      人工知能学会論文誌

      Volume: 28 Pages: 13-21

    • NAID

      130003362304

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Robust active learning for linear regression via density power2012

    • Author(s)
      Sogawa, Y., Ueno, T., Kawahara, Y., Washio, T.
    • Journal Title

      Neural Information Processing

      Volume: 7665 Pages: 594-602

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Bootstrap confidence intervals in DirectLiNGAM2012

    • Author(s)
      Thamvitayakul, K. Shimizu, S., Ueno, T., Washio, T., Tashiro, T.
    • Journal Title

      IEEE International Conference on Data Mining(ICDM) Workshop: Reliability Issues in KnowledgeDiscovery

      Pages: 659-668

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Presentation] 日常環境ブレイン・マシン・インタフェースのための脳情報解読法について2014

    • Author(s)
      川鍋一晃
    • Organizer
      NAISTゼミナール1
    • Place of Presentation
      奈良先端科学技術大学院大学(奈良県)
    • Year and Date
      2014-10-22
    • Related Report
      2014 Annual Research Report
    • Invited
  • [Presentation] ブレイン・マシン・インタフェースのための非定常性に対してロバストな脳波特徴量の構築法について2014

    • Author(s)
      川鍋一晃
    • Organizer
      北陸先端科学技術大学院大学 情報科学研究科セミナー ワークショップ「脳機能イメージング信号処理の最前線」
    • Place of Presentation
      北陸先端科学技術大学院大学(石川県)
    • Year and Date
      2014-10-17
    • Related Report
      2014 Annual Research Report
    • Invited
  • [Presentation] Subject-independent decoding from EEG through sparse learning of spatial bases common across sessions and subjects2014

    • Author(s)
      Morioka, H., Kanemura, A., Hirayama, J., Ogawa, T., Ikeda, S., Kawanabe, M. and Ishii, S.
    • Organizer
      Advance in Neuroinformatics (AINI2014)
    • Place of Presentation
      理化学研究所(埼玉県)
    • Year and Date
      2014-09-25 – 2014-09-26
    • Related Report
      2014 Annual Research Report
  • [Presentation] Subject-independent BMI through sparse learning of spatial bases common across sessions and subjects2014

    • Author(s)
      Morioka, H., Kanemura, A., Hirayama, J., Shikauchi, M., Ogawa, T., Ikeda, S., Kawanabe, M. and Ishii, S.
    • Organizer
      第37回日本神経科学大会(Neurosience2014)
    • Place of Presentation
      パシフィコ横浜(神奈川県)
    • Year and Date
      2014-09-11 – 2014-09-13
    • Related Report
      2014 Annual Research Report
  • [Presentation] 確率推論に基づく方策探索法2014

    • Author(s)
      植野剛
    • Organizer
      日本ロボット学会学術講演会
    • Place of Presentation
      九州産業大学(福岡県)
    • Year and Date
      2014-09-04 – 2014-09-06
    • Related Report
      2014 Annual Research Report
  • [Presentation] 確率推論に基づく方策探索法2014

    • Author(s)
      植野剛
    • Organizer
      河原林ERATO AIセミナー
    • Place of Presentation
      国立情報学研究所(東京都)
    • Year and Date
      2014-06-30
    • Related Report
      2014 Annual Research Report
    • Invited
  • [Presentation] Dynamic Connectivity Factorization: Interpretable decompositions of non-stationarity2014

    • Author(s)
      Hyvarinen, A., Hirayama, J. and Kawanabe, M.
    • Organizer
      4th International Workshop on Pattern Recognition in Neuroimaging (PRNI2014)
    • Place of Presentation
      Tuebingen, Germany
    • Year and Date
      2014-06-04 – 2014-06-06
    • Related Report
      2014 Annual Research Report
  • [Presentation] e射影に基づく方策探索法2014

    • Author(s)
      植野剛
    • Organizer
      人工知能学会全国大会(JSAI2014)
    • Place of Presentation
      ひめぎんホール(愛媛県)
    • Year and Date
      2014-05-12 – 2015-05-15
    • Related Report
      2014 Annual Research Report
  • [Presentation] Robust feature construction against non-stationarity for EEG-BMI decoders2014

    • Author(s)
      Kawanabe, M.
    • Organizer
      2nd International Winter Workshop on Brain-Computer Interface
    • Place of Presentation
      High1 Resort, Korea
    • Related Report
      2013 Annual Research Report
    • Invited
  • [Presentation] 直接方策探索法の統計解析2013

    • Author(s)
      植野剛
    • Organizer
      統計的機械学習セミナー
    • Place of Presentation
      東京(招待講演)
    • Year and Date
      2013-03-22
    • Related Report
      2012 Annual Research Report
  • [Presentation] Robust spatial filtering with beta divergence2013

    • Author(s)
      Samek, W., Blythe, D., Mueller, K.-R., and Kawanabe, M.
    • Organizer
      Neural Information Processing Systems (NIPS) 2013
    • Place of Presentation
      Lake Tahoe, Nevada (USA)
    • Related Report
      2013 Annual Research Report
  • [Presentation] A waypoint-based framework in brain-controlled smart home environments: brain interfaces, domotics, and robotics integration2013

    • Author(s)
      Kanemura, A., Morales, Y., Kawanabe, M., Morioka, H., Kallakuri, N., Ikeda, T., Miyashita, T., Hagita, N., and Ishii, S.
    • Organizer
      IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2013)
    • Place of Presentation
      東京ビッグサイト(東京都)
    • Related Report
      2013 Annual Research Report
  • [Presentation] A Waypoint-based Framework and Data-driven Decoder for Brain-Machine Interface in Smart Home Environments2013

    • Author(s)
      Kawanabe, M., Kanemura, A., Morales, Y., Morioka, H., Kallakuri, N., Ikeda, T., Miyashita, T., Hagita, N., and Ishii, S.
    • Organizer
      IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2013), Workshop on Neuroscience and Robotics: Towards a robot-enabled, neuroscience-guided healthy society
    • Place of Presentation
      東京ビッグサイト(東京都)
    • Related Report
      2013 Annual Research Report
    • Invited
  • [Presentation] Finding structured dictionary representation by network-flow optimization2013

    • Author(s)
      Kanemura, A., Yuan, J., and Kawahara, Y.
    • Organizer
      Workshop on Data Discretization and Segmentation for Knowledge Discovery (DDS)
    • Place of Presentation
      Yokohama, Japan
    • Related Report
      2013 Annual Research Report
  • [Presentation] 学習による制御: 強化学習2013

    • Author(s)
      植野剛
    • Organizer
      計測・制御・システム工学部会シンポジウム
    • Place of Presentation
      東日本製鉄所見学センター(千葉県)
    • Related Report
      2013 Annual Research Report
    • Invited
  • [Presentation] Semiparametric Statistical Inference to Reinforcement learning2013

    • Author(s)
      Ueno, T.
    • Organizer
      Beroulli Society Satellite Meeting to the ISI World Statistics Congress
    • Place of Presentation
      東京大学(東京都)
    • Related Report
      2013 Annual Research Report
    • Invited
  • [Presentation] Decoding of spatial attention from cortical currents estimated from EEG with NIRS prior2013

    • Author(s)
      Morioka, H., Kanemura, A., Morimoto, S., Yoshioka, T., Kawanabe, M., and Ishii, S.
    • Organizer
      第36回日本神経科学大会、第56回日本神経化学会大会、第23回日本神経回路学会大会(Neuro2013)
    • Place of Presentation
      国立京都国際会館(京都府)
    • Related Report
      2013 Annual Research Report
  • [Presentation] An auditory ERP-based BMI for a universal controller in a real environment2013

    • Author(s)
      Ishido, N., Morimoto, S., Kanemura, A., Maruyama, M., Kawanabe, M., Ishii, S., Saruwatari, H., and Shikano, K.
    • Organizer
      第36回日本神経科学大会、第56回日本神経化学会大会、第23回日本神経回路学会大会(Neuro2013)
    • Place of Presentation
      国立京都国際会館(京都府)
    • Related Report
      2013 Annual Research Report
  • [Presentation] 聴覚注意を用いたブレインマシンインタフェースに関する基礎的検討2013

    • Author(s)
      石堂なつみ,小川剛史,森本智志,兼村厚範,丸山雅紀,川鍋一晃,石井信,猿渡洋,中村哲,鹿野清宏
    • Organizer
      2013年度応用音響研究会(予稿:電子情報通信学会技術研究報告EA,vol. 113,no. 134,pp. 51-56)
    • Place of Presentation
      北海道医療大学(北海道)
    • Related Report
      2013 Annual Research Report
  • [Presentation] 統計的画像処理におけるモデリングの方向性について2012

    • Author(s)
      兼村厚範
    • Organizer
      人工知能学会基本問題研究会
    • Place of Presentation
      横浜(招待講演)
    • Year and Date
      2012-11-17
    • Related Report
      2012 Annual Research Report
  • [Presentation] Weighted Likelihood Policy Searchの推定分散減少法2012

    • Author(s)
      植野剛, 林浩平, 鷲尾隆, 河原吉伸
    • Organizer
      人工知能学会基本問題研究会
    • Place of Presentation
      横浜
    • Year and Date
      2012-11-17
    • Related Report
      2012 Annual Research Report
  • [Presentation] 確率推論に基づく強化学習・確率最適制御2012

    • Author(s)
      植野剛
    • Organizer
      第15回情報論的学習理論ワークショップ
    • Place of Presentation
      東京(招待講演)
    • Year and Date
      2012-11-07
    • Related Report
      2012 Annual Research Report
  • [Presentation] 重み付き最尤推定に基づく方策探索法2012

    • Author(s)
      植野剛, 林浩平, 鷲尾隆, 河原吉伸
    • Organizer
      第15回情報論的学習理論ワークショップ
    • Place of Presentation
      東京
    • Year and Date
      2012-11-07
    • Related Report
      2012 Annual Research Report
  • [Presentation] Semi-autonomous wheelchair navigation towards brain-controlled system2012

    • Author(s)
      Morales, L. Y., Kallakuri, N.,兼村厚範,宮下敬宏,篠沢一彦,萩田紀博
    • Organizer
      日本ロボット学会学術講演会
    • Place of Presentation
      札幌
    • Year and Date
      2012-09-18
    • Related Report
      2012 Annual Research Report
  • [Presentation] 統計推論の観点から強化学習を考える2012

    • Author(s)
      植野剛
    • Organizer
      統計数理セミナー
    • Place of Presentation
      東京(招待講演)
    • Year and Date
      2012-07-27
    • Related Report
      2012 Annual Research Report
  • [Presentation] 多様体上での経路積分型制御2012

    • Author(s)
      植野剛,河原吉伸,鷲尾隆
    • Organizer
      人工知能学会全国大会
    • Place of Presentation
      山口
    • Year and Date
      2012-06-14
    • Related Report
      2012 Annual Research Report

URL: 

Published: 2012-04-23   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi