BCI image retrieval using fMRI and kernel fuzzy clustering

• Project/Area Number: 24500258
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Multi-year Fund
• Section: 一般
• Research Field: Sensitivity informatics/Soft computing
• Research Institution: Kochi University of Technology
• Principal Investigator: YOSHIDA Shinichi 高知工科大学, 工学部, 准教授 (30334519)
• Co-Investigator(Kenkyū-buntansha): HATAKEYAMA Yutaka 高知大学, 医歯学系, 准教授 (00376956) ; OKAMOTO Kazushi 千葉大学, 学内共同利用施設等, 助教 (10615032) ; SAIKI Sachio 神戸大学, その他の研究科, 助教 (40549408)
• Project Period (FY): 2012-04-01 – 2015-03-31
• Project Status: Completed (Fiscal Year 2014)
• Budget Amount: ¥5,330,000 (Direct Cost: ¥4,100,000、Indirect Cost: ¥1,230,000); Fiscal Year 2014: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000); Fiscal Year 2013: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000); Fiscal Year 2012: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
• Keywords: ソフトコンピューティング / BCI / fMRI / 機械学習 / 画像検索 / パターン認識 / 脳情報デコーディング

Outline of Final Research Achievements

This study aims at image retrieval using brain neural data obtained from fMRI---BCI based image retrieval. In order to construct the foundation of BCI image retrieval, we have conducted four brain decoding experiment, color circle, black-and-white shapes, emotional images, and images which have different semantics. We used and compared four machine learning techniques, SVM, backpropagation, random forest, and sparse logistic regression. The result shows that the accuracy of the estimation of image is around 70%.

Research Products

• [Journal Article] Support Vector Description of Clusters for Content-Based Image Annotation (2014)
  • Author(s): Liang Sun ; Hongwei Ge ; YOSHIDA, Shinichi ; Yanchun Liang ; Guozhen Tan
  • Journal Title: Pattern Recognition Volume: 47 Issue: 3 Pages: 1361-1374
  • DOI: 10.1016/j.patcog.2013.10.015
  • Peer Reviewed
• [Presentation] Examine of Motion Correction Methods using Particle Filter for functional Magnetic Resonance Imaging (2014)
  • Author(s): Tatsuro Matsuo, Yutaka Hatakeyama, Sachio Saiki, Kazushi Okamoto, Shinichi Yoshida
  • Organizer: IDHF 2014 (International Symposium on Interaction design and Human Factors)
  • Place of Presentation: Kochi, Japan
  • Year and Date: 2014-11-25 – 2014-11-26
• [Presentation] Decoding Color of Stimuli given to a Human Subject from functional Magnetic Resonance Imaging Voxel Patterns using Machine Learning Algorithm (2014)
  • Author(s): Koike Noriki, Shinichi Yoshida, Yutaka Hatakeyama
  • Organizer: World Automation Congress 2014, 9th International Forum on Multimedia and Image Processing
  • Place of Presentation: Hawaii, United States of America
  • Year and Date: 2014-08-03 – 2014-08-07
• [Presentation] Decoding analysis for fMRI based on Deep Brief Network (2014)
  • Author(s): Yutaka Hatakeyama, Hiromi Kataoka, Yoshiyasu Okuhara, Shinichi Yoshida
  • Organizer: World Automation Congress 2014, 9th International Forum on Multimedia and Image Processing
  • Place of Presentation: World Automation Congress 2014, 9th International Forum on Multimedia and Image Processing
  • Year and Date: 2014-08-03 – 2014-08-07
• [Presentation] Comparison of Motion Correction Methods including Particle Filter for functional Magnetic Resonance Imaging (2014)
  • Author(s): Tatsuro Matsuo, Natsuki Fujimori, Yutaka Hatakeyama, Sachio Saiki, Kazushi Okamoto, Shinichi Yoshida
  • Organizer: World Automation Congress 2014, 9th International Forum on Multimedia and Image Processing
  • Place of Presentation: World Automation Congress 2014, 9th International Forum on Multimedia and Image Processing
  • Year and Date: 2014-08-03 – 2014-08-07
• [Presentation] 脳センシングとパターン認識の応用」 (2012)
  • Author(s): 吉田真一
  • Organizer: 「パーティクルフィルタ研究会」「ソフトロボティックス研究会」(日本知能情報ファジィ学会）
  • Place of Presentation: 高知県宿毛市
• [Presentation] Machine Learning of functional Magnetic Resonance Imaging Data for Brain Decoding
  • Author(s): Noriki Koike, Yutaka Hatakeyama, and Shinich Yoshida
  • Organizer: The 3rd International Workshop on Advanced Computational Intelligence and Intelligent Informatics (IWACIII 2013)
  • Place of Presentation: Shanghai, China
• [Presentation] Supervised Learning of functional Magnetic Resonance Imaging Data for Brain Decoding
  • Author(s): Noriki Koike, Yutaka Hatakeyama and Shinich Yoshida
  • Organizer: The 14th International Symposium on Advanced Intelligent Systems (ISIS2013)
  • Place of Presentation: Daejeon, Korea
• [Presentation] Multi-voxel pattern analysis of fMRI based on deep learning methods
  • Author(s): Yutaka Hatakeyama, Shinichi Yoshida, Hiromi Kataoka, Yoshiyasu Okuhara
  • Organizer: The 14th International Symposium on Advanced Intelligent Systems (ISIS2013)
  • Place of Presentation: Daejeon, Korea
• [Presentation] 脳機能データへの機械学習の適用とBCI応用への可能性
  • Author(s): 吉田真一, 小池規伎
  • Organizer: 日本知能情報ファジィ学会九州支部 夏季ワークショップ
  • Place of Presentation: 佐賀県唐津市
  • Invited
• [Presentation] パーティクルフィルタを用いたfMRI 脳画像のリアルタイム補正
  • Author(s): 吉田真一
  • Organizer: 統計数理研究所 共同利用研究 研究報告会
  • Place of Presentation: 統計数理研究所(東京)
• [Presentation] 画像から誘起される感情のfMRIによる定量化の検討
  • Author(s): 小林礼佳, 吉田真一
  • Organizer: 日本知能情報ファジィ学会ソフトロボティックス研究会
  • Place of Presentation: 高知工科大学
• [Presentation] 音楽の和音から受ける印象のアンケート調査研究
  • Author(s): 中村大樹, 吉田真一
  • Organizer: 日本知能情報ファジィ学会ソフトロボティックス研究会
  • Place of Presentation: 高知工科大学
• [Presentation] 脳活動からの図形形状の識別
  • Author(s): 岩切雄希, 吉田真一
  • Organizer: 日本知能情報ファジィ学会ソフトロボティックス研究会
  • Place of Presentation: 高知工科大学