Development of a decoding method for imagined characters (vowels and consonants) using EEG.

• Project/Area Number: 15K01849
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Multi-year Fund
• Section: 一般
• Research Field: Brain biometrics
• Research Institution: Tokyo Institute of Technology
• Principal Investigator: Yoshimura Natsue 東京工業大学, 科学技術創成研究院, 准教授 (00581315)
• Co-Investigator(Kenkyū-buntansha): 緒方 洋輔 東京工業大学, 科学技術創成研究院, 特任助教 (60641355)
• Project Period (FY): 2015-04-01 – 2018-03-31
• Project Status: Completed (Fiscal Year 2017)
• Budget Amount: ¥4,810,000 (Direct Cost: ¥3,700,000、Indirect Cost: ¥1,110,000); Fiscal Year 2017: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000); Fiscal Year 2016: ¥2,730,000 (Direct Cost: ¥2,100,000、Indirect Cost: ¥630,000); Fiscal Year 2015: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
• Keywords: 脳波 / デコーディング / 機械学習 / 逆問題 / ブレイン・コンピュータ・インタフェース / 機能的MRI

Outline of Final Research Achievements

Electroencephalography (EEG) has low spatial resolution because it is recorded from sensors placed on the scalp. For this reason, it is considered to be hard to decode imagined characters in the brain from EEG. To solve the problem, EEG cortical current source is calculated using machine learning methods in this research project.
During the research period, decoding performance of vowel classification has enhanced using the EEG current source signals compared to that using EEG sensor signals. This achievement was published in an international journal (Yoshimura et al., Frontiers in Neuroscience, 2016).
The method has showed efficiency also for consonants classification (Under preparation for publish).

Research Products

• [Int'l Joint Research] University of Tuebingen(ドイツ)
• [Int'l Joint Research] Polish Academy of Science(ポーランド)
• [Int'l Joint Research] Polish Academy of Science(ポーランド)
• [Int'l Joint Research] University of Trento(イタリア)
• [Journal Article] Decoding of Ankle Flexion and Extension from Cortical Current Sources Estimated from Non-invasive Brain Activity Recording Methods (2018)
  • Author(s): Mejia Tobar Alejandra、Hyoudou Rikiya、Kita Kahori、Nakamura Tatsuhiro、Kambara Hiroyuki、Ogata Yousuke、Hanakawa Takashi、Koike Yasuharu、Yoshimura Natsue
  • Journal Title: Frontiers in Neuroscience Volume: 11 Pages: 1-12
  • DOI: 10.3389/fnins.2017.00733
  • Peer Reviewed / Open Access / Int'l Joint Research
• [Journal Article] Decoding finger movement in humans using synergy of EEG cortical current signals (2017)
  • Author(s): Yoshimura Natsue、Tsuda Hayato、Kawase Toshihiro、Kambara Hiroyuki、Koike Yasuharu
  • Journal Title: Scientific Reports Volume: 7 Issue: 1 Pages: 1-11
  • DOI: 10.1038/s41598-017-09770-5
  • Peer Reviewed / Open Access
• [Journal Article] Decoding of emotional responses to user-unfriendly computer interfaces via electroencephalography signals (2017)
  • Author(s): Yoshimura Natsue、Koga Osamu、Katsui Yu、Ogata Yousuke、Kambara Hiroyuki、Koike Yasuharu
  • Journal Title: ACTA IMEKO Volume: 6 Issue: 2 Pages: 93-93
  • DOI: 10.21014/acta_imeko.v6i2.383
  • Peer Reviewed / Open Access
• [Journal Article] Hybrid control of a vision-guided robot arm by EOG, EMG, EEG biosignals and head movement acquired via a consumer-grade wearable device. (2017)
  • Author(s): Minati L., Yoshimura N., Koike Y.
  • Journal Title: IEEE Access Volume: 4 Pages: 9528-9541
  • DOI: 10.1109/access.2017.2647851
  • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
• [Journal Article] Mapping ECoG channel contributions to trajectory and muscle activity prediction in human sensorimotor cortex (2017)
  • Author(s): Nakanishi Y., Yanagisawa T., Shin D., Kambara H., Yoshimura N., Tanaka M., Fukuma R., Kishima H., Hirata M., and Koike Y
  • Journal Title: Scientific Reports Volume: 7 Issue: 1 Pages: 1-13
  • DOI: 10.1038/srep45486
  • Peer Reviewed / Open Access / Int'l Joint Research
• [Journal Article] Controlling an electromyography-based power-assist device for the wrist using electroencephalography cortical currents (2016)
  • Author(s): Kawase T., Yoshimura N., Kambara H., Koike Y
  • Journal Title: Advanced robotics Volume: 31 Issue: 1-2 Pages: 88-96
  • DOI: 10.1080/01691864.2016.1215935
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] Decoding of covert vowel articulation using electroencephalography cortical currents (2016)
  • Author(s): Natsue Yoshimura, Atsushi Nishimoto, Abdelkader Nasreddine Belkacem, Duk Shin, Hiroyuki Kambara, Takashi Hanakawa, Yasuharu Koike
  • Journal Title: Frontiers in Neuroscience Volume: 10 Pages: 1-15
  • DOI: 10.3389/fnins.2016.00175
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Presentation] Synergy analysis for motor decoding (2017)
  • Author(s): Yoshimura Natsue, Kawase Toshihiro, Koike Yasuharu
  • Organizer: 第40回日本神経科学大会
• [Presentation] Classification of ankle flexion and extension tasks using non-invasive brain activity recording methods (2017)
  • Author(s): Mejia Tobar Alejandra, Hyoudo RIkiya, Kita Kahori, Nakamura Tatsuhiro, Kambara Hiroyuki, Hanakawa Takashi, Koike Yasuharu, Yoshimura Natsue RIkiya, Kita Kahori, Nakamura Tatsuhiro, Kambara Hiroyuki, Hanakawa Takashi, Koike Yasuharu, Yoshimura Natsue Riki
  • Organizer: Graz BCI Conference 2017
  • Int'l Joint Research
• [Presentation] Brain activity synergy analysis for motor decoding (2017)
  • Author(s): Yoshimura Natsue, Tsuda Hyato, Kawase Toshihiro, Kambara Hiroyuki, Koike Yasuharu
  • Organizer: Yamada Symposium 2017
• [Presentation] Muscle activity reconstruction of ankle flexors and extensors using non-invasive brain activity recording methods (2016)
  • Author(s): Mejia Tobar A., Hyoudou R., Kita K., Nakamura T., Kambara H., Hanakawa T., Koike Y., and Yoshimura N
  • Organizer: Neuroscience 2016
  • Place of Presentation: The San Diego Convention Center (San Diego, CA, USA)
  • Year and Date: 2016-11-12
  • Int'l Joint Research
• [Presentation] 脳波による脳情報のデコーディングとリハビリテーションへの応用 (2016)
  • Author(s): 吉村奈津江
  • Organizer: 神奈川県ヘルスケア・ニューフロンティア講座
  • Place of Presentation: 横浜崎陽軒（横浜市）
  • Year and Date: 2016-10-23
  • Invited
• [Presentation] Neural representation of wrist motor coordinate frames and their application (2016)
  • Author(s): Natsue Yoshimura
  • Organizer: ATR Mini Symposium on Sensorimotor Control and Robotics
  • Place of Presentation: ATR (京都府)
  • Year and Date: 2016-08-08
  • Invited
• [Presentation] Classifying force level of hand grasping and opening using electroencephalography cortical currents (2016)
  • Author(s): Yoshimura N., Okushita R., Aikawa H., Kambara H., Hanakawa T., and Koike Y.
  • Organizer: The Sixth International Brain-Computer Interface Meeting 2016
  • Place of Presentation: The Asilomar Conference Center in Pacific Grove, California, USA
  • Year and Date: 2016-05-30
  • Int'l Joint Research
• [Presentation] Electromyographic activity reconstruction of ankle flexors and extensors from estimated cortical currents (2016)
  • Author(s): Mejia Tobar A., Hyoudou R., Kita K., Nakamura T., Kambara H., Hanakawa T., Koike Y., and Yoshimura N.
  • Organizer: The 1st International Symposium on Embodied-Brain Systems Science (EmboSS 2016)
  • Place of Presentation: 東京大学
  • Year and Date: 2016-05-08
  • Int'l Joint Research
• [Presentation] Evaluation of usability for cursor control from electroencephalography (2015)
  • Author(s): Osamu Koga, Natsue Yoshimura, Hiroyuki Kambara, Yasuharu Koike
  • Organizer: XXI IMEKO World Congress "Measurement in Research and Industry"
  • Place of Presentation: Prague, Czech Republic
  • Year and Date: 2015-08-30
  • Int'l Joint Research
• [Presentation] Muscle activity reconstruction for ankle flexor and extensor (2015)
  • Author(s): Alejandra Mejia Tobar, Rikiya Hyoudou, Kahori Kita, Tatsuhiro Nakamura, Hiroyuki Kambara, Takashi Hanakawa, Yasuharu Koike, Natsue Yoshimura
  • Organizer: 第38回日本神経科学大会
  • Place of Presentation: 神戸国際展示場
  • Year and Date: 2015-07-28