• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Innovation of multi-channel EEG signal processing technology for BMI development by fusion of information science and brain science

Research Project

Project/Area Number 23500202
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Perception information processing/Intelligent robotics
Research InstitutionUniversity of Tsukuba

Principal Investigator

MAKINO Shoji  筑波大学, システム情報系, 教授 (60396190)

Co-Investigator(Kenkyū-buntansha) RUTKOWSKI Tomasz  筑波大学, システム情報系, 講師 (50415238)
MIYABE Shigeki  筑波大学, システム情報系, 助教 (50598745)
Co-Investigator(Renkei-kenkyūsha) TERASAWA Hiroko  筑波大学, 図書館情報メディア系, 助教 (70579094)
YAMADA Takeshi  筑波大学, システム情報系, 准教授 (20312829)
Project Period (FY) 2011 – 2013
Project Status Completed (Fiscal Year 2013)
Budget Amount *help
¥4,550,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥1,050,000)
Fiscal Year 2013: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2012: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2011: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Keywords情報センシング / マルチチャネル信号処理 / 知能ロボティックス
Research Abstract

We advanced BMI development in two following frameworks. (1) We proposed a method to select the optimal latency and electrode based on the F-value based on the statistical characteristics of an event-related potential for spatial auditory stimuli. The proposed method demonstrated an 8% improvement of correct classification rate. (2) We verified a combination of real and virtual sound sources by speakers to evoke P300 responses. A large individual difference in P300 appearance was confirmed. To develop an alternate auditory BMI using virtual sound source, we tried a headphone-based auditory BMI using a head impulse response in an open database. A clear P300 was observed in occipital area. With view to develop multimodal BMI, the P300s by the spatial auditory stimuli, visual stimuli and the combination of these modalities were compared. It revealed that the amplitude of P300 for spatial auditory stimuli was less than the other.

Report

(4 results)
  • 2013 Annual Research Report   Final Research Report ( PDF )
  • 2012 Research-status Report
  • 2011 Research-status Report
  • Research Products

    (42 results)

All 2014 2013 2011 Other

All Journal Article (2 results) (of which Peer Reviewed: 2 results) Presentation (40 results)

  • [Journal Article] Workshops of the Fifth International Brain-Computer Interface Meeting: Defining the Future2014

    • Author(s)
      Tomasz Rutkowski
    • Journal Title

      Taylor & Francis, Brain-Computer Interfaces

      Volume: Volume 1 Issue: 1 Pages: 27-49

    • DOI

      10.1080/2326263x.2013.876724

    • Related Report
      2013 Annual Research Report 2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] Brain Evoked Potential Latencies Optimization for Spatial Auditory Brain2013

    • Author(s)
      Z. Cai, S. Makino and T. M. Rutkowski
    • Journal Title

      Springer Cognitive Computation (Special Issue : Advances on Brain Inspired Computing)

      Volume: Volume5,Number2 Issue: 1 Pages: 34-43

    • DOI

      10.1007/s12559-013-9228-x

    • Related Report
      2013 Annual Research Report 2013 Final Research Report
    • Peer Reviewed
  • [Presentation] Bone- conduction- based Brain Computer Interface Paradigm- EEG Signal Processing, Feature Extraction and Classification -2013

    • Author(s)
      D. Aminaka, K. Mori, T. Matsui, S. Makino, and T. M. Rutkowski
    • Organizer
      The 9th International Conference on SIGNAL IMAGE TECHNOLOGY & INTERNET BASED SYSTEMS
    • Place of Presentation
      Kyoto, Japan
    • Year and Date
      2013-12-05
    • Related Report
      2013 Final Research Report
  • [Presentation] Auditory Brain- Computer Interface Paradigm with Head Related Impulse Response- based Spatial Cues2013

    • Author(s)
      C. Nakaizumi, K. Mori, T. Matsui, S. Makino, and T. M. Rutkowski
    • Organizer
      The 9th International Conference on SIGNAL IMAGE TECHNOLOGY & INTERNET BASED SYSTEMS
    • Place of Presentation
      Kyoto, Japan
    • Year and Date
      2013-12-05
    • Related Report
      2013 Final Research Report
  • [Presentation] EEG Signal Processing and Classification for the Novel Tactile- Force Brain- Computer Interface Paradigm2013

    • Author(s)
      S. Kono, D. Aminaka, S. Makino, and T. M. Rutkowski
    • Organizer
      The 9th International Conference on SIGNAL IMAGE TECHNOLOGY & INTERNET BASED SYSTEMS
    • Place of Presentation
      Kyoto, Japan
    • Year and Date
      2013-12-05
    • Related Report
      2013 Final Research Report
  • [Presentation] Novel spatial tactile and bone-conduction auditory brain computer interface2013

    • Author(s)
      T. M. Rutkowski, H. Mori, S. Makino, K. Mori
    • Organizer
      The 43rd annual meeting of the Society for Neuroscience
    • Place of Presentation
      San Diego, California, USA
    • Year and Date
      2013-11-09
    • Related Report
      2013 Annual Research Report 2013 Final Research Report
  • [Presentation] Novel Virtual Moving Sound-based Spatial Auditory Brain-Computer Interface Paradigm2013

    • Author(s)
      Y. Lelievre and T. M. Rutkowski
    • Organizer
      The 6th International IEEE EMBS Conference on Neural Engineering
    • Place of Presentation
      California, USA
    • Year and Date
      2013-11-06
    • Related Report
      2013 Final Research Report
  • [Presentation] Classifying P300 Responses to Various Vowel Stimuli for Auditory Brain-Computer Interface2013

    • Author(s)
      Y. Matsumoto, S. Makino, K. Mori and T. M. Rutkowski
    • Organizer
      Asia-Pacific Signal and Information Processing Association Annual Summit and Conference 2013
    • Place of Presentation
      Kaohsiung, Taiwan
    • Year and Date
      2013-10-31
    • Related Report
      2013 Final Research Report
  • [Presentation] Spatial Auditory BCI with ERP Responses to Front-Back to the Head Stimuli Distinction Support2013

    • Author(s)
      Z. Cai, S. Makino, T. M. Rutkowski
    • Organizer
      Asia-Pacific Signal and Information Processing Association Annual Summit and Conference 2013
    • Place of Presentation
      Kaohsiung, Taiwan
    • Year and Date
      2013-10-31
    • Related Report
      2013 Final Research Report
  • [Presentation] Spatial Auditory BCI Paradigm based on Real and Virtual Sound Images Generation2013

    • Author(s)
      N. Nishikawa, S. Makino, T. M. Rutkowski
    • Organizer
      Asia-Pacific Signal and Information Processing Association Annual Summit and Conference 2013
    • Place of Presentation
      Kaohsiung, Taiwan
    • Year and Date
      2013-10-31
    • Related Report
      2013 Final Research Report
  • [Presentation] Multi-command Chest Tactile Brain Computer Interface for Small Vehicle Robot Navigation2013

    • Author(s)
      H. Mori, S. Makino, and T. M. Rutkowski
    • Organizer
      The 2013 International Conference on Brain and Health Informatics
    • Place of Presentation
      Maebashi, Gunma, Japan
    • Year and Date
      2013-10-30
    • Related Report
      2013 Final Research Report
  • [Presentation] Single Trial BCI Classification Accuracy Improvement for the Novel Virtual Sound Movement- based Spatial Auditory Paradigm2013

    • Author(s)
      Y. Lelievre, Y. Washizawa, and T. M. Rutkowski
    • Organizer
      Asia-Pacific Signal and Information Processing Association Annual Summit and Conference 2013
    • Place of Presentation
      Kaohsiung, Taiwan
    • Year and Date
      2013-10-30
    • Related Report
      2013 Final Research Report
  • [Presentation] Classification Improvement of P300 Response Based Auditory Spatial Brain-Computer Interface Paradigm2013

    • Author(s)
      M. Chang, S. Makino, T. M. Rutkowski
    • Organizer
      IEEE TENCON 2013
    • Place of Presentation
      Xi ' an, Shaanxi, China
    • Year and Date
      2013-10-23
    • Related Report
      2013 Final Research Report
  • [Presentation] Auditory and Tactile Brain Computer Interfaces for Locked-in State Patients and Healthy Users2013

    • Author(s)
      T. M. Rutkowski, H. Mori, M. Chang, S. Kono, D. Aminaka and C. Nakaizumi
    • Organizer
      日本・ポーランド科学技術セミナー
    • Place of Presentation
      Tokyo, Japan
    • Year and Date
      2013-10-16
    • Related Report
      2013 Final Research Report
  • [Presentation] BEYOND VISUAL P300 BASED BRAIN-COMPUTER INTERFACING PARADIGMS2013

    • Author(s)
      T. M. Rutkowski
    • Organizer
      Innovations in Information and Communication Science and Technology (IICST 2013)
    • Place of Presentation
      Tomsk, Russia
    • Year and Date
      2013-09-03
    • Related Report
      2013 Final Research Report
  • [Presentation] Network Based Complexity Analysis in Tactile Brain Computer Interface Task2013

    • Author(s)
      H. Mori, Y. Matsumoto, S. Makino, Z. R. Struzik, D. Mandic, and T. M. Rutkowski
    • Organizer
      The 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society
    • Place of Presentation
      Osaka, Japan
    • Year and Date
      2013-07-04
    • Related Report
      2013 Final Research Report
  • [Presentation] Spatial Tactile and Auditory Brain Computer Interface based on Head Position Stimulation2013

    • Author(s)
      T. M. Rutkowski, H. Mori, Y. Matsumoto, Z. R. Struzik, S. Makino, D. Mandic, and K. Mori
    • Organizer
      The 36th Annual Meeting of the Japan Neuroscience Society
    • Place of Presentation
      Kyoto, Japan
    • Year and Date
      2013-06-21
    • Related Report
      2013 Annual Research Report 2013 Final Research Report
  • [Presentation] Comparison of P300 Responses in Auditory, Visual and Audiovisual Spatial Speller BCI Paradigms2013

    • Author(s)
      M. Chang, N. Nishikawa, Z. R. Struzik, K. Mori, S. Makino, D. Mandic, T. M. Rutkowski
    • Organizer
      The 5th International Brain-Computer Interface Meeting 2013
    • Place of Presentation
      California, USA
    • Year and Date
      2013-06-04
    • Related Report
      2013 Annual Research Report 2013 Final Research Report
  • [Presentation] Multi-Command Tactile and Auditory Brain Computer Interface based on Head Position Stimulation2013

    • Author(s)
      H. Mori, Y. Matsumoto, Z. R. Struzik, K. Mori, S. Makino, D. Mandic, T. M. Rutkowski
    • Organizer
      The 5th International Brain-Computer Interface Meeting 2013
    • Place of Presentation
      California, USA
    • Year and Date
      2013-06-04
    • Related Report
      2013 Annual Research Report 2013 Final Research Report
  • [Presentation] Multi-command Tactile Brain ComputerInterface: A Feasibility Study2013

    • Author(s)
      H. Mori, Y. Matsumoto, V. Kryssanov, E. Cooper, H. Ogawa, S. Makino, Z. R. Struzik, and T. M. Rutkowski
    • Organizer
      The 8th International Workshop on Haptic and Audio Interaction Design
    • Place of Presentation
      Daejeon, Korea
    • Year and Date
      2013-04-18
    • Related Report
      2013 Final Research Report
  • [Presentation] Spatial Auditory and Tactile BCI in Application to Vehicular Robot Control2013

    • Author(s)
      T. M. Rutkowski
    • Organizer
      University of Cincinnati
    • Place of Presentation
      Cincinnati, OH, USA
    • Related Report
      2013 Annual Research Report 2013 Final Research Report
  • [Presentation] Spatial location and sound timbre as informative cues in auditory BCI/BMI - electrodes position optimization for brain evoked potential enhancement2011

    • Author(s)
      Z. Cai, H. Terasawa, S. Makino, T. Yamada, T. M. Rutkowski
    • Organizer
      APSIPA ASC 2011
    • Place of Presentation
      Grand New World Hotel Xian(中国)
    • Related Report
      2011 Research-status Report
  • [Presentation] New EEG components separation method: Data driven Huang-Hilbert transform application to auditory BMI paradigm2011

    • Author(s)
      T.M. Rutkowski, Q. Zhao, D.P. Mandic, Z. Cai, A. Cichocki, S. Makino, A.W. Przybyszewski
    • Organizer
      Neuroscience 2011
    • Place of Presentation
      Walter E. Washington Convention Center(アメリカ)
    • Related Report
      2011 Research-status Report
  • [Presentation] Multi-command Tactile Brain ComputerInterface: A Feasibility Study

    • Author(s)
      Hiromu Mori, Yoshihiro Matsumoto, Victor Kryssanov, Eric Cooper, Hitoshi Ogawa, Shoji Makino, Zbigniew R. Struzik, and Tomasz M. Rutkowski
    • Organizer
      The 8th International Workshop on Haptic and Audio Interaction Design
    • Place of Presentation
      Daejeon, Korea
    • Related Report
      2013 Annual Research Report
  • [Presentation] Network Based Complexity Analysis in Tactile Brain Computer

    • Author(s)
      Hiromu Mori, Yoshihiro Matsumoto, Shoji Makino, Zbigniew R. Struzik, Danilo P. Mandic,
    • Organizer
      The 35th Annual International Conference of the IEEE Engineering in Medicine
    • Place of Presentation
      Osaka, Japan
    • Related Report
      2013 Annual Research Report
  • [Presentation] BEYOND VISUAL P300 BASED BRAIN-COMPUTER INTERFACING PARADIGMS

    • Author(s)
      Rutkowski T.M
    • Organizer
      Innovations in Information and Communication Science and Technology
    • Place of Presentation
      Tomsk, Russia
    • Related Report
      2013 Annual Research Report
  • [Presentation] Classification Improvement of P300 Response Based Auditory Spatial Brain-Computer Interface Paradigm

    • Author(s)
      Moonjeong Chang, Shoji Makino, Tomasz M. Rutkowski
    • Organizer
      IEEE TENCON 2013
    • Place of Presentation
      Xi’an, Shaanxi, China
    • Related Report
      2013 Annual Research Report
  • [Presentation] Spatial Auditory BCI Paradigm based on Real and Virtual Sound Images Generation

    • Author(s)
      Nozomu Nishikawa, Shoji Makino, Tomasz M. Rutkowski
    • Organizer
      Asia-Pacific Signal and Information Processing Association Annual Summit and Conference 2013
    • Place of Presentation
      Kaohsiung, Taiwan
    • Related Report
      2013 Annual Research Report
  • [Presentation] Spatial Auditory BCI with ERP Responses to Front-Back to the Head Stimuli Distinction Support

    • Author(s)
      Zhenyu Cai, Shoji Makino, Tomasz M. Rutkowski
    • Organizer
      Asia-Pacific Signal and Information Processing Association Annual Summit and Conference 2013
    • Place of Presentation
      Kaohsiung, Taiwan
    • Related Report
      2013 Annual Research Report
  • [Presentation] Single Trial BCI Classification Accuracy Improvement for the Novel Virtual Sound Movement-based Spatial Auditory Paradigm

    • Author(s)
      Yohann Leli`evre, Yoshikazu Washizawa, and Tomasz M. Rutkowski
    • Organizer
      Asia-Pacific Signal and Information Processing Association Annual Summit and Conference 2013
    • Place of Presentation
      Kaohsiung, Taiwan
    • Related Report
      2013 Annual Research Report
  • [Presentation] Classifying P300 Responses to Various Vowel Stimuli for Auditory Brain-Computer Interface

    • Author(s)
      Yoshihiro Matsumoto, Shoji Makino, Koichi Mori and Tomasz M. Rutkowski
    • Organizer
      Asia-Pacific Signal and Information Processing Association Annual Summit and Conference 2013
    • Place of Presentation
      Kaohsiung, Taiwan
    • Related Report
      2013 Annual Research Report
  • [Presentation] Multi-command Chest Tactile Brain Computer Interface for Small Vehicle Robot Navigation

    • Author(s)
      Hiromu Mori, Shoji Makino, and Tomasz M. Rutkowski
    • Organizer
      The 2013 International Conference on Brain and Health Informatics
    • Place of Presentation
      Maebashi, Gunma, Japan
    • Related Report
      2013 Annual Research Report
  • [Presentation] Novel Virtual Moving Sound-based Spatial Auditory Brain-Computer Interface Paradigm

    • Author(s)
      Yohann Lelievre and Tomasz M. Rutkowski
    • Organizer
      The 6th International IEEE EMBS Conference on Neural Engineering
    • Place of Presentation
      California, USA
    • Related Report
      2013 Annual Research Report
  • [Presentation] EEG Signal Processing and Classification for the Novel Tactile-Force Brain-Computer Interface Paradigm

    • Author(s)
      Shota Kono, Daiki Aminaka, Shoji Makino, and Tomasz M. Rutkowski
    • Organizer
      The 9th International Conference on SIGNAL IMAGE TECHNOLOGY & INTERNET BASED SYSTEMS
    • Place of Presentation
      Kyoto, Japan
    • Related Report
      2013 Annual Research Report
  • [Presentation] Auditory Brain-Computer Interface Paradigm with Head Related Impulse Response-based Spatial Cues

    • Author(s)
      Chisaki Nakaizumi, Koichi Mori, Toshie Matsui, Shoji Makino, and Tomasz M. Rutkowski
    • Organizer
      The 9th International Conference on SIGNAL IMAGE TECHNOLOGY & INTERNET BASED SYSTEMS
    • Place of Presentation
      Kyoto, Japan
    • Related Report
      2013 Annual Research Report
  • [Presentation] Bone&-conduction&-based Brain Computer Interface Paradigm- EEG Signal Processing, Feature Extraction and Classification-

    • Author(s)
      Daiki Aminaka, Koichi Mori, Toshie Matsui, Shoji Makino, and Tomasz M. Rutkowski
    • Organizer
      The 9th International Conference on SIGNAL IMAGE TECHNOLOGY & INTERNET BASED SYSTEMS
    • Place of Presentation
      Kyoto, Japan
    • Related Report
      2013 Annual Research Report
  • [Presentation] Auditory and Tactile Brain Computer Interfaces for Locked-in State Patients and Healthy Users

    • Author(s)
      Tomasz M. Rutkowski, Hiromu Mori, MoonJeong Chang, Shota Kono, Daiki Aminaka and Chisaki Nakaizumi
    • Organizer
      日本・ポーランド科学技術セミナー
    • Place of Presentation
      Tokyo, Japan
    • Related Report
      2013 Annual Research Report
  • [Presentation] Psychophysical responses comparison in spatial visual, audiovisual, and auditory BCI-spelling paradigms

    • Author(s)
      Moonjeong Chang, Nozomu Nishikawa, Zhenyu Cai, Shoji Makino1, and Tomasz M. Rutkowski
    • Organizer
      The 6th International Conference on Soft Computing and Intelligent Systems The 13th International Symposium on Advanced Intelligent Systems
    • Place of Presentation
      Kobe, Japan
    • Related Report
      2012 Research-status Report
  • [Presentation] Vibrotactile stimulus frequency optimization for the haptic BCI prototype

    • Author(s)
      Hiromu Mori, Yoshihiro Matsumito, Shoji Makino1, Victor Kryssanov3, and Tomasz M. Rutkowski
    • Organizer
      The 6th International Conference on Soft Computing and Intelligent Systems The 13th International Symposium on Advanced Intelligent Systems
    • Place of Presentation
      Kobe, Japan
    • Related Report
      2012 Research-status Report
  • [Presentation] Spatial auditory BCI paradigm utilizing N200 and P300 response

    • Author(s)
      Zhenyu Cai, Shoji Makino, Takeshi Yamada, and Tomasz M. Rutkowski
    • Organizer
      Asia-Pacific Signal and Information Processing Association Annual Summit and Conference APSIPA2012
    • Place of Presentation
      Hollywood, California, USA
    • Related Report
      2012 Research-status Report
  • [Presentation] The spatial real and virtual sound stimuli optimization for the auditory BMI

    • Author(s)
      Nozomu Nishikawa, Yoshihiro Matsumoto, Shoji Makino, and Tomasz M. Rutkowski
    • Organizer
      Asia-Pacific Signal and Information Processing Association Annual Summit and Conference APSIPA2012
    • Place of Presentation
      Hollywood, California, USA
    • Related Report
      2012 Research-status Report
  • [Presentation] Auditory steady-state response stimuli based BCI application - The optimization of the stimuli types and lengths

    • Author(s)
      Yoshihiro Matsumoto, Nozomu Nishikawa, Shoji Makino, Takeshi Yamada, and Tomasz M. Rutkowski
    • Organizer
      Asia-Pacific Signal and Information Processing Association Annual Summit and Conference APSIPA2012
    • Place of Presentation
      Hollywood, California, USA
    • Related Report
      2012 Research-status Report

URL: 

Published: 2011-08-05   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi