• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Silent speech BCI

Research Project

Project/Area Number 23500151
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Media informatics/Database
Research InstitutionKyushu Institute of Technology

Principal Investigator

YAMAZAKI TOSHIMASA  九州工業大学, 大学院情報工学研究院, 教授 (50392163)

Co-Investigator(Kenkyū-buntansha) INOUE Katsuhiro  九州工業大学, 大学院・情報工学研究院, 教授 (00150516)
MAEDA Matoko  九州工業大学, 大学院・情報工学研究院, 助教 (00274556)
Project Period (FY) 2011 – 2013
Project Status Completed (Fiscal Year 2013)
Budget Amount *help
¥5,200,000 (Direct Cost: ¥4,000,000、Indirect Cost: ¥1,200,000)
Fiscal Year 2013: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2012: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2011: ¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000)
Keywordsサイレントスピーチ / BCI / 脳波 / BP / ICA / ECDL / Broca野 / HMM / Kalman filter / 運動準備電位 / 運動前野 / confusion matrix / BCI
Research Abstract

A new silent speech BCI was proposed using both EEGs scalp-recorded and speech signals measured during overtly and covertly speaking "janken" and "season" in Japanese. The framework consists of two phases. The first phase specifies a Kalman filter (KF) using both spectrograms of the speech signals and independent components of the EEGs recorded during the actual speech task. In case of the "season" task, speech signals were transformed into vowel and/or consonant sequences, and these relations were learned by HMM. The second one predicts spectrograms for the silent "janken" and "season" by the KF with the EEGs during the silent speech tasks. For the silent "season", the predicted spectrograms were inputted to the HMM. The present results demonstrate that when using the Kalman filter with the ICs whose dipole solutions are localized to mainly the Broca's area, the silent "jankens" are all correctly predicted for ten healthy subjects, and the "spring"- and "summer"-HMMs worked well.

Report

(4 results)
  • 2013 Annual Research Report   Final Research Report ( PDF )
  • 2012 Research-status Report
  • 2011 Research-status Report
  • Research Products

    (62 results)

All 2014 2013 2012 2011

All Journal Article (14 results) (of which Peer Reviewed: 13 results) Presentation (45 results) (of which Invited: 2 results) Book (3 results)

  • [Journal Article] Spatiotemporal human brain activities on recalling names of body parts2013

    • Author(s)
      T.Yamanoi, Y.Tanaka, M.Ohtsuki, S.Ohnishi, T.Yamazaki and M.Sugeno
    • Journal Title

      Journal of Advanced Computational Intelligence and Intelligent Informatics

      Volume: Vol.17, No.3 Pages: 386-391

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] EEG pattern recognition based on frequency analysis during imaging and gazing tasks2013

    • Author(s)
      K.Kinoshita, T.Yamaguchi, H.Uno, Y.Nishihara, M.Maeda and K.Inoue
    • Journal Title

      Proc. of the 43rd ISCIE International Symposium on Stochastic Systems Theory and Its Applications

      Pages: 338-343

    • NAID

      130007377421

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] Spatiotemporal human brain activities on recalling names of body parts2013

    • Author(s)
      T.Yamanoi et al.
    • Journal Title

      Journal of Advanced Computational Intelligence and Industrial Informatics

      Volume: 17

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] EEG pattern recognition based on frequency analysis during imaging and gazing tasks2013

    • Author(s)
      K.Kinoshita et al.
    • Journal Title

      Proc. of the 43rd ISCIE International Symposium on Stochastic Systems Theory and Its Applications

      Volume: なし Pages: 338-343

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] Morphological redundant Wavelet analysis of vocal signal2012

    • Author(s)
      T.Yamaguchi, K.Seita, M.Fujio and K.Inoue
    • Journal Title

      ICIC Express Letter

      Volume: Vol.6, No.4 Pages: 983-989

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] BCI by use of EEGs from right frontal area2012

    • Author(s)
      T.Yamanoi et al.
    • Journal Title

      Proc. SCIS-ISIS 2012

      Volume: なし Pages: 1150-1153

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] Morphological redundant wavelet analysis of vocal signal2012

    • Author(s)
      T.Yamaguchi et al.
    • Journal Title

      ICIC Express Letter

      Volume: 6 Pages: 983-989

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] A study of stimulation method in visual evoked potential based BCI2012

    • Author(s)
      T.Mizoguchi et al.
    • Journal Title

      Proc. of SICE Annual Conference 2012

      Volume: なし Pages: 2169-2174

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] Spatiotemporal brain activity during hiragana word recognition tasks2011

    • Author(s)
      H.Toyoshima et al.
    • Journal Title

      Journal of Advanced Computational Intelligent Informatics

      Volume: 3 Pages: 357-361

    • Related Report
      2011 Research-status Report
    • Peer Reviewed
  • [Journal Article] 身体名称想起時におけるヒト脳内活動部位の時空間的推移の推定2011

    • Author(s)
      山ノ井高洋ら
    • Journal Title

      形の科学会誌

      Volume: 2 Pages: 251-252

    • Related Report
      2011 Research-status Report
  • [Journal Article] EEG analysis based on pulse complex model during hand motor imagery2011

    • Author(s)
      H.Uno et al.
    • Journal Title

      Proc. the 42th ISCIE Internatonal Symposium on Stochastic Systems and Systems Theory and its Application

      Volume: なし Pages: 250-255

    • Related Report
      2011 Research-status Report
    • Peer Reviewed
  • [Journal Article] Shape description of 3D objetcs by curvature spin images generated via gaze modeling2011

    • Author(s)
      T.Nakamae et al.
    • Journal Title

      Proc. the 42th ISCIE Internatonal Symposium on Stochastic Systems and Systems Theory and its Application

      Volume: なし Pages: 196-201

    • Related Report
      2011 Research-status Report
    • Peer Reviewed
  • [Journal Article] Design method of morphological structuring function for pattern recognition of EEG signals during motor imagery and cognition2011

    • Author(s)
      T.Yamaguchi et al.
    • Journal Title

      International Journal of Innovative Computing, Information and Control

      Volume: 7 Pages: 4989-5002

    • Related Report
      2011 Research-status Report
    • Peer Reviewed
  • [Journal Article] A transient-VEP based spelling systems by using ICA and adaptive morphological filter2011

    • Author(s)
      K.Inoue et al.
    • Journal Title

      Proc. the 5th International BCI

      Volume: なし Pages: 76-79

    • Related Report
      2011 Research-status Report
    • Peer Reviewed
  • [Presentation] サイレントスピーチBCI-子音識別への拡張-2014

    • Author(s)
      山口ひろみ、山口彩夏、山崎敏正、福住伸一
    • Organizer
      電子情報通信学会 MEとバイオサイバネティックス研究会
    • Place of Presentation
      玉川大学
    • Related Report
      2013 Annual Research Report
  • [Presentation]2013

    • Author(s)
      山ノ井, 田中, 豊島, 山崎, 大槻
    • Organizer
      電子情報通信学会MEとバイオサイバネティックス研究会
    • Place of Presentation
      徳島大学
    • Related Report
      2013 Final Research Report
  • [Presentation] Silent Speech BCI-子音識別への拡張-2013

    • Author(s)
      山口彩夏、山口ひろみ、上野修平、山崎敏正、福住伸一
    • Organizer
      第20回日本生物工学会九州支部大会
    • Place of Presentation
      佐賀大学
    • Related Report
      2013 Annual Research Report
  • [Presentation] 複数画像認知・イメージング時EEGによるBCI2013

    • Author(s)
      山ノ井高洋、田中良典、豊島恒、山崎敏正、大槻美佳、菅野道夫
    • Organizer
      第29回ファジイシステムシンポジウム2013
    • Place of Presentation
      大阪国際大学
    • Related Report
      2013 Annual Research Report
  • [Presentation] 認知・想起時のEEGからの提示画像の推定-正準判別分析を用いて-2013

    • Author(s)
      山ノ井高洋、田中良典、豊島恒、山崎敏正、大槻美佳
    • Organizer
      電子情報通信学会 MEとバイオサイバネティックス研究会
    • Place of Presentation
      徳島大学
    • Related Report
      2013 Annual Research Report
  • [Presentation] Bayesian Networkを利用した運動準備電位によるジャンケン動作予測2013

    • Author(s)
      杉本 他
    • Organizer
      電子情報通信学会 MEとバイオサイバネティックス研究会
    • Place of Presentation
      飯塚
    • Related Report
      2012 Research-status Report
  • [Presentation] サイレントスピーチBCI-Single-trial EEGsを利用したサイレントジャンケンの予測-2013

    • Author(s)
      久野 他
    • Organizer
      電子情報通信学会 MEとバイオサイバネティックス研究会
    • Place of Presentation
      東京
    • Related Report
      2012 Research-status Report
  • [Presentation] 図形注視・想起時の脳波パタン識別2013

    • Author(s)
      木下 他
    • Organizer
      電子情報通信学会MEとバイオサイバネティックス研究会
    • Place of Presentation
      飯塚
    • Related Report
      2012 Research-status Report
  • [Presentation] 独立成分分析を用いた急速眼球運動時の睡眠脳波解析2013

    • Author(s)
      山下 他
    • Organizer
      電子情報通信学会MEとバイオサイバネティックス研究会
    • Place of Presentation
      飯塚
    • Related Report
      2012 Research-status Report
  • [Presentation] BCIシステムにおける独立成分分析を用いた重心推定2013

    • Author(s)
      畑瀬 他
    • Organizer
      電子情報通信学会MEとバイオサイバネティックス研究会
    • Place of Presentation
      飯塚
    • Related Report
      2012 Research-status Report
  • [Presentation] レム睡眠時の睡眠ポリグラフ解析2013

    • Author(s)
      高地、井上
    • Organizer
      電気学会研究会 産業計測制御・メカトロニクス制御・合同研究会
    • Place of Presentation
      千葉
    • Related Report
      2012 Research-status Report
  • [Presentation] A new single-trial-EEG-based BCI using silent speech tasks2012

    • Author(s)
      T.Yamazaki, et al
    • Organizer
      NEUROSCIENCE 2012
    • Place of Presentation
      New Orleans
    • Related Report
      2013 Final Research Report 2012 Research-status Report
  • [Presentation] 脳波のモルフォロジカル・ウェーブレット解析2012

    • Author(s)
      井上勝裕
    • Organizer
      第5回ウェーブレット変換およびその応用に関するワークショップ
    • Place of Presentation
      豊橋市
    • Related Report
      2013 Final Research Report
    • Invited
  • [Presentation] Spatiotemporal localization and comparison of brain activity on recalling one type of Kanji homophones2012

    • Author(s)
      Y.Tanaka, M.Hirata, T.Yamanoi, H.Toyoshima, M.Ohtsuki and T.Yamazaki
    • Organizer
      第27回生体・生理工学シンポジウム講演論文集
    • Place of Presentation
      札幌
    • Related Report
      2013 Final Research Report
  • [Presentation] 身体部位名称想起時における脳内活動部位の時空間推定2012

    • Author(s)
      田中, 山ノ井, 大槻, 豊島, 大西, 山崎
    • Organizer
      第28回ファジィシステムシンポジウム講演論文集
    • Place of Presentation
      名工大
    • Related Report
      2013 Final Research Report
  • [Presentation] 身体部位名称想起時における脳内活動部位について2012

    • Author(s)
      田中, 山ノ井, 大槻, 豊島, 大西, 山崎
    • Organizer
      第22回ソフトサイエンス・ワークショップ講演論文集
    • Place of Presentation
      専修大
    • Related Report
      2013 Final Research Report
  • [Presentation] 身体部位名称想起時における脳内活動部位について2012

    • Author(s)
      田中 他
    • Organizer
      第22回ソフトサイエンス・ワークショップ
    • Place of Presentation
      東京
    • Related Report
      2012 Research-status Report
  • [Presentation] Spatiotemporal human brain activities on recalling body names2012

    • Author(s)
      T.Yamanoi et al.
    • Organizer
      ISCIIA 2012
    • Place of Presentation
      札幌
    • Related Report
      2012 Research-status Report
  • [Presentation] Silent speech BCI: Test fo DIVA hypothesis2012

    • Author(s)
      S.Ueno et al.
    • Organizer
      ISCIIA 2012
    • Place of Presentation
      札幌
    • Related Report
      2012 Research-status Report
  • [Presentation] 身体部位名称想起時における脳内活動部位の時空間推定2012

    • Author(s)
      田中 他
    • Organizer
      第28回ファジィシステムシンポジウム
    • Place of Presentation
      名古屋
    • Related Report
      2012 Research-status Report
  • [Presentation] Spatiotemporal localization and comparison of brain activity on recalling one type of Kanji homophones2012

    • Author(s)
      Y.Tanaka et al.
    • Organizer
      第27回生体生理工学シンポジウム
    • Place of Presentation
      札幌
    • Related Report
      2012 Research-status Report
  • [Presentation] サイレントスピーチBCI-発話ジャンケン時とサイレントジャンケン時の運動準備電位-2012

    • Author(s)
      山田 他
    • Organizer
      電子情報通信学会 MEとバイオサイバネティックス研究会
    • Place of Presentation
      富山
    • Related Report
      2012 Research-status Report
  • [Presentation] サイレントジャンケンの性能評価2012

    • Author(s)
      韓 他
    • Organizer
      第19回日本生物工学会九州支部大分大会
    • Place of Presentation
      別府
    • Related Report
      2012 Research-status Report
  • [Presentation] 運動準備電位によるジャンケン動作予測-learning modelの構築-2012

    • Author(s)
      黒岩 他
    • Organizer
      第19回日本生物工学会九州支部大分大会
    • Place of Presentation
      別府
    • Related Report
      2012 Research-status Report
  • [Presentation] 運動準備電位によるジャンケン動作予測-learning modelの性能評価-2012

    • Author(s)
      藤 他
    • Organizer
      第19回日本生物工学会九州支部大分大会
    • Place of Presentation
      別府
    • Related Report
      2012 Research-status Report
  • [Presentation] 動作イメージBCI-Bayesian Network ModelとCommon Spatial Patternの性能比較-2012

    • Author(s)
      山口 他
    • Organizer
      第19回日本生物工学会九州支部大分大会
    • Place of Presentation
      別府
    • Related Report
      2012 Research-status Report
  • [Presentation] 脳波のモルフォロジカル・ウェーブレット解析2012

    • Author(s)
      井上勝裕
    • Organizer
      第5回ウェーブレット変換およびその応用に関するワークショップ
    • Place of Presentation
      豊橋
    • Related Report
      2012 Research-status Report
    • Invited
  • [Presentation] 局所パタンスペクトルを用いた睡眠脳波の形状特徴解析2012

    • Author(s)
      井上 他
    • Organizer
      日本睡眠学会第37回定期学術集会
    • Place of Presentation
      横浜
    • Related Report
      2012 Research-status Report
  • [Presentation] 睡眠脳波の時間周波数解析2012

    • Author(s)
      高地 他
    • Organizer
      日本睡眠学会第37回定期学術集会
    • Place of Presentation
      横浜
    • Related Report
      2012 Research-status Report
  • [Presentation] Blind source separation based on estimation for the number of source signals using Hough transform2012

    • Author(s)
      T.Ishibashi et al.
    • Organizer
      44th ISCIE International Symposium on Stochastic Systems Theory and Its Applications
    • Place of Presentation
      東京
    • Related Report
      2012 Research-status Report
  • [Presentation] Target speech extraction based on orthogonalization of joint distribution of observed signals2012

    • Author(s)
      T.Ishibashi et al.
    • Organizer
      44th ISCIE International Symposium on Stochastic Systems Theory and Its Applications
    • Place of Presentation
      東京
    • Related Report
      2012 Research-status Report
  • [Presentation] 非定常パルス抽出法を用いた脳波パタン認識2012

    • Author(s)
      井上、宇野
    • Organizer
      第42回日本臨床神経生理学会学術大会
    • Place of Presentation
      東京
    • Related Report
      2012 Research-status Report
  • [Presentation] 形状ヒストグラムに基づく特徴記述法を用いた3次元物体認識2012

    • Author(s)
      馬場 他
    • Organizer
      計測自動制御学会第31回九州支部学術講演会
    • Place of Presentation
      熊本
    • Related Report
      2012 Research-status Report
  • [Presentation] 睡眠中の聴覚誘発K-complex波の解析2012

    • Author(s)
      溝上 他
    • Organizer
      計測自動制御学会第31回九州支部学術講演会
    • Place of Presentation
      熊本
    • Related Report
      2012 Research-status Report
  • [Presentation] RLSSRを用いた急速眼球運動時の脳波解析2012

    • Author(s)
      高地 他
    • Organizer
      平成24年度日本生体医工学会九州支部学術講演会
    • Place of Presentation
      鹿児島
    • Related Report
      2012 Research-status Report
  • [Presentation] 高サンプリング周波数における運動時脳波のシステム同定2012

    • Author(s)
      西原、井上
    • Organizer
      平成24年度日本生体医工学会九州支部学術講演会
    • Place of Presentation
      鹿児島
    • Related Report
      2012 Research-status Report
  • [Presentation] Bereitschaftspotential modeling by DBNM and its application to BCI2011

    • Author(s)
      S.Takata et al.
    • Organizer
      HCI 2011
    • Place of Presentation
      Orlando, Florida, USA
    • Related Report
      2011 Research-status Report
  • [Presentation] Silent speech BCI: Learning and decoding algorithms using single-trial EEGs and speech signals2011

    • Author(s)
      K.Yamamoto et al.
    • Organizer
      BPES2011
    • Place of Presentation
      立命館大学
    • Related Report
      2011 Research-status Report
  • [Presentation] Spatiotemporal brain activities on recalling body names2011

    • Author(s)
      R.Yamatono et al.
    • Organizer
      BPES2011
    • Place of Presentation
      立命館大学
    • Related Report
      2011 Research-status Report
  • [Presentation] 脳波によるヒトの状態推定のためのウェーブレット手法の応用2011

    • Author(s)
      井上勝裕ら
    • Organizer
      平成23年度 数学・数理科学と諸科学との連携研究ワークショップ「ウェーブレット理論と工学への応用」
    • Place of Presentation
      大阪教育大学
    • Related Report
      2011 Research-status Report
  • [Presentation] A VEP-based spelling systems with sequential stimulus using binary BCH codes2011

    • Author(s)
      T.Mizoguchi et al.
    • Organizer
      The SICE Annual Conference 2011
    • Place of Presentation
      東京都
    • Related Report
      2011 Research-status Report
  • [Presentation] EEG pattern recognition based on frequency analysis during imaging and gazing tasks2011

    • Author(s)
      K.Kinoshita et al.
    • Organizer
      The 43rd ISCIE International Symposiums on Stochastic Systems and Systems Theory and its Applications
    • Place of Presentation
      草津市
    • Related Report
      2011 Research-status Report
  • [Presentation] 独立成分分析と適応モルフォロジカルフィルタを用いたVEPの検出2011

    • Author(s)
      井上勝裕、山口朋也
    • Organizer
      第41回日本臨床神経生理学会学術大会
    • Place of Presentation
      静岡市
    • Related Report
      2011 Research-status Report
  • [Presentation] 独立成分分析を用いたBCIシステムにおけるエラーポテンシャルの抽出2011

    • Author(s)
      畑瀬悟ら
    • Organizer
      計測自動制御学会九州支部 第30回学術講演会
    • Place of Presentation
      大分市
    • Related Report
      2011 Research-status Report
  • [Presentation] 2状態の尤度に基づく筋電位活動推定2011

    • Author(s)
      西原陽子ら
    • Organizer
      計測自動制御学会九州支部 第30回学術講演会
    • Place of Presentation
      大分市
    • Related Report
      2011 Research-status Report
  • [Book] Equivalent-Current-Dipole-Source-Locali zation-Based BCIs with Motor Imagery, In : Brain-Computer Interface Systems-Recent Progress and Future Prospects (Ed. Reza Fazel-Rezai)2013

    • Author(s)
      T.Yamazaki, et al
    • Publisher
      INTECH
    • Related Report
      2013 Final Research Report
  • [Book] Brain-Computer Interface Systems-Recent Progress and Future Prospects2013

    • Author(s)
      T.Yamazaki, M.Sakamoto, S.Takata, H.Yamaguchi, K.Tanaka, T.Shibata, H.Takayanagi, K.Kamijo and T.Yamanoi
    • Total Pages
      270
    • Publisher
      INTECH
    • Related Report
      2013 Annual Research Report
  • [Book] Brain-Computer Interface2013

    • Author(s)
      T.Yamazaki et al.
    • Total Pages
      20
    • Publisher
      INTECH
    • Related Report
      2012 Research-status Report

URL: 

Published: 2011-08-05   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi