• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of Adaptive and Multi-functional Speech Enhancement System for Both EL-users and Esophageal Speech Users

Research Project

Project/Area Number 15K01487
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Rehabilitation science/Welfare engineering
Research InstitutionOsaka Institute of Technology

Principal Investigator

MATSUI Kenji  大阪工業大学, ロボティクス&デザイン工学部, 教授 (30613682)

Co-Investigator(Kenkyū-buntansha) 中藤 良久  九州工業大学, 大学院工学研究院, 教授 (10599955)
加藤 弓子  聖マリアンナ医科大学, 医学部, 研究員 (10600463)
水町 光徳  九州工業大学, 大学院工学研究院, 准教授 (90380740)
Project Period (FY) 2015-04-01 – 2018-03-31
Project Status Completed (Fiscal Year 2017)
Budget Amount *help
¥4,680,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥1,080,000)
Fiscal Year 2017: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2016: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2015: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Keywords人工喉頭 / ハンズフリー / 食道発声 / 発生支援 / 人口喉頭 / 口唇認識 / 拡声器 / 発声支援 / 口唇の動き検出 / 喉頭マイク
Outline of Final Research Achievements

People who have had laryngectomy require speech enhancement system.This study was undertaken to explore the feasibility of using compact loudspeaker with wireless function and EQ. Also, lip motion detection device with photo sensor was developed and tested. Then, lip reading function was developed and obtained close to 90% vowel recognition accuracy.We confirmed the total system using those functions will be improve the user's communication performance.

Report

(4 results)
  • 2017 Annual Research Report   Final Research Report ( PDF )
  • 2016 Research-status Report
  • 2015 Research-status Report
  • Research Products

    (23 results)

All 2019 2018 2017 2016 2015 Other

All Int'l Joint Research (1 results) Journal Article (6 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 6 results,  Acknowledgement Compliant: 3 results) Presentation (16 results) (of which Int'l Joint Research: 8 results)

  • [Int'l Joint Research] Salamanca University(Spain)

    • Related Report
      2017 Annual Research Report
  • [Journal Article] Preliminary Study of Mobile Device-based Speech Enhancement System Using Lip-reading2019

    • Author(s)
      Yuta Matsunaga, Kenji Matsui, Yoshihisa Nakatoh, Yumiko O. Kato, Daniel Lopez-Sanchez, Sara Rodriguez, Juan Manuel Corchado
    • Journal Title

      Distributed Computing and Artificial Intelligence, 15th International Conference

      Volume: 未定

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Development of Hands-free Speech Enhancement System for Both EL-users and Esophageal Speech Users2018

    • Author(s)
      Yuta Matsunaga, Kenji Matsui, Yoshihisa Nakatoh, Yumiko O. Kato
    • Journal Title

      Distributed Computing and Artificial Intelligence, 14th International Conference

      Volume: 620 Pages: 334-341

    • DOI

      10.1007/978-3-319-62410-5_41

    • ISBN
      9783319624099, 9783319624105
    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Improvement Method of Speech Intelligibility by Enhancement of Spectral Variation2018

    • Author(s)
      川原 竣介、平川 凜、中藤 良久
    • Journal Title

      The Japanese Journal of the Institute of Industrial Applications Engineers

      Volume: 6 Issue: 1 Pages: 51-54

    • DOI

      10.12792/jjiiae.6.1.51

    • NAID

      130006507532

    • ISSN
      2187-5146, 2189-373X
    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Method for improving intelligibility of elderly speech based on formant frequency shift2016

    • Author(s)
      Yuto Tanaka, Mitsunori Mizumachi, Yoshihisa Nakatoh
    • Journal Title

      Journal of the Institute of Industrial Applications Engineers

      Volume: 1 Pages: 1-6

    • NAID

      40021221710

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] LPC残差駆動歌唱システムにおける音韻性除去による音質改善の検討2016

    • Author(s)
      姫野 剛至,田中 裕人,水町 光徳,松井 謙二,中藤 良久
    • Journal Title

      産業応用工学会論文誌

      Volume: 4 Pages: 19-25

    • NAID

      130005263509

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Singing System by Electric-Larynx Using LPC Residual Wave2015

    • Author(s)
      Takashi Himeno, Yuto Tanaka, Mitsunori Mizumachi, Yoshihisa Nakatoh, Kenji Matsui
    • Journal Title

      Journal of the Institute of Industrial Applications Engineers

      Volume: 3 Issue: 4 Pages: 183-186

    • DOI

      10.12792/jiiae.3.183

    • NAID

      40020646760

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Presentation] 携帯機器と口唇情報利用による発声支援方式の基礎検討2018

    • Author(s)
      松永勇太、松井謙二、中藤良久、加藤弓子
    • Organizer
      2018電子情報通信学会総合大会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 音声スペクトルの時間変化強調による明瞭性改善効果の検討2018

    • Author(s)
      川原竣介,平川凜,中藤良久
    • Organizer
      日本音響学会2018年春季研究発表会
    • Related Report
      2017 Annual Research Report
  • [Presentation] Development of Handsfree Speech Enhancement System for Laryngectomies2017

    • Author(s)
      Yuta Matsunaga, Kenji Matsui, Yoshihisa nakatoh, Yumiko O. Kato
    • Organizer
      2017 RISP International Workshop on Nonlinear Circuits, Communications and signal Processing
    • Place of Presentation
      Hyatt Regency Guam, U.S.A.
    • Year and Date
      2017-02-28
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Speech Enhancement of Singing Support System for Lartngectomies2017

    • Author(s)
      Hirotaka Nogamia, Yoshihisa Nakatoh, Kenji Matsui
    • Organizer
      International Conference on Intelligent Systems and Image Processing 2017 (ICISIP 2017)
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Analysis of Speech Depending on Age and Speaking Style by Using Acoustic Features2017

    • Author(s)
      Shunsuke Kawahara, Yoshihisa Nakatoh
    • Organizer
      International Conference on Intelligent Systems and Image Processing 2017
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Study on Children Voice Features Using Expression Words2017

    • Author(s)
      HARADA Naoya, Yoshihisa Nakatoh
    • Organizer
      International Conference on Intelligent Systems and Image Processing 2017
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 発話者の年齢や発話スタイルの異なる音声の音響的特徴の分析2017

    • Author(s)
      川原竣介,中藤良久
    • Organizer
      日本音響学会2017年秋季研究発表会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 子供音声を特徴付ける表現語に影響を及ぼす因子の検討2017

    • Author(s)
      原田 尚哉,中藤良久
    • Organizer
      日本音響学会2017年秋季研究発表会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 喉頭摘出者に向けた歌唱支援システムにおける音質改善の検討2016

    • Author(s)
      野上 博高,田中 裕人,中藤 良久,松井 謙二
    • Organizer
      日本音響学会 2016秋季研究発表会
    • Place of Presentation
      富山大学
    • Year and Date
      2016-09-14
    • Related Report
      2016 Research-status Report
  • [Presentation] ホルマント周波数シフトによる高齢者音声の明瞭度改善2016

    • Author(s)
      田中 裕人,水町 光徳,中藤 良久
    • Organizer
      日本音響学会 2016秋季研究発表会
    • Place of Presentation
      富山大学
    • Year and Date
      2016-09-14
    • Related Report
      2016 Research-status Report
  • [Presentation] Study on the Improvement of Intelligibility for Elderly Speech Using Formant Frequency Shift Method2016

    • Author(s)
      Yuto Tanaka, Mitsunori Mizumachi, Yoshihisa Nakatoh
    • Organizer
      International Conference on Speech and Computer (SPECOM 2016)
    • Place of Presentation
      The Aquincum Hotel Budapest, Hungary
    • Year and Date
      2016-08-23
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Development of Wearable Speech Enhancement System for Laryngectomees2016

    • Author(s)
      Kenta Kimura, Kenji Matsui, Yoshihisa Nakatoh, Yumiko O. Kato
    • Organizer
      NCSP16, pp339-pp342, March 6, 2016
    • Place of Presentation
      Honolulu, Hawaii, USA
    • Year and Date
      2016-03-08
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Singing Support System Using LPC Residual Wave for Laryngectomee2016

    • Author(s)
      Takashi Himeno, Yuto Tanaka, Mitsunori Mizumachi, Yoshihisa Nakatoh, Kenji Matsui
    • Organizer
      IEEE International Conference on Consumer Electronics
    • Place of Presentation
      Las Vegas, AZ, USA
    • Year and Date
      2016-01-10
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] パワー補正したLPC残差を用いる代替発声歌唱法の音質改善2015

    • Author(s)
      姫野剛至、田中裕人、水町光徳、中藤良久、松井謙二
    • Organizer
      平成27年度(第68回) 電気・情報関係学会九州支部連合大会
    • Place of Presentation
      福岡大学
    • Year and Date
      2015-09-26
    • Related Report
      2015 Research-status Report
  • [Presentation] ハンズフリー発声支援システムに関する基礎検討2015

    • Author(s)
      木村建太 ,松井謙二 ,中藤良久、加藤弓子
    • Organizer
      日本音響学会2015秋季発表会
    • Place of Presentation
      会津大学
    • Year and Date
      2015-09-18
    • Related Report
      2015 Research-status Report
  • [Presentation] Singing System by Electric-Larynx Using LPC Residual Wave2015

    • Author(s)
      Takashi Himeno, Yuto Tanaka, Mitsunori Mizumachi, Yoshihisa Nakatoh, Kenji Matsui
    • Organizer
      3rd IIAE International Conference on Intelligent Systems and Image Processing 2015
    • Place of Presentation
      福岡大学
    • Year and Date
      2015-09-04
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2015-04-16   Modified: 2019-03-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi