• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

The analysis of unclear vocal articulations of auditory-impaired and the construction of an interactive training system using a talking robot

Research Project

Project/Area Number 21500517
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Rehabilitation science/Welfare engineering
Research InstitutionKagawa University

Principal Investigator

SAWADA Hideyuki  香川大学, 工学部, 教授 (00308206)

Project Period (FY) 2009 – 2011
Project Status Completed (Fiscal Year 2011)
Budget Amount *help
¥4,420,000 (Direct Cost: ¥3,400,000、Indirect Cost: ¥1,020,000)
Fiscal Year 2011: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2010: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2009: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
Keywords発話ロボット / 発話訓練 / 聴覚障がい者 / 支援技術 / 音声 / 聴覚フィードバック / 自己組織化ニューラルネットワーク / 構音障害 / 自己組織化NN / 聴覚障碍者 / 構音障碍
Research Abstract

In this study, a vocalization training system for the auditory-impaired was constructed by applying a talking robot, which has mechanical organs like a human. With an adaptive learning strategy using an auditory feedback control, the robot autonomously learned the human vocalizations, and then reproduced the speech articulations from inputted vocal sounds. By analyzing the acquired relations between vocal articulations and the generated vocal sounds stored in the robot, unclear vocal sounds given by auditory-impaired people were classified, and then particular features were extracted, which were associated with vocal articulations reproduced by the robot. The robot was employed in the speech training for auditory-impaired, and the training results verified the effectiveness of the interactive training employing the robot.

Report

(4 results)
  • 2011 Annual Research Report   Final Research Report ( PDF )
  • 2010 Annual Research Report
  • 2009 Annual Research Report
  • Research Products

    (39 results)

All 2012 2011 2010 2009 Other

All Journal Article (10 results) (of which Peer Reviewed: 8 results) Presentation (22 results) Book (3 results) Remarks (4 results)

  • [Journal Article] Dual-SOMの位相構造学習に基づく発話ロボットの自律的音声獲得2011

    • Author(s)
      木谷光来, 原達矢, 澤田秀之
    • Journal Title

      日本機械学会論文集C編

      Volume: Vol.77, No.775 Pages: 1062-1070

    • NAID

      130000873813

    • Related Report
      2011 Final Research Report
  • [Journal Article] Voice articulatory training with a talking robot for the auditory impaired2011

    • Author(s)
      Mitsuki Kitani, Tatsuya Hara and Hideyuki Sawada
    • Journal Title

      International Journal on disability and human development

      Volume: Vol.10, No.1 Pages: 63-67

    • Related Report
      2011 Final Research Report 2010 Annual Research Report
  • [Journal Article] Dual-SOMの位相構造学習に基づく発話ロボットの自律的音声獲得2011

    • Author(s)
      木谷光来, 原達矢, 澤田秀之
    • Journal Title

      日本機械学会論文集(C編)

      Volume: Vol.77, No.775 Pages: 1062-1070

    • NAID

      130000873813

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] A Talking Robot and Its Human-like Expressive Speech Production2011

    • Author(s)
      Mitsuki Kitani, Tatsuya Hara, Hiroki Hanada, Hideyuki Sawada
    • Journal Title

      International Conference on Human System Interaction

      Pages: 203-208

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Several Approaches to Speech and Auditory Systems for Human System Interactions2011

    • Author(s)
      Hideyuki Sawada, Mitsuki Kitani
    • Journal Title

      International Conference on Human System Interaction

      Pages: 409-414

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Dual-SOMの位相構造学習に基づく発話ロボットの自律的音声獲得2011

    • Author(s)
      澤田秀之, 他
    • Journal Title

      日本機械学会論文集(C編)

      Volume: Vol.77, No.775(In Press)

    • NAID

      130000873813

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Best Paper Award A talking robot for the vocal communication by the mimicry of human voice2010

    • Author(s)
      Hideyuki Sawada, et al.
    • Journal Title

      International Conference on Human System Interaction

      Volume: HSI2010 Pages: 728-733

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Integration of Sound and Image Information for Active Tracking of Particular Person2010

    • Author(s)
      Hideyuki Sawada, et al.
    • Journal Title

      Int'l Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology

      Volume: ECTI-CON 2010 Pages: 861-865

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Robotic Vocalization Training System for the Auditory-impaired2010

    • Author(s)
      Hideyuki Sawada, et al.
    • Journal Title

      International Conference on Disability, Virtual Reality and Associated Technologies

      Volume: ICDVRAT 2010 Pages: 263-272

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] A Talking Robot and the Adaptive Learning of Speech Articulation Using 3D SOM2009

    • Author(s)
      Mitsuki Kitani, Tatsuya Hara, Hideyuki Sawada
    • Journal Title

      IEEE International Symposium on Biomedical Engineering (IEEE ISBME2009) (CD-ROM proceedings)

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Presentation] 人の音響聴取を模倣した特定音響の能動的センシング2011

    • Author(s)
      宇高静, 澤田秀之
    • Organizer
      計測自動制御学会第12回システムインテグレーション部門講演会(SI2011)
    • Place of Presentation
      京都大学
    • Year and Date
      2011-12-23
    • Related Report
      2011 Annual Research Report
  • [Presentation] 視覚・聴覚・触覚を通した人とロボットのコミュニケーション2011

    • Author(s)
      澤田秀之
    • Organizer
      2011国際ロボット展
    • Place of Presentation
      東京ビッグサイト
    • Year and Date
      2011-11-09
    • Related Report
      2011 Annual Research Report
  • [Presentation] Analysis of Robotic Speech employing the Vocal Tract Area Function2011

    • Author(s)
      Outstanding English Presentation Award, Mitsuki Kitani and Hideyuki Sawada
    • Organizer
      電気関係学会四国支部大会講演論文集
    • Year and Date
      2011-09-23
    • Related Report
      2011 Final Research Report
  • [Presentation] Outstanding English Presentation Award, "Analysis of Robotic Speech employing the Vocal Tract Area Function"2011

    • Author(s)
      Mitsuki Kitani, Hideyuki Sawada
    • Organizer
      電気関係学会四国支部大会
    • Place of Presentation
      阿南高専
    • Year and Date
      2011-09-23
    • Related Report
      2011 Annual Research Report
  • [Presentation] Estimating and Tracking Dififerent Sounds by a Robotic Auditory System2011

    • Author(s)
      Chika Udaka, Hideyuki Sawada
    • Organizer
      電気関係学会四国支部大会
    • Place of Presentation
      阿南高専
    • Year and Date
      2011-09-23
    • Related Report
      2011 Annual Research Report
  • [Presentation] 視覚・聴覚・触覚を通した人とロボットのコミュニケーション技術2011

    • Author(s)
      澤田秀之
    • Organizer
      MEMSイノベーションワークショップ
    • Place of Presentation
      東京ビッグサイト
    • Year and Date
      2011-07-15
    • Related Report
      2011 Annual Research Report
  • [Presentation] 人とロボットの音声コミュニケーションと発話ロボット2011

    • Author(s)
      澤田秀之
    • Organizer
      ROBOTECH次世代ロボット製造技術展
    • Place of Presentation
      東京ビッグサイト
    • Year and Date
      2011-07-13
    • Related Report
      2011 Annual Research Report
  • [Presentation] A Talking Robot and Its Human-like Expressive Speech Production2011

    • Author(s)
      Mitsuki Kitani, Tatsuya Hara, Hiroki Hanada and Hideyuki Sawada
    • Organizer
      International Conference on Human System Interaction
    • Related Report
      2011 Final Research Report
  • [Presentation] Several Approaches to Speech and Auditory Systems for Human System Interactions2011

    • Author(s)
      Hideyuki Sawada and Mitsuki Kitani
    • Organizer
      International Conference on Human System Interaction
    • Related Report
      2011 Final Research Report
  • [Presentation] ロボットによる聴覚障がい者の発話動作の再現2011

    • Author(s)
      木谷光来, 大久保和哉, 澤田秀之
    • Organizer
      電子情報通信学会HCGシンポジウム2011
    • Related Report
      2011 Annual Research Report 2011 Final Research Report
  • [Presentation] A Talking Robot and the Auditory Feedback Learning for Natural Vocalization2010

    • Author(s)
      IEEE Best Award, Mitsuki Kitani, Tatsuya Hara, Hiroki Hanada and Hideyuki Sawada
    • Organizer
      The 7th IEEE Tokyo Young Researchers Workshop
    • Year and Date
      2010-11-20
    • Related Report
      2011 Final Research Report
  • [Presentation] IEEE Best Award : A Talking Robot and the Auditory Feedback Learning for Natural Vocalization2010

    • Author(s)
      Mitsuki Kitani, et al.
    • Organizer
      7th IEEE Tokyo Young Researchers Workshop
    • Place of Presentation
      東京工業大学
    • Year and Date
      2010-11-20
    • Related Report
      2010 Annual Research Report
  • [Presentation] 優秀発表賞:Estimation of Sound Source Direction using a Robotic Arm2010

    • Author(s)
      Chika Udaka, et al.
    • Organizer
      電気関係学会 四国支部大会
    • Place of Presentation
      愛媛大学
    • Year and Date
      2010-09-25
    • Related Report
      2010 Annual Research Report
  • [Presentation] Construction of an Interactive Training System Using a Talking Robot2010

    • Author(s)
      Mitsuki Kitani, et al.
    • Organizer
      電気関係学会 四国支部大会
    • Place of Presentation
      愛媛大学
    • Year and Date
      2010-09-25
    • Related Report
      2010 Annual Research Report
  • [Presentation] ロボットパフォーマンス「発話ロボット」2010

    • Author(s)
      澤田秀之
    • Organizer
      科学技術振興機構「科学と芸術の集い」ロボットアーティスト大集合
    • Place of Presentation
      サンポートホール高松 大ホール(香川)
    • Year and Date
      2010-02-21
    • Related Report
      2009 Annual Research Report
  • [Presentation] A talking robot for the vocal communication by the mimicry of human voice2010

    • Author(s)
      Best Paper Award, Mitsuki Kitani, Tatsuya Hara, Hiroki Hanada and Hideyuki Sawada
    • Organizer
      International Conference on Human System Interaction
    • Related Report
      2011 Final Research Report
  • [Presentation] Robotic Vocalization Training System for the Auditory-impaired2010

    • Author(s)
      Mitsuki Kitani, Tatusya Hara, Hiroki Hanada and Hideyuki Sawada
    • Organizer
      International Conference on Disability, Virtual Reality and Associated Technologies
    • Related Report
      2011 Final Research Report
  • [Presentation] Adaptive Learning of the Speech Articulation of a Talking Robot Using 3D SOM2009

    • Author(s)
      澤田秀之
    • Organizer
      電気関係学会 四国支部大会 講演論文集
    • Place of Presentation
      徳島大学(徳島県)
    • Year and Date
      2009-09-26
    • Related Report
      2009 Annual Research Report
  • [Presentation] A Talking Robot and the Interactive Speech Training for Hearing-Impaired2009

    • Author(s)
      Invited Talk, Hideyuki Sawada
    • Organizer
      General Meeting of the Acoustical Society of America
    • Year and Date
      2009-05-18
    • Related Report
      2011 Final Research Report
  • [Presentation] Invited Talk A Talking Robot and the Interactive Speech Training for Hearing-Impaired2009

    • Author(s)
      澤田秀之
    • Organizer
      General Meeting of the Acoustical Society of America
    • Place of Presentation
      Hilton Portland & Executive Tower, Oregon, USA
    • Year and Date
      2009-05-18
    • Related Report
      2009 Annual Research Report
  • [Presentation] A Talking Robot and the Adaptive Learning of Speech Articulation Using 3D SOM2009

    • Author(s)
      Mitsuki Kitani, Tatsuya Hara and Hideyuki Sawada
    • Organizer
      IEEE International Symposium on Biomedical Engineering(IEEE ISBME2009)
    • Related Report
      2011 Final Research Report
  • [Presentation] 音響信号と画像信号の統合処理による特定音響の能動的センシング2009

    • Author(s)
      澤田秀之
    • Organizer
      計測自動制御学会 第10回システムインテグレーション部門講演会(SI2009)
    • Place of Presentation
      芝浦工業大学 豊洲キャンパス(東京都)
    • Related Report
      2009 Annual Research Report
  • [Book] A Talking Robot and Its Singing Performance by the Mimicry of Human Vocalization2012

    • Author(s)
      Mitsuki Kitani, Tatsuya Hara, Hiroki Hanada and Hideyuki Sawada
    • Related Report
      2011 Final Research Report
  • [Book] "A Talking Robot and Its Singing Performance by the Mimicry of Human Vocalization" in Human-Computer Systems Interaction : Backgrounds and Applications Part 2, Advances in Intelligent and Soft Computing2011

    • Author(s)
      Mitsuki Kitani, Tatsuya Hara, Hiroki Hanada, Hideyuki Sawada
    • Total Pages
      516
    • Publisher
      Springer
    • Related Report
      2011 Annual Research Report
  • [Book] 「ロボット情報学ハンドブック」, ISBN:978-4764955073(松原仁, 松野文俊, 稲見昌彦, 野田五十樹, 大須賀公一, 編集)2010

    • Author(s)
      澤田秀之
    • Total Pages
      943
    • Publisher
      ナノオプトニクスエナジー
    • Related Report
      2009 Annual Research Report
  • [Remarks]

    • URL

      http://www.eng.kagawa-u.ac.jp/~sawada/

    • Related Report
      2011 Final Research Report
  • [Remarks]

    • URL

      http://www.eng.kagawa-u.ac.jp/~sawada/

    • Related Report
      2011 Annual Research Report
  • [Remarks]

    • URL

      http://www.eng.kagawa-u.ac.jp/~sawada/

    • Related Report
      2010 Annual Research Report
  • [Remarks]

    • URL

      http://www.eng.kagawa-u.ac.jp/~sawada/

    • Related Report
      2009 Annual Research Report

URL: 

Published: 2009-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi