• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2011 Fiscal Year Final Research Report

The analysis of unclear vocal articulations of auditory-impaired and the construction of an interactive training system using a talking robot

Research Project

  • PDF
Project/Area Number 21500517
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Rehabilitation science/Welfare engineering
Research InstitutionKagawa University

Principal Investigator

SAWADA Hideyuki  香川大学, 工学部, 教授 (00308206)

Project Period (FY) 2009 – 2011
Keywords発話ロボット / 発話訓練 / 聴覚障がい者 / 支援技術 / 音声 / 聴覚フィードバック / 自己組織化ニューラルネットワーク / 構音障害
Research Abstract

In this study, a vocalization training system for the auditory-impaired was constructed by applying a talking robot, which has mechanical organs like a human. With an adaptive learning strategy using an auditory feedback control, the robot autonomously learned the human vocalizations, and then reproduced the speech articulations from inputted vocal sounds. By analyzing the acquired relations between vocal articulations and the generated vocal sounds stored in the robot, unclear vocal sounds given by auditory-impaired people were classified, and then particular features were extracted, which were associated with vocal articulations reproduced by the robot. The robot was employed in the speech training for auditory-impaired, and the training results verified the effectiveness of the interactive training employing the robot.

  • Research Products

    (13 results)

All 2012 2011 2010 2009 Other

All Journal Article (2 results) Presentation (9 results) Book (1 results) Remarks (1 results)

  • [Journal Article] Dual-SOMの位相構造学習に基づく発話ロボットの自律的音声獲得2011

    • Author(s)
      木谷光来, 原達矢, 澤田秀之
    • Journal Title

      日本機械学会論文集C編

      Volume: Vol.77, No.775 Pages: 1062-1070

  • [Journal Article] Voice articulatory training with a talking robot for the auditory impaired2011

    • Author(s)
      Mitsuki Kitani, Tatsuya Hara and Hideyuki Sawada
    • Journal Title

      International Journal on disability and human development

      Volume: Vol.10, No.1 Pages: 63-67

  • [Presentation] A Talking Robot and Its Human-like Expressive Speech Production2011

    • Author(s)
      Mitsuki Kitani, Tatsuya Hara, Hiroki Hanada and Hideyuki Sawada
    • Organizer
      International Conference on Human System Interaction
    • Year and Date
      20110000
  • [Presentation] Several Approaches to Speech and Auditory Systems for Human System Interactions2011

    • Author(s)
      Hideyuki Sawada and Mitsuki Kitani
    • Organizer
      International Conference on Human System Interaction
    • Year and Date
      20110000
  • [Presentation] ロボットによる聴覚障がい者の発話動作の再現2011

    • Author(s)
      木谷光来, 大久保和哉, 澤田秀之
    • Organizer
      電子情報通信学会HCGシンポジウム2011
    • Year and Date
      20110000
  • [Presentation] Analysis of Robotic Speech employing the Vocal Tract Area Function2011

    • Author(s)
      Outstanding English Presentation Award, Mitsuki Kitani and Hideyuki Sawada
    • Organizer
      電気関係学会四国支部大会講演論文集
    • Year and Date
      2011-09-23
  • [Presentation] A talking robot for the vocal communication by the mimicry of human voice2010

    • Author(s)
      Best Paper Award, Mitsuki Kitani, Tatsuya Hara, Hiroki Hanada and Hideyuki Sawada
    • Organizer
      International Conference on Human System Interaction
    • Year and Date
      20100000
  • [Presentation] Robotic Vocalization Training System for the Auditory-impaired2010

    • Author(s)
      Mitsuki Kitani, Tatusya Hara, Hiroki Hanada and Hideyuki Sawada
    • Organizer
      International Conference on Disability, Virtual Reality and Associated Technologies
    • Year and Date
      20100000
  • [Presentation] A Talking Robot and the Auditory Feedback Learning for Natural Vocalization2010

    • Author(s)
      IEEE Best Award, Mitsuki Kitani, Tatsuya Hara, Hiroki Hanada and Hideyuki Sawada
    • Organizer
      The 7th IEEE Tokyo Young Researchers Workshop
    • Year and Date
      2010-11-20
  • [Presentation] A Talking Robot and the Adaptive Learning of Speech Articulation Using 3D SOM2009

    • Author(s)
      Mitsuki Kitani, Tatsuya Hara and Hideyuki Sawada
    • Organizer
      IEEE International Symposium on Biomedical Engineering(IEEE ISBME2009)
    • Year and Date
      20090000
  • [Presentation] A Talking Robot and the Interactive Speech Training for Hearing-Impaired2009

    • Author(s)
      Invited Talk, Hideyuki Sawada
    • Organizer
      General Meeting of the Acoustical Society of America
    • Year and Date
      2009-05-18
  • [Book] A Talking Robot and Its Singing Performance by the Mimicry of Human Vocalization2012

    • Author(s)
      Mitsuki Kitani, Tatsuya Hara, Hiroki Hanada and Hideyuki Sawada
    • Total Pages
      1867-5662
  • [Remarks]

    • URL

      http://www.eng.kagawa-u.ac.jp/~sawada/

URL: 

Published: 2013-07-31  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi