• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A talking robot having human-like brain functions for autonomous voice learning and its application to a vocal articulation simulator

Research Project

Project/Area Number 15K01459
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Rehabilitation science/Welfare engineering
Research InstitutionWaseda University (2017-2018)
Kagawa University (2015-2016)

Principal Investigator

Sawada Hideyuki  早稲田大学, 理工学術院, 教授 (00308206)

Research Collaborator Thanh Vo Nhu  University of Science and Technology
Project Period (FY) 2015-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥4,810,000 (Direct Cost: ¥3,700,000、Indirect Cost: ¥1,110,000)
Fiscal Year 2017: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2016: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Fiscal Year 2015: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
Keywords知能ロボット / ソフトロボット / 人工知能 / 音声生成 / 聴覚フィードバック / 脳内ネットワーク / 音声認識 / 発声障害 / 機械学習
Outline of Final Research Achievements

We have developed a talking robot, which is a mechanical vocalization system by modeling the human vocal articulatory system. The robot is constructed with mechanical parts that are made by referring to human vocal organs biologically and functionally. In this project, newly redesigned organs were developed for extending the speaking capability.
In human speech, the timing function is important for determining its duration, stress and rhythm. The cerebellum plays a key role in the coordination, precision and timing of motor responses. We have developed a robotic brain, which generates human-like vocal sounds using a simplified cerebellum-like neural network model as the timing function. The brain model was designed using the System Generator software, and implemented in a hardware co-simulated with a FPGA. We verified that the learning capability of the cerebellar-like neural network was applicable to speaking for generating a human-like utterance with prosodic features.

Academic Significance and Societal Importance of the Research Achievements

本研究は、人間の音声生成機構を全て機械的に再現した発話ロボットを構築するばかりでなく、音声の自律獲得に拘わる脳機能を再現した学習機構を実装し、音声から口内の発話動作を獲得して音声生成を行うシステムを実現した。これにより、人間の様に学習によって発話動作及び音声を獲得することが出来る機械機構を再現でき、更に人間の構音動作との比較から、発話障害の訓練装置の実現に貢献できる。
人間は、聴覚フィードバックによって各発話器官を統合的に制御して、安定した発話をおこなう手法を、後天的に獲得している。人間の音声学習機構との比較、解析を行っていくことにより、脳における情報の認知・生成メカニズムの解明につながる。

Report

(5 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Research-status Report
  • 2016 Research-status Report
  • 2015 Research-status Report
  • Research Products

    (16 results)

All 2019 2018 2017 2016 2015 Other

All Int'l Joint Research (1 results) Journal Article (9 results) (of which Int'l Joint Research: 7 results,  Peer Reviewed: 9 results,  Acknowledgement Compliant: 4 results,  Open Access: 2 results) Presentation (3 results) (of which Int'l Joint Research: 1 results,  Invited: 1 results) Book (1 results) Remarks (2 results)

  • [Int'l Joint Research] The University of Danang(ベトナム)

    • Related Report
      2018 Annual Research Report
  • [Journal Article] Intoning Speech Performance of the Talking Robot for Vietnamese Language Case2018

    • Author(s)
      Thanh Vo Nhu and Hideyuki Sawada
    • Journal Title

      Proc. of International Symposium on Micro-NanoMechatronics and Human Science

      Volume: MHS2018 Pages: 160-163

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Development of Vietnamese Voice Chatbot with Emotion Expression2018

    • Author(s)
      Thanh Vo Nhu and Hideyuki Sawada
    • Journal Title

      Proc. of International Symposium on Micro-NanoMechatronics and Human Science

      Volume: MHS2018 Pages: 22-27

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Diabetic Neuropathy: A Focus on the Testing Method2018

    • Author(s)
      unichi Danjo, Sonoko Danjo, Hideyuki Sawada, Keiji Uchida and Yu Nakamura
    • Journal Title

      International Journal of Family & Community Medicine

      Volume: 2-1 Pages: 00027-00027

    • Related Report
      2017 Research-status Report
    • Peer Reviewed
  • [Journal Article] Text-to-speech of a talking robot for interactive speech training of hearing impaired2017

    • Author(s)
      Vo Nhu Thanh、Sawada Hideyuki
    • Journal Title

      IEEE International Conference on Human System Interaction

      Volume: HSI2017 Pages: 166-171

    • DOI

      10.1109/hsi.2017.8005021

    • Related Report
      2017 Research-status Report
    • Peer Reviewed
  • [Journal Article] A Talking Robot and Its Real-time Interactive Modification for Speech Clarification2016

    • Author(s)
      Vo Nhu Thanh and Hideyuki Sawada
    • Journal Title

      SICE Journal of Control, Measurement, and System Integration

      Volume: Vol.9, No.6 Issue: 6 Pages: 251-256

    • DOI

      10.9746/jcmsi.9.251

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Automatic Vowel Sequence Reproduction for a Talking Robot Based on PARCOR Coefficient Template Matching2016

    • Author(s)
      Vo Nhu Thanh and Hideyuki Sawada
    • Journal Title

      IEIE Transactions on Smart Processing and Computing

      Volume: Vol. 5, No. 3 Issue: 3 Pages: 215-221

    • DOI

      10.5573/ieiespc.2016.5.3.215

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Comparison of Several Acoustic Features for the Vowel Sequence Reproduction of a Talking Robot2016

    • Author(s)
      Vo Nhu Thanh and Hideyuki Sawada
    • Journal Title

      IEEE International Conference on Mechatronics and Automation

      Volume: CD-ROM Pages: 1137-1142

    • DOI

      10.1109/icma.2016.7558722

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Autonomous Vowels Sequence Reproduction of a Talking Robot Using PARCOR Coefficients2016

    • Author(s)
      Vo Nhu Thanh and Hideyuki Sawada
    • Journal Title

      Proceedings of International Conference on Electronics, Information and Communication

      Volume: CD-ROM proceedings

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] A Talking Robot and the Expressive Speech Communication with Human2015

    • Author(s)
      Hideyuki Sawada
    • Journal Title

      International Journal of Affective Engineering

      Volume: 14 Issue: 2 Pages: 95-102

    • DOI

      10.5057/ijae.14.95

    • NAID

      130005064397

    • ISSN
      2187-5413
    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] Vietnamese Language Speech Performance by the Talking Robot2016

    • Author(s)
      Vo Nhu Thanh and Hideyuki Sawada
    • Organizer
      電気関係学会 四国支部連合大会 講演論文集
    • Place of Presentation
      徳島大学
    • Year and Date
      2016-09-17
    • Related Report
      2016 Research-status Report
  • [Presentation] A Real Time Visualization System for Articulatory Analysis of the Talking Robot2015

    • Author(s)
      Vo Nhu Thanh and Hideyuki Sawada
    • Organizer
      電気関係学会 四国支部連合大会 講演論文集
    • Place of Presentation
      高知工科大学
    • Year and Date
      2015-09-26
    • Related Report
      2015 Research-status Report
  • [Presentation] A Talking Robot and the Autonomous Learning of Speech Articulation for the Communication with Human2015

    • Author(s)
      Hideyuki Sawada
    • Organizer
      Internstional Workshop on Speech Robotics
    • Place of Presentation
      Dresden, Germany
    • Year and Date
      2015-09-11
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research / Invited
  • [Book] 日本機械学会誌「運動パターンを創り出すマテリアルと知能の設計」2019

    • Author(s)
      前田真吾, 澤田秀之, 重宗宏毅, 三輪貴信
    • Total Pages
      2
    • Publisher
      一般社団法人日本機械学会
    • Related Report
      2018 Annual Research Report
  • [Remarks] 早稲田大学 澤田研究室

    • URL

      http://www.sawada.phys.waseda.ac.jp/

    • Related Report
      2018 Annual Research Report 2017 Research-status Report
  • [Remarks] 香川大学 澤田研究室

    • URL

      http://www.eng.kagawa-u.ac.jp/~sawada/

    • Related Report
      2015 Research-status Report

URL: 

Published: 2015-04-16   Modified: 2020-03-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi