• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research on figure models of speech articulators and a speaking robot development based on speech articulators' motions measurements

Research Project

Project/Area Number 20K11876
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 61010:Perceptual information processing-related
Research InstitutionOsaka Institute of Technology

Principal Investigator

Hirayama Makoto J.  大阪工業大学, 情報科学部, 教授 (70329374)

Project Period (FY) 2020-04-01 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2023: ¥520,000 (Direct Cost: ¥400,000、Indirect Cost: ¥120,000)
Fiscal Year 2022: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2021: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2020: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
Keywords音声生成 / 調音器官運動模型 / 調音運動計測 / 発話ロボット / 調音器官模型 / 音声発話ロボット
Outline of Research at the Start

人間の言語音声生成機構について、顎・舌・唇といった調音器官の運動計測とその解析に基づき、調音器官の形状模型および動作模型製作,さらに音声発話ロボットの試作を行う。声帯音源模型により駆動される動作可能な顎・舌・唇からなる声道模型を作成して、母音及びいくつかの子音の音声発話ができるようにする。音声科学教育の充実及び調音機構のさらなる解明に役立つとともに、ヒト型ロボットの高度化に貢献するものとなる。

Outline of Final Research Achievements

With the aim of elucidating the mechanism of speech production and its application to a speech robot, we designed and created 3DCG models of the speech-producing organs (maxilla, mandible, hyoid bone, tongue, lips, muscles attached to them, and their surrounding skin, vocal cords, vocal tract, and nasal cavity) using modeling software with reference to MRI measurement data. The models of the maxilla, mandible, and hyoid were made using a 3D printer that was installed in the laboratory. Models of the tongue, lips, vocal cords, and vocal tract were made by hand, and models of these speech organs were made using viscoelastic materials such as urethane gel. A model of the vocal tract was also made, which was driven by an electric laryngeal model to produce speech sounds. We also proposed a method to synthesize MRI images of the lungs, vocal cords, and vocal tract and display them in a moving image.

Academic Significance and Societal Importance of the Research Achievements

人間の音声生成は音声生成器官の筋運動によりなされるが、多数の筋が協調する複雑な調音運動の詳細を解明していくことは、音声科学の課題である。音声生成器官である上顎、下顎、舌骨、舌、唇、それらに付着する筋群とその周辺の皮膚、声帯周辺、声道、鼻腔のCGモデルを設計制作し、音声生成器官の実態模型を制作することで、実態模型により動作の詳細を理解し、また、実体模型を使って音声生成を試みることで、音声言語科学の進展に貢献した。今回の研究成果を利用して、1) 調音器官運動機構の検証、2) 音声科学教育用教材、3) 構音指導、4) 外国語発音教育、5) 発話ロボット部品開発への応用が今後期待できる。

Report

(5 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Research-status Report
  • 2021 Research-status Report
  • 2020 Research-status Report
  • Research Products

    (10 results)

All 2024 2023 2021

All Journal Article (2 results) (of which Peer Reviewed: 2 results,  Open Access: 1 results) Presentation (7 results) (of which Int'l Joint Research: 5 results) Book (1 results)

  • [Journal Article] A Life-size Display of MRI (magnetic resonance imaging) Movie of the Speech Organs at a Language Exhibition2024

    • Author(s)
      Makoto J. Hirayama, Ichiro Fujimoto, and Ritsuko Kikusawa
    • Journal Title

      SPIE Conference Proceedings

      Volume: 13164 Pages: 1-6

    • DOI

      10.1117/12.3018205

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] 3D modeling and 3D printing of human jaws for speech production research and education2023

    • Author(s)
      Makoto J. Hirayama
    • Journal Title

      Proceedings of SPIE

      Volume: 12592 Pages: 1-4

    • DOI

      10.1117/12.2670529

    • Related Report
      2022 Research-status Report
    • Peer Reviewed
  • [Presentation] Life-size exhibition display for magnetic resonance imaging movie of speech organs2024

    • Author(s)
      Makoto J. Hirayama, Ichiro Fujimoto, and Ritsuko Kikusawa
    • Organizer
      International Workshop on Advanced Image Technology 2024
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Computer Graphics Modeling of Human Speech Organs2024

    • Author(s)
      Makoto J. Hirayama
    • Organizer
      8th IIEEJ International Conference on Image Electronics and Visual Computing
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Making Figure Models of Speech Articulators for Speech Production Research2023

    • Author(s)
      Makoto J. Hirayama
    • Organizer
      Acoustics 2023
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 3Dプリンタによる博物館展示用模型の製作2023

    • Author(s)
      平山亮
    • Organizer
      画像電子学会第50回年次大会
    • Related Report
      2022 Research-status Report
  • [Presentation] 3D modeling and 3D printing of human jaws for speech production research and education2023

    • Author(s)
      Makoto J. Hirayama
    • Organizer
      International Workshop on Advanced Image Technology
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] 3Dプリンタによる音声生成器官模型の試作2021

    • Author(s)
      平山亮
    • Organizer
      画像電子学会 第297回研究会
    • Related Report
      2021 Research-status Report
  • [Presentation] A finger motion traking system for Japanese sign language demonstrations2021

    • Author(s)
      Makoto J. Hirayama, Akira Asada, and Ritsuko Kikusawa
    • Organizer
      The 7th IIEEJ International Conference on Image Electronics and Visual Computing (IEVC2021)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Book] しゃべるヒト ーことばの不思議を科学するー2023

    • Author(s)
      菊澤律子・吉岡乾(編著)
    • Total Pages
      326
    • Publisher
      文理閣
    • ISBN
      9784892599248
    • Related Report
      2023 Annual Research Report

URL: 

Published: 2020-04-28   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi