• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of visual feedback speech training method based on real-time audio visualization system in cleft palate

Research Project

Project/Area Number 20H03891
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 57060:Surgical dentistry-related
Research InstitutionKagoshima University

Principal Investigator

Nakamura Norifumi  鹿児島大学, 医歯学域歯学系, 教授 (60217875)

Co-Investigator(Kenkyū-buntansha) 石畑 清秀  鹿児島大学, 医歯学域鹿児島大学病院, 講師 (10437957)
手塚 征宏  鹿児島大学, 医歯学域歯学系, 助教 (50759777)
小倉 道広  鹿児島大学, 鹿児島大学病院, 言語聴覚士 (60867745)
上栗 裕平  鹿児島大学, 鹿児島大学病院, 医員 (70911949)
坂田 聡  熊本大学, 大学院先端科学研究部(工), 助教 (80336205)
上田 裕市  熊本大学, 大学院先端科学研究部(工), 教授 (00141961)
Project Period (FY) 2020-04-01 – 2023-03-31
Project Status Completed (Fiscal Year 2022)
Budget Amount *help
¥11,700,000 (Direct Cost: ¥9,000,000、Indirect Cost: ¥2,700,000)
Fiscal Year 2022: ¥2,470,000 (Direct Cost: ¥1,900,000、Indirect Cost: ¥570,000)
Fiscal Year 2021: ¥2,990,000 (Direct Cost: ¥2,300,000、Indirect Cost: ¥690,000)
Fiscal Year 2020: ¥6,240,000 (Direct Cost: ¥4,800,000、Indirect Cost: ¥1,440,000)
Keywords口蓋裂 / ニューラルネットワーク / 異常構音 / 音声可視化 / 言語訓練 / 構音異常 / AI / EPG
Outline of Research at the Start

研究代表者らは新規ニューラルネットワーク(以下NN)の応用によって、音声を音源、調音様式、調音位置のカテゴリーに分類できる構音特徴分析システムを構築し、母音の色彩表示に加えて子音部では調音様式をテクスチャー(紋様)で表示することを可能にしてきた。
本研究では、母音を色彩で、子音を縞模様などのテクスチャーといった視覚的に訴えやすく、小児でも判別しやすい表記方法に音声を変換することによって、有効性の高い言語訓練法の実現に繋げる。口蓋裂術後の異常構音を正確に判別できるようになれば、聴覚に頼ってきた構音評価の正確性の向上をもたらすだけでなく、言語異常に苦しむ口蓋裂患者のQOLが著しく改善される。

Outline of Final Research Achievements

This study aims to develop a speech training method that enables real-time speech visualization and visual feedback of abnormal articulation in cleft palate patients based on articulatory feature analysis using a novel neural network (NN) system.
The NN system was successfully able to visualize abnormal articulation in cleft palate patients. The results of these NN analyses correlated well with the perceptual judgments of several speech-language pathologists. In addition, we developed software that allows the examiner and examinee to confirm the articulation place and sound sources by drawing them in real time on a sagittal image of the face.
It can be concluded that the NN system is a useful tool for enabling visual feedback to the diagnosis and speech training in patients with cleft palate. In the future, the NN system will be used for clinical application of speech training methods that reflect behavioral changes.

Academic Significance and Societal Importance of the Research Achievements

口唇裂口蓋裂患者は多様な障害を有するが、中でも言語障害は、患者のコミュニケーションを招いて患者のQOLを著しく低下させる.口蓋裂患者が正常構音を早期に獲得するには、早期に鼻咽腔閉鎖運動や構音動作の異常を診断し、言語訓練を行うことが有効とある.
新規ニューラルネットワーク(NN)システムは、口蓋裂児の構音異常の診断ならびに言語訓練に視覚的フィードバックを可能にする有用なツールとなり得る.また、本NNシステムを用いて口蓋裂児の調音位置を詳細に観察できるようになることは、口蓋裂に伴う異常構音の発生メカニズムの解明を促進させ、発症要因にアプローチ可能なより科学的な言語訓練へと発展することが期待できる.

Report

(4 results)
  • 2022 Annual Research Report   Final Research Report ( PDF )
  • 2021 Annual Research Report
  • 2020 Annual Research Report
  • Research Products

    (32 results)

All 2023 2022 2021 2020

All Journal Article (15 results) (of which Peer Reviewed: 15 results,  Open Access: 4 results) Presentation (17 results) (of which Int'l Joint Research: 7 results,  Invited: 4 results)

  • [Journal Article] Comparison of recurrence rate and speech outcome between two different techniques for cleft palatal fistula closure: A retrospective cohort study2022

    • Author(s)
      Tezuka M, Kamikuri Y, Ishihata K, Kibe T, Fuchigami T, Muhammad Subhan Amir, Matsunaga K, Nakamura N
    • Journal Title

      J of Cranio-Maxillo-Facial Surg

      Volume: 50 Issue: 1 Pages: 86-92

    • DOI

      10.1016/j.jcms.2021.09.018

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Postoperative stability following orthognathic surgery and final skeletal morphology in class III patients with cleft lip and palate2022

    • Author(s)
      Ishihata K, Kibe T, Tezuka M, Seong C-H, Maeda A, Okawachi T, Nozoe E, Nakamura N
    • Journal Title

      J Oral Maxillofac Surg Med Pathol

      Volume: 34 Issue: 6 Pages: 704-712

    • DOI

      10.1016/j.ajoms.2022.04.005

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Three-dimensional nasal forms following unilateral cleft-lip nose correction with mandibular ramus cortical bone augmentation for concaved nasal dorsum2022

    • Author(s)
      Ishihata K, Okawachi T, Kibe T, Tezuka M, Ratman MF, Nakamura N
    • Journal Title

      J Oral Maxillofac Surg Med Pathol

      Volume: 34 Issue: 6 Pages: 740-748

    • DOI

      10.1016/j.ajoms.2022.06.007

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Three-dimensional quantification of postoperative facial asymmetry in patients with unilateral cleft lip and palate using facial symmetry plane2022

    • Author(s)
      Shiigi A, Okawachi T, Kamiya T, Hosoki D, Nomoto N, Ratman MF, Amir MS, Ishihata K, Nakamura N
    • Journal Title

      Cleft Palate Craniofac J

      Volume: Epub

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 口唇裂・口蓋裂児に関する臨床統計的検討2022

    • Author(s)
      髙木律男,児玉泰光,飯田征二,井上直子,小林眞司,阪井丘芳,須佐美隆史,須田直人,中村典史,宮脇剛司,古郷幹彦
    • Journal Title

      日口蓋誌

      Volume: 48 Pages: 210-219

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed
  • [Journal Article] A Follow-Up Study on the Clinical Outcomes of Alveolar Reconstruction Using Octacalcium Phosphate Granules and Atelocollagen Complex2021

    • Author(s)
      Kibe T, Maeda-Iino A, Takahashi T, Kamakura S, Suzuki O, Nakamura N.
    • Journal Title

      Oral Maxillofac Surg.

      Volume: 79 Issue: 12 Pages: 2462-2471

    • DOI

      10.1016/j.joms.2021.09.017

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] An adolescent patient with bilateral cleft lip and palate treated with late bone grafting and edgewise appliance for mesial movement of the maxillary molars and improvement of the retroclined maxillary central incisor.2021

    • Author(s)
      Maeda‐Iino A, Nakagawa S, Nakamura N, Miyawaki S.
    • Journal Title

      AJO-DO Clinical Companion

      Volume: 1 Issue: 1 Pages: 55-72

    • DOI

      10.1016/j.xaor.2021.01.006

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Closure of oronasal fistulae post palatoplasty with tongue flap in bilateral complete cleft lip and palate patient: A case report2021

    • Author(s)
      Sayekti M, Barus L, Sumarta NPM, Nakamura N
    • Journal Title

      Arch Orofac Sci

      Volume: 16 Issue: Supp. 1 Pages: 59-65

    • DOI

      10.21315/aos2021.16.s1.10

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 口唇裂・口蓋裂児のQOLにおける自己評価と保護者による評価の検討2021

    • Author(s)
      香西早苗、中新美保子、稲川喜一、井上信次、手塚征宏、岐部俊郎、中村典史
    • Journal Title

      日口蓋誌

      Volume: 46 Pages: 153-159

    • NAID

      130008125922

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 両側性口唇顎裂ならびに上顎両側重視部に複数の副顎を伴う両側性横眼裂(Tessier 分類7)患者の臨床的特徴 出生から14歳までの経過観察2021

    • Author(s)
      春山直人,鈴木 陽,野口健志,野村俊介,吉崎恵悟,落合 聡,笹栗正明,光安岳志,森山雅文,中村典史,高橋一郎
    • Journal Title

      日本頭蓋顎顔面外科学会誌

      Volume: 37 Pages: 1-11

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 片側性唇顎裂患者の鼻前庭部にみられた鼻唇嚢胞の一例2021

    • Author(s)
      上栗裕平, 渕上貴央, 手塚征宏, 岐部俊郎, 石畑清秀, 中村典史
    • Journal Title

      日口蓋誌

      Volume: 46 Pages: 41-46

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Using three-dimensional nasal forms to compare definitive unilateral cleft lip nose correction with/without a cross-lap joint cartilage graft technique.2020

    • Author(s)
      Okawachi T, Ishihata K, Nomoto N, Tezuka M, Kamikuri Y, Nozoe E, Nakamura N.
    • Journal Title

      J Craniomaxillofac Surg.

      Volume: 48 Issue: 11 Pages: 1035-1044

    • DOI

      10.1016/j.jcms.2020.08.008

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Alternative successful functional recovery of total full-thickness velar defect following recurrent oropharyngeal carcinoma resection: A case report2020

    • Author(s)
      Tezuka M, Hirahara N, Kamikuri Y, Ishida T, Nakamura N
    • Journal Title

      Journal of Oral Maxillofacial Surgery, Medicine and Pathology

      Volume: 32 Issue: 6 Pages: 498-502

    • DOI

      10.1016/j.ajoms.2020.07.010

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 口唇形成術後に肺炎加療を要した13トリソミーの1例2020

    • Author(s)
      中囿賢太、石畑清秀、岐部敏郎、手塚征宏、渕上貴央、中村典史
    • Journal Title

      日本口蓋裂学会誌

      Volume: 45 Pages: 220-224

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 顎間骨整位術と顎裂部への骨移植後に小臼歯の移植を行った両側性不完全唇顎口蓋裂を伴う不正咬合症例2020

    • Author(s)
      丸谷 佳菜子, 權 相豪, 友成 博, 中村典史, 宮脇 正一
    • Journal Title

      九州矯正歯科学会雑誌

      Volume: 15 Pages: 51-56

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Presentation] Visualization of cleft palate speech to improve the quality of articulation using a novel Neural Network system2023

    • Author(s)
      Nakamura N
    • Organizer
      The 19th Scientific Meeting & Refresher Course in Dentistry (KPPKIG 2023)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 新規ニューラルネットワークを用いた口蓋裂患者の異常構音の可視化の試み-瘻孔閉鎖術前後の変化の分析2022

    • Author(s)
      上栗裕平, 手塚征宏, 椎木彩乃, 岐部俊郎, 石畑清秀, 中村典史
    • Organizer
      第76回日本口腔科学会学術集会
    • Related Report
      2022 Annual Research Report
  • [Presentation] 声門破裂音の改善を認めた口蓋裂児に対する音声可視化システムによる評価の応用2022

    • Author(s)
      上栗裕平, 手塚征宏, 小倉道広, 椎木彩乃, 岐部俊郎, 木村菜美子, 坂田聡, 中村典史
    • Organizer
      第46回日本口蓋裂学会総会・学術集会
    • Related Report
      2022 Annual Research Report
  • [Presentation] Speech visualization using a novel neural network before and after fistula closure surgery in patients with cleft palate2022

    • Author(s)
      Kamikuri Y, Tezuka M, Tadashi Sakata, Yuichi Ueda, Michihiro Ogura, Kiyohide Ishihata, Norifumi Nakamura
    • Organizer
      14th international cleft congress CLEFT 2022
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Three-dimensional quantification of post-operative facial asymmetry using a facial symmetry plane in patients with unilateral cleft lip and palate2022

    • Author(s)
      Nakamura N, Shiigi A, Nomoto N, Okawachi T, Kamiya T, Hosoki D, Ratman FM, Ishihata K
    • Organizer
      14th international cleft congress CLEFT 2022
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 口唇口蓋裂治療を次世代に伝える-「技」を「戦略」に置き換えて-2022

    • Author(s)
      中村典史
    • Organizer
      第4回南九州歯学会
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] Education of cleft lip and palate for lay person2021

    • Author(s)
      Nakamura N
    • Organizer
      orld Universities Association for Community Development (WUACD) Thematic Summer Program
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Successful secondary correction of cleft lip nose deformities using extended spreader cartilage graft with a cross-lap joint technique2021

    • Author(s)
      Nakamura N
    • Organizer
      The 2021 Chonnam National University Dental Hospital International Symposium
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Secondary correction of cleft lip nose deformity -Surgical strategy and three-dimensional results-2021

    • Author(s)
      Nakamura N
    • Organizer
      Japan-Korea Joint Symposium in The 66th Annual Meeting of Japanese Association of Oral and Maxillofacial Surgery
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A method for evaluating of asymmetry on cleft lip using symmetry plane2021

    • Author(s)
      Sawada S, Kamiya T, Kimura-Nomoto N, Okawachi T, Nozoe E, Nakamura N
    • Organizer
      The 21st International Conference on Control, Automation and Systems
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 唇口蓋裂患者の標準的外貌評価法の概要 -Japancleftとして-2021

    • Author(s)
      土佐泰祥, 杠 俊介, 小林眞司, 木村得尚, 奥本隆行, 三古谷 忠, 児玉泰光, 中村典史, 田中宗一, 渕上貴央
    • Organizer
      第45回日本口蓋裂学会総会・学術集会 シンポジウム3「Japancleftについて考える-活動の現況と今後-」
    • Related Report
      2021 Annual Research Report
  • [Presentation] 片側性唇顎口蓋裂の顎裂部へのOCP/Collagen移植術の長期観察2021

    • Author(s)
      中村典史
    • Organizer
      第66回日本口腔外科学会総会・学術集会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 口蓋化構音の再分類の試み -聴覚的判定とNeural Networkによる音声分析の比較2021

    • Author(s)
      上栗裕平, 手塚征宏, 小倉道広, 渕上貴央, 岐部俊郎, 中村典史
    • Organizer
      第45回日本口蓋裂学会総会・学術集会
    • Related Report
      2021 Annual Research Report 2020 Annual Research Report
  • [Presentation] Furlow法術後の鼻咽腔閉鎖機能不全に対し口蓋弁後方移動術を施行した1例2021

    • Author(s)
      椎木彩乃, 手塚征宏, 上栗裕平, 岐部俊郎, Mohammad Farid Ratman, 中村典史
    • Organizer
      第89回日本口腔外科学会九州支部学術集会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 当科における口唇裂・口蓋裂患者の手術内容に関する15年間の臨床統計的検討2021

    • Author(s)
      佐井新一, 岐部俊郎, 手塚征宏, 大河内孝子, 石畑清秀, 野元菜美子, 上栗裕平, 椎木彩乃, 野添悦郎, 中村典史
    • Organizer
      第66回日本口腔外科学会総会・学術大会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 当科の口蓋裂手術の工夫と言語の『見える化』の取り組み2020

    • Author(s)
      手塚征宏, 上栗裕平, 坂田 聰, 上田裕市, 中村典史
    • Organizer
      第65回日本口腔外科学会総会・学術集会
    • Related Report
      2020 Annual Research Report
  • [Presentation] 当科における口蓋裂術後の4歳時言語成績2020

    • Author(s)
      上栗裕平, 手塚征宏, 渕上貴央, 岐部俊郎, 松永和秀, 西原一秀, 中村典史
    • Organizer
      第44回日本口蓋裂学会総会・学術集会
    • Related Report
      2020 Annual Research Report

URL: 

Published: 2020-04-28   Modified: 2024-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi