Research and Development of a Novel Phonic Diagnostic System with AI Technologies

• Project/Area Number: 18K18407
• Research Category: Grant-in-Aid for Early-Career Scientists
• Allocation Type: Multi-year Fund
• Review Section: Basic Section 90130:Medical systems-related
• Research Institution: Tenri Health Care University
• Principal Investigator: KOJIMA TSUYOSHI 天理医療大学, 医療学部, 特別研究員 (60767698)
• Project Period (FY): 2018-04-01 – 2021-03-31
• Project Status: Completed (Fiscal Year 2020)
• Budget Amount: ¥4,030,000 (Direct Cost: ¥3,100,000、Indirect Cost: ¥930,000); Fiscal Year 2020: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000); Fiscal Year 2019: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000); Fiscal Year 2018: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
• Keywords: 音声障害 / 人工知能 / アプリ / スマートデバイス / GRBAS尺度 / AI / iPhoneアプリ / ディープラーニング / GRBAS / 遠隔診療

Outline of Final Research Achievements

We researched to determine the GRBAS scale, classifying voice disorders into four levels based on auditory impressions, using artificial intelligence (AI). Based on this research, we conducted a study to identify characteristic voice disorders (vocal fold paralysis, supraglottic stenosis, spasmodic dysphonia, etc.) using AI. We have also created and released an iPhone application that uses AI to determine the GRBAS scale for easy use in actual clinical practice. As more data becomes available, it will be possible to create a higher-performance AI, so we have started to consolidate voice and medical data at several collaborating research institutes after standardizing the voice recordings and recording methods.

Academic Significance and Societal Importance of the Research Achievements

本研究ではAIで音声の質を評価できることを示したが、これは熟練した医師や言語聴覚士のようにもしくはそれ以上に音声から診断及び障害の客観的・定量的な評価ができる可能性を示す学術的意義があるものであった。またAIを用いた研究成果をスマートデバイスで使用可能とし、実際に臨床でAIによる音声障害の評価・診断支援を手軽に活かしていくためのための道筋をつけ、検診や救急、地域医療等への幅広い応用の可能性がひろがる社会的意義のある研究となった。

Research Products

• [Journal Article] A new iPhone application for voice quality assessment based on the GRBAS scale. (2020)
  • Author(s): Kojima Tsuyoshi、Hasebe Koki、Fujimura Shintaro、Okanoue Yusuke、Kagoshima Hiroki、Taguchi Atsushi、Yamamoto Hirotaka、Shoji Kazuhiko、Hori Ryusuke
  • Journal Title: The Laryngoscope Volume: 131 Issue: 3 Pages: 580-582
  • DOI: 10.1002/lary.28796
  • Peer Reviewed
• [Journal Article] Classification of Voice Disorders Using a One-Dimensional Convolutional Neural Network (2020)
  • Author(s): Fujimura Shintaro、Kojima Tsuyoshi、Okanoue Yusuke、Shoji Kazuhiko、Inoue Masato、Omori Koichi、Hori Ryusuke
  • Journal Title: Journal of Voice Volume: なし Issue: 1 Pages: 15-20
  • DOI: 10.1016/j.jvoice.2020.02.009
  • Peer Reviewed
• [Journal Article] Real-Time Acoustic Voice Analysis Using a Handheld Device Running Android Operating System (2020)
  • Author(s): Fujimura Shintaro、Kojima Tsuyoshi、Okanoue Yusuke、Kagoshima Hiroki、Taguchi Atsushi、Shoji Kazuhiko、Inoue Masato、Hori Ryusuke
  • Journal Title: Journal of Voice Volume: 34 Issue: 6 Pages: 823-829
  • DOI: 10.1016/j.jvoice.2019.05.013
  • Peer Reviewed
• [Journal Article] Discrimination of "hot potato voice" caused by upper airway obstruction utilizing a support vector machine. (2018)
  • Author(s): 3.Fujimura S, Kojima T, Okanoue Y, Shoji K, Inoue M, Hori R.
  • Journal Title: Laryngoscope Volume: 28 Issue: 6 Pages: 1301-1307
  • DOI: 10.1002/lary.27584
  • Peer Reviewed
• [Journal Article] An innovative voice analyzer ‘VA’ smart phone program for quantitative analysis of voice quality. (2018)
  • Author(s): 4.Kojima T, Fujimura S, Hori R, Okanoue Y, Shoji K, Inoue M.
  • Journal Title: Journal of Voice Volume: 22 Issue: 5 Pages: 642-648
  • DOI: 10.1016/j.jvoice.2018.01.026
  • Peer Reviewed
• [Presentation] シンポジウム「咽頭喉頭・音声科学の進歩」 音声AI診断． (2021)
  • Author(s): 児嶋剛，長谷部孝毅，堀龍介，藤村真太郎
  • Organizer: 第122回日本耳鼻咽喉科学会総会・学術講演会
  • Invited
• [Presentation] 共催セミナー 音声の客観的評価のすすめ． (2021)
  • Author(s): 児嶋剛，堀龍介
  • Organizer: 第122回日本耳鼻咽喉科学会総会・学術講演会
• [Presentation] Objective Assessment of Pathological Voice Using the GRBAS Scale with Artificial Intelligence. (2021)
  • Author(s): Kojima T, Hasebe K, Fujimura S, Okanoue Y, Otsuki S, Yamamoto T, Yuki R, Hori R.
  • Organizer: The 142nd American Laryngological Association (ALA) at ALA/COSM VIRTUAL Meeting
• [Presentation] iPhoneアプリによるGRBAS尺度を用いた病的音声の客観的評価． (2020)
  • Author(s): 児嶋剛，岡上雄介，鹿子島大貴，田口敦士，長谷部孝毅，山本浩孝，庄司和彦，堀龍介
  • Organizer: 第82回耳鼻臨床学会学術講演会
• [Presentation] GRBASスケールに基づいた音声障害評価のためのiPhoneアプリの開発． (2020)
  • Author(s): 児嶋剛，長谷部孝毅，藤村真太郎，堀龍介
  • Organizer: 第65回音声言語医学会
• [Presentation] 深層学習を用いた音声障害の解析． (2020)
  • Author(s): 藤村真太郎，児嶋剛，堀龍介，大森孝一
  • Organizer: 第65回音声言語医学会
• [Presentation] パネルディスカッション「多様な医師像を目指そう！」＜スマホ世代における新たな発想 アプリ診断が医療を動かす＞新しい耳鼻咽喉科診療の夜明け． (2020)
  • Author(s): 長谷部孝毅，児嶋剛，堀龍介
  • Organizer: 第110回日本耳鼻咽喉科学会総会・学術講演会
  • Invited
• [Presentation] Deep Neural Network Models for Discrimination of The Cause of Voice Disorders. (2020)
  • Author(s): Fujimura S, Kojima T, Hori R, Omori K.
  • Organizer: The 141st Annual Meeting of the American Laryngological Association (ALA) at COSM (COSM Virtual Poster Session)
• [Presentation] The Developing of a New iPhone App for Voice Quality Assessment Based on the GRBAS. (2020)
  • Author(s): Kojima T, Hasebe K, Fujimura S, Okanoue Y, Hori R.
  • Organizer: The 141st Annual Meeting of the American Laryngological Association (ALA) at COSM (COSM Virtual Poster Session)
• [Presentation] The developing of a new iPhone App for Voice quality assessment based on the GRBAS Scale (2020)
  • Author(s): Tsuyoshi Kojima, MD, PhD Koki Hasebe, MD Shintaro Fujimura, MD Yusuke Okanoue, MD Hiroki Kagoshima, MD Atsushi Taguchi, MD Hirotaka Yamamoto, MD Ryusuke Hori, MD, PhD
  • Organizer: The 141th Annual Meeting of the American Laryngological Association (ALA) with the Combined Otolaryngological Spring Meetings (COSM)
  • Int'l Joint Research
• [Presentation] Thyroplasty with real-time acoustic analysis. (2019)
  • Author(s): Kojima T, Hori R, Okanoue Y, Fujimura S, Kagoshima H, Taguchi A, Inoue M, Shoji K.
  • Organizer: The 140th Annual Meeting of the American Laryngological Association (ALA) with the Combined Otolaryngological Spring Meetings (COSM)
  • Int'l Joint Research
• [Presentation] Thyroplasty with real-time acoustic analysis. (2019)
  • Author(s): Kojima T, Hori R, Okanoue Y, Fujimura S, Kagoshima H, Atsushi T, Inoue M, Shoji K
  • Organizer: The 140th Annual Meeting of the American Laryngological Association (ALA) with the Combined Otolaryngological Spring Meetings (COSM)
  • Int'l Joint Research
• [Presentation] 深層学習による音声障害の病態評価 (2018)
  • Author(s): 藤村真太郎，児嶋剛
  • Organizer: 第63回日本音声言語医学会総会・学術講演会
• [Presentation] 当院の音声治療の取り組み (2018)
  • Author(s): 田中良，児嶋剛，藤村真太郎
  • Organizer: 第63回日本音声言語医学会総会・学術講演会
• [Presentation] Discrimination of "hot potato voice" Using Machine Learning with Vocal Tract Model and Articulatory Speech Synthesizer (2018)
  • Author(s): Kojima T, Fujimura S, Hori R, Okanoue Y, Oyagi S, Kagoshima H, Shoji, Inoue M
  • Organizer: ABEA's 98th Annual Meeting in conjunction with COSM
  • Int'l Joint Research
• [Presentation] CLASSIFICATION OF VOICE DISORDERS USING DEEP LEARNING MODELS (2018)
  • Author(s): Fujimura S, Kojima T, Hori R, Okanoue Y, Oyagi S, Kagoshima H, Shoji, Inoue M
  • Organizer: The 139th Annual meeting of the American Laryngological Association in conjunction with COSM
  • Int'l Joint Research