• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

DEVELOPMENT OF THE SPEECH TRAINING SOFTWARE FOR HEARING IMPAIRED CHILDREN USING THE NETWORK ENVIRONMENT

Research Project

Project/Area Number 11680229
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Educational technology
Research InstitutionCHUBU UNIVERSITY

Principal Investigator

UMEZAKI Taizo  CHUBU UNIVERSITY, ENGINEERING, PROFESSOR, 工学部, 教授 (40193932)

Project Period (FY) 1999 – 2001
Project Status Completed (Fiscal Year 2001)
Budget Amount *help
¥3,200,000 (Direct Cost: ¥3,200,000)
Fiscal Year 2001: ¥500,000 (Direct Cost: ¥500,000)
Fiscal Year 2000: ¥1,100,000 (Direct Cost: ¥1,100,000)
Fiscal Year 1999: ¥1,600,000 (Direct Cost: ¥1,600,000)
KeywordsSPEECH TRAINING / HEARING IMPAIRED CHILDREN / INTERNET EDUCATION / LIP READING / DEAF / HIDDEN MARKOV MODEL / UTTERANCE EXPRESSION / KOHONEN NEURAL NETWORKS / ゲームランド / ハイブリッド型 / 通信教育 / Open GL / DPマッチング / 発語訓練 / 子音認識 / 単語訓練 / ニューラルネットワーク
Research Abstract

Our (Umezaki Lab) research result of 3 years is as follows.
The recognition system of the hybrid type to have integrated three kinds of recognition methods (DP matching, hidden Markov model, artificial neural networks) was developed. With this, the recognition rate of the consonant improved so far more.
We developed the utterance training software of the three dimensional version which can be trained in the game sense using the Open GL library. An intellectual training element is incorporated into this software. The title of the software includes the trapshooting and meteorite collision (shooting game), the firework (fantasy game) and so on.
We added the following feature to the Internet education system, 1)the data management feature to record a training result, 2)the communication feature that the accumulated training result accumulates to the server through the internet, 3)the report feature to guide the following training based on the training result which, was accumulated by the server.
We developed the lip reading training software which can be built with the small-scale database. In this software, we don' t need complicated rule setting. In this software, the image which was produced by the speech synthesis library and the Kohonen-type neural networks is used. The synthesized image which is near the video image is generated by this. The children can train lip reading alone at the house.
We are distributing the CD-ROM of the developed software for free. At present, it is already used, in about 60 relation organizations such as the school for the deaf under Aichi Prefecture. Especially, the teachers at the Chikusa and Okazaki schools for the deaf cooperated aggressively.

Report

(4 results)
  • 2001 Annual Research Report   Final Research Report Summary
  • 2000 Annual Research Report
  • 1999 Annual Research Report
  • Research Products

    (27 results)

All Other

All Publications (27 results)

  • [Publications] 梅崎太造, 平野崇, 佐藤幸男: "3次元顔表情の自動生成"電気学会論文誌. Vol.121-C,2. 47-422 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 梅崎太造, 間瀬寛子, 江川敦史: "ゲーム性を取り入れた聴覚障害児用発話訓練ソフトウェアの開発"日本福祉工学会誌. Vol.2. 31-36 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 木村成宏, 佐藤省三, 梅崎太造: "発話表情の自動生成"電子情報通信学会,信学技報. PRMU2001-39. 1-8 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 近田智洋, 高橋久, 梅崎太造: "聴覚障害児用発話訓練システム"電子情報通信学会,信学技報. WIT00-4. 17-22 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 木村成宏, 梅崎太造, 佐藤省三: "母音同期に基づく発話表情画像の自動生成"電気関係学会,東海支部連合大会,講論集. 505. 253 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 猪又信義, 梅崎太造, 田中泰史: "3D版発話訓練ソフトウェアの開発"電気関係学会,東海支部連合大会,講論集. 506. 253 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] TAIZO UMEZAKI, TAKESHI HIRANO, YUKIO SATO: "AUTOMATIC SYNTHESIS OF 3-D FACIAL EXPRESSION"TRANSACTIONS OF THE INSTITUTE OF ELECTRICAL ENGINEERS OF JAPAN. VOL.121-C,2. 417-422 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] TAIZO UMEZAKI, HIROKO MASE, ATSUSHI EGAWA: "DEVELOPMENT OF SPEECH TRAINING SOFTWARE FOR HEARING IMPAIRED CHILDREN WHICH INTRODUCED A GAME"THE JOURNAL OF THE JAPAN SOCIETY FOR WELFARE ENGINEERING. VOL.2. 31-36 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] NARUHIRO KIMURA, SYOZO SATO, TAIZO UMEZAKI: "AUTOMATIC SYNTHESIS OF FACIAL EXPRESSION IN SPEECH"THE INSTITUTE OF ELECTRONICS, INFORMATION AND COMMUNICATION ENGINEERS, TECHNICAL REPORT. PRMU2001-39. 1-8 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] TOMOHIRO KONDA, HISASHI TAKAHASHI, TAIZO UMEZAKI: "THE PRONUNCIATION TRAINING SYSTEM FOR AURALLY IMPAIRED CHILDREN"THE INSTITUTE OF ELECTRONICS, INFORMATION AND COMMUNICATION ENGINEERS, TECHNICAL REPORT. WIT00-4. 17-22 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] NARUHIRO KIMURA, TAIZO UMEZAKI, SYOZO SATO: "AUTOMATIC SYNTHESIS OF FACIAL EXPRESSION WITH SPEECHING BASED ON VOWEL SECTION SYNCHRONIZATION"THE INSTITUTES OF ELECTRICAL AND RELATED ENGINEERS, TOKAI-SECTION JOINT CONFERENCE. 505. 253 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] NOBUYOSHI INOMATA, TAIZO UMEZAKI, YASUSHI TANAKA: "DEVELOPMENT OF SPEECH TRAINING SOFTWARE USING 3-D"THE INSTITUTES OF ELECTRICAL AND RELATED ENGINEERS, TOKAI-SECTION JOINT CONFERENCE. 506. 53 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 木村成宏, 佐藤省三, 梅崎太造: "発話表情の自動生成"電子情報通信学会, 信学技報. PRMU2001-39. 1-8 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 丹羽英之, 内藤正紀, 梅崎太造, 佐藤省三: "歩行訓練機能を持つ福祉ロボット"日本ME学会東海支部学術集会. 10. 19 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 木村成宏, 梅崎太造, 佐藤省三: "母音同期に基づく発話表情画像の自動生成"電気関係学会, 東海支部連合大会, 講論集. 505. 253 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 猪又信義, 梅崎太造, 田中泰史: "3D版発話訓練ソフトウェアの開発"電気関係学会, 東海支部連合大会, 講論集. 506. 253 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 丹羽英之, 内藤正紀, 梅崎太造, 佐藤省三: "歩行リハビリテーション用福祉ロボットの開発"電気関係学会, 東海支部連合大会, 講論集. 715. 358 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 梅崎太造,間瀬寛子,江川敦史: "ゲーム性を取り入れた聴覚障害児用発話訓練ソフトウェアの開発"日本福祉工学会誌. 2. 31-36 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 梅崎太造,平野崇,佐藤幸男: "3次元顔表情の自動生成"電気学会論文誌. 121-C,2. 417-422 (2001)

    • Related Report
      2000 Annual Research Report
  • [Publications] 木村成宏,梅崎太造: "発話時における口形状動画像の自動生成"電気関係学会東海支部連合大会講演論文集. 701. 351 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 近田智洋,高橋久,梅崎太造: "聴覚障害児用発話訓練システム"電子情報通信学会,第2種研究会資料. WIT00-4. 17-22 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] T.Konda,M.Yoshimura,T.Umezaki,I.Yoshimura: "An off-line signature verification method based on a hidden Markov model using column images as features"Biennial Conference of the International Graphonomics Society. 79-82 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 平野崇、梅崎太造、佐藤幸男: "三次元顔表情の自動生成"電子情報通信学会、信学技報. PRMU99-135. 13-20 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 江川敦史、梅崎太造: ""フー"のセンシングとその訓練ソフトウェア開発"電気関係学会、東海支部連合大会講論集. 524. 262 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 平野崇、梅崎太造、佐藤幸男: "三次元顔表情の自動作成"電気関係学会、東海支部連合大会講論集. 714. 357 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 加藤幸男、梅崎太造: "ケアサービスを目的とした自律走行ロボットの開発"日本福祉工学会、学術講演論文集. 108. 27-28 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 間瀬寛子、江川敦史、梅崎太造: "ゲーム性を取り入れた聴覚障害児用発話訓練ソフトウェアの開発"日本福祉工学会、学術講演論文集. 109. 29-30 (1999)

    • Related Report
      1999 Annual Research Report

URL: 

Published: 1999-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi