• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Developping a system for dialog support to the hard of hearing via speech recognition and character display

Research Project

Project/Area Number 18500127
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Perception information processing/Intelligent robotics
Research InstitutionKanazawa University

Principal Investigator

FUNADA Tetsuo  Kanazawa University, Graduate School of Natural Science and Technology, Professor (40019766)

Co-Investigator(Kenkyū-buntansha) NOMURA Hideyuki  Kanazawa University, Graduate School of Natural Science and Technology, Assistant Professor (90334763)
Project Period (FY) 2006 – 2007
Project Status Completed (Fiscal Year 2007)
Budget Amount *help
¥1,280,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥180,000)
Fiscal Year 2007: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2006: ¥500,000 (Direct Cost: ¥500,000)
Keywordsthe hard of hearing / dialog support system / speech recognition / noisy environment / reliability
Research Abstract

This research is to develop a dialog support system for persons such as age-related hearing loss via speech recognition and character display. For this purpose, the system is expected to be small and light. At the beginning of this research, we intended to design the system with combining custom ISI and micro-displays. However since mobile computers with a built-in microphone recently have come onto the market, we changed to implement the system on a mobile computer.
At the beginning in 2006, the system was designed to recognize only the pre-registered words, so it shows inconvenience that unregistered words cannot be recognized. Therefore, we improved the system by making it recognize all Japanese 101 syllables (kana). In this case, dialog partner has to speak syllable by syllable and the system display the recognized syllables one after another. It has also inconvenience that the system can display contents of dining by a sequence of only kana character so difficult to read fir the haul of hearing.
In 2007, we improved the system in the following three points. The first is to decrease recognition error by incorporating new algorithm to extract noise-robust speech feature proposed by us. The second is to incorporate the "kana to Chinese character conversion" in the system, the command of which is also ordered by speech The third is to make the system display the ascend candidate of recognition, and can select the second one in case of mis-recognition of the first candidate. This selection command is also acceptable by speech. By making the system be possible to operate only by speech command, it has become convenient to use.
Further improvement is desired in recognition speed and recognition error.
Parts of these results have been presented at technical committee on speech of Acoustic Society of Japan and the Institute of Electronics, Intimation and Communication Engineers, and International Workshop on Communication and Information Technologies (ICSIT07).

Report

(3 results)
  • 2007 Annual Research Report   Final Research Report Summary
  • 2006 Annual Research Report
  • Research Products

    (14 results)

All 2007 2006

All Journal Article (3 results) Presentation (11 results)

  • [Journal Article] スペクトル傾斜の3値化に基づく特徴量を用いた雑音下単語認識システム2007

    • Author(s)
      梅野 恵
    • Journal Title

      日本音響学会研究発表会講演論文集 2007春季(CD-ROM)

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 信頼性を考慮した孤立発声単音節認識システム2007

    • Author(s)
      黒田 弥文
    • Journal Title

      日本音響学会研究発表会講演論文集 (CD-ROM)

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 短時間パワースペクトルの時間・周波数傾斜の3値化に基づく音声特徴量を用いた音声認識2006

    • Author(s)
      梅野 恵
    • Journal Title

      電子情報通信学会音声研究会技術研究報告 SP2006-31

      Pages: 25-30

    • Related Report
      2006 Annual Research Report
  • [Presentation] Noisy Word Recognition Using a Feature Based on Ternarized Spectral Slope2007

    • Author(s)
      Megumi Umeno
    • Organizer
      International Symposium on Communications and Information Technologies(ISCIT07)
    • Place of Presentation
      Sydney
    • Year and Date
      2007-10-17
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Noisy word recognition using a feature based on ternarized spectral slope2007

    • Author(s)
      Megumi, Umeno
    • Organizer
      International Symposium on Communications and Information Technologies (ISCIT07)
    • Place of Presentation
      Sydney
    • Year and Date
      2007-10-17
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Noisy Word Recognition Using a Feature Based on Ternarized Spectral Slope2007

    • Author(s)
      Tetsuo Funada
    • Organizer
      International Symposium on Communications and Information Technologries(ISCIT07)
    • Place of Presentation
      Sydney
    • Year and Date
      2007-10-17
    • Related Report
      2007 Annual Research Report
  • [Presentation] 単語音声認識における時間変化を表現する特徴量の耐雑音性について2007

    • Author(s)
      船田 哲男
    • Organizer
      電子情報通信学会 音声研究会
    • Place of Presentation
      富山
    • Year and Date
      2007-07-27
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] On noise robustness of feature expressing temporal variation for word speech recognition2007

    • Author(s)
      Tetsuo, Funada
    • Organizer
      The Institute of Electronics, Information and Communication Engineers, Technical Committee of Speech
    • Place of Presentation
      Toyama
    • Year and Date
      2007-07-27
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] 単語音声認識における時間変化を表現する特徴量の耐雑音性について2007

    • Author(s)
      船田 哲男
    • Organizer
      電子情報通信学会音声研究会
    • Place of Presentation
      富山
    • Year and Date
      2007-07-27
    • Related Report
      2007 Annual Research Report
  • [Presentation] 音声認識のためのスペクトルの時間変化を表す特徴量抽出についての検討2007

    • Author(s)
      梅野 恵
    • Organizer
      電子情報通信学会 音声研究会
    • Place of Presentation
      京都
    • Year and Date
      2007-05-31
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] A consideration on extracting temporal feature of Spectrum for speech recognition2007

    • Author(s)
      Megumi, Umeno
    • Organizer
      The Institute of Electronics, Information and Communication Engineers, Technical Committee of Speech
    • Place of Presentation
      Kyoto
    • Year and Date
      2007-05-31
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] 音声認識のためのスペクトルの時間変化を表す特徴量抽出についての検討2007

    • Author(s)
      船田 哲男
    • Organizer
      電子情報通信学会音声研究会
    • Place of Presentation
      京都
    • Year and Date
      2007-05-31
    • Related Report
      2007 Annual Research Report
  • [Presentation] 信頼性を考慮した孤立発声単音節認識システム2007

    • Author(s)
      黒田 弥文
    • Organizer
      日本音響学会 春季研究発表会
    • Place of Presentation
      東京
    • Year and Date
      2007-03-13
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Isolated syllable recognition system considering a confidence measure2007

    • Author(s)
      Hirofumi, Kuroda
    • Organizer
      Spring Meeting, Acoustical Society of Japan
    • Place of Presentation
      Tokyo
    • Year and Date
      2007-03-13
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary

URL: 

Published: 2006-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi