• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

On the Development of Real Time Lip Reading System for Word Recognition in Noisy Circumstances

Research Project

Project/Area Number 12650427
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Measurement engineering
Research InstitutionTottori University

Principal Investigator

SUGAHARA Kazunori  Tottori University, Faculty of Engineering, Associate Professor, 工学部・電気電子工学科, 助教授 (90149948)

Co-Investigator(Kenkyū-buntansha) KONISHI Ryosuke  Tottori University, Faculty of Engineering, Professor, 工学部・電気電子工学科, 教授 (00032269)
Project Period (FY) 2000 – 2001
Project Status Completed (Fiscal Year 2001)
Budget Amount *help
¥3,400,000 (Direct Cost: ¥3,400,000)
Fiscal Year 2001: ¥1,200,000 (Direct Cost: ¥1,200,000)
Fiscal Year 2000: ¥2,200,000 (Direct Cost: ¥2,200,000)
KeywordsLip Reading / Word Recognition / Noisy Circumstance / FPGA / 音声認識 / 唇形状の時間変化 / 動的輪郭モデル / 隠れマルニフモデル / 隠れマルコフモデル
Research Abstract

Robotic technology had been developed to provide substitution of simple human operations. However, the importance of assistant behavior according to the human commands instead of the stand-alone behavior has been recognized in recent years. In such cases, a variety of communication methods between human and robots can be considered. The word recognition technique had been developed in several researchers and in calm situation it can be used for practical use. But in noisy circumstances, they are not still applicable and have a number of problems to solve. For word recognition method in noisy circumstances, the lip reading method is investigated in our research. The lip reading method does not require the additional training to utilize it.
In this research, the video images of human speaking are input to the system and the lip shape movements are automatically extracted to provide word recognition parameters. For these automatic extractions of lip shapes of the NTSC video signal rate are realized by hardware realization of the active contour model techniques. For future works, the development of the lip area separation technique from complex background is remained.

Report

(3 results)
  • 2001 Annual Research Report   Final Research Report Summary
  • 2000 Annual Research Report
  • Research Products

    (15 results)

All Other

All Publications (15 results)

  • [Publications] 菅原一孔: "パーソナルコンピュータ上での読唇システムの実時間実現"計測自動制御学会論文誌. 36・12. 1145-1151 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Kazunori SUGAHARA: "Personal Computer Based Real Time Lip Reading System"2000 5th.Int.Conf. Signal Processing. 1341-1346 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 菅原一孔: "画像情報を取り入れた単語認識システムの実時間実現"電子情報通信学会技術研究報告. PRMU99-269. 57-63 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 垣田直士: "色情報による唇領域の抽出について"電子情報通信学会技術研究報告. DSP2001-83. 17-22 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 鷲尾昌宣: "動画像処理を目指した動的輪郭モデルのハードウェア化について"電子情報通信学会技術研究報告. DSP2001-83. 23-30 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Kazunori SUGAHARA, Toshimi SHINCHI, Makoto KISHINO, Ryosuke, KONISHI: "Real time Realization of Lip Reading System on the Personal Computer"Transactions of information processing society of Japan. Vol. 36, No. 12. 1145-1151 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Kazunori SUGAHARA, Makoto KISHINO, Ryosuke KONISHI: "Personal Computer Based Real Time Lip Reading System"Proceedings of 5th International Conference on Signal Processing Proceedings. 1341-1346 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Kazunori SUGAHARA, Masanobu WASHIO, Makoto KISHINO, Ryosuke KONISHI: "Real time realization of word recognition system based on voice and lip movement information"Technical report of the institute of electronics, information and communication engineers. Vol. PRMU99-269. 57-63 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Naoshi KAKITA, Kazunori SUGAHARA, Ryosuke KONISHI: "On the Lip Area Extraction Method based on the Color Information"Technical report of the institute of electronics, information and communication engineers. Vol. DSP2001-83. 17-22 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Masanobu WASHIO, Yasuo ANNO, Kazunori SUGAHARA, Ryosuke KONISHI: "Hardware Realization of Active Contour Model for Real Time Video Image Processing"Technical report of the institute of electronics, information and communication engineers. Vol. DSP2001-83. 23-30 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 垣田直士: "色情報による唇領域の抽出について"電子情報通信学会技術研究報告. DSP2001-83. 17-22 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 鷲尾昌宣: "動画像処理を目指した動的輪郭モデルのハードウェア化について"電子情報通信学会技術研究報告. DSP2001-83. 23-30 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 菅原一孔: "パーソナルコンピュータ上での読唇システムの実時間実現"計測自動制御学会論文誌. 36. 1145-1151 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] Kazunori SUGAHARA: "Personal Computer Based Real Time Lip Reading System"2000 5th.Int.Conf.Signal Processing. 1341-1346 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 菅原一孔: "画像情報を取り入れた単語認識システムの実時間実現"電子情報通信学会技術研究報告. PRMU-269. 57-63 (2000)

    • Related Report
      2000 Annual Research Report

URL: 

Published: 2000-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi