• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of human machine interface by using lip reading technique in noisy circumstances

Research Project

Project/Area Number 15500070
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Media informatics/Database
Research InstitutionNational University Corporation Tottori University

Principal Investigator

SUGAHARA Kazunori  Tottori University, Dept.of Engineering, Professor, 工学部, 教授 (90149948)

Co-Investigator(Kenkyū-buntansha) KONISHI Ryosuke  Tottori University, Dept.of Engineering, Professor, 工学部, 教授 (00032269)
KAWAMURA Takao  Tottori University, Dept.of Engineering, Associate Professor, 工学部, 助教授 (10263485)
Project Period (FY) 2003 – 2004
Project Status Completed (Fiscal Year 2004)
Budget Amount *help
¥3,500,000 (Direct Cost: ¥3,500,000)
Fiscal Year 2004: ¥1,600,000 (Direct Cost: ¥1,600,000)
Fiscal Year 2003: ¥1,900,000 (Direct Cost: ¥1,900,000)
Keywordslip reading system / human-machine interface / active contour model / real time video processing
Research Abstract

The importance of assistant behavior according to the human commands instead of the stand-alone behavior has been recognized in recent years. In such cases, communication methods between human and robots should be considered. The word recognition technique had been developed in several researchers and in calm situation it can be used for practical use. But in noisy circumstances, they are not still applicable and have a number of problems to solve. For word recognition method in noisy circumstances, the lip reading method is investigated in our research. By the lip reading method, additional trainings of user are not required to control robots.
In this research, the video images of human speaking are input to the system and the lip shape movements are automatically extracted to provide word recognition parameters. For these automatic extractions of lip shapes of the NTSC video signal rate are realized by hardware realization of the active contour model techniques. For future works, the development of the lip area separation technique from complex background is remained.

Report

(3 results)
  • 2004 Annual Research Report   Final Research Report Summary
  • 2003 Annual Research Report
  • Research Products

    (17 results)

All 2005 2004 2003 Other

All Journal Article (14 results) Publications (3 results)

  • [Journal Article] 動的輪郭モデルのハードウエア化とその読唇母音認識への応用2005

    • Author(s)
      佐々木 悠介
    • Journal Title

      電子情報通信学会技術報告 Vol.104

      Pages: 13-17

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] Hardware realization of active contour model and its application for word recognition by lip reading2005

    • Author(s)
      Yuusuke SASAKI, Takao KAWAMURA, Kazunori SUGAHARA
    • Journal Title

      Technical report of the institute of electronics, information and communication engineers vol.104

      Pages: 13-17

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] 顔領域特定アルゴリズムのハードウェア上への実現について2004

    • Author(s)
      山本 貴彦
    • Journal Title

      電気学会 情報システム研究会資料 IS-04-26

      Pages: 25-30

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Lip Shape Extraction for Word Recognition by Using Hardware Active Contour Model2004

    • Author(s)
      Yuusuke Sasaki
    • Journal Title

      Proceedings of the 2004 International Symposium on Intelligent Multimedia, Video & Speech Processing

      Pages: 370-373

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] ハードウエア実現した動的輪郭モデルによる唇の外側および内側の形状抽出について2004

    • Author(s)
      佐々木 悠介
    • Journal Title

      電子情報通信学会技術報告 (CD-ROM)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] 動的輪郭モデルによる唇形状抽出と単語認識のハードウエア実現について2004

    • Author(s)
      佐々木 悠介
    • Journal Title

      第6回IEEE広島支部学生シンポジウム論文集

      Pages: 171-174

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] Realization of a Face Area Extraction Algorithm in Hardware System2004

    • Author(s)
      Takahiko YAMAMOTO, Takao KAWAMURA, Kazunori SUGAHARA
    • Journal Title

      Proceedings of the 15-th IEE Information System Technical reports

      Pages: 25-30

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Lip Shape Extraction for Word Recognition by Using Hardware Active Contour Model2004

    • Author(s)
      Yuusuke SASAKI, Takao KAWAMURA, Kazunori SUGAHARA
    • Journal Title

      Proceedings of the 2004 International Symposium on Intelligent Multimedia, Video & Speech Processing

      Pages: 370-373

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Inner and Outer Lip Shape Extraction by using Hardware Active Contour Model2004

    • Author(s)
      Yuusuke SASAKI, Takao KAWAMURA, Kazunori SUGAHARA
    • Journal Title

      Technical report of the institute of electronics, information and communication engineers (CD-ROM)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Lip shape extraction by using active contour model and its application for word recognition2004

    • Author(s)
      Yuusuke SASAKI, Takao KAWAMURA, Kazunori SUGAHARA
    • Journal Title

      Proceedings of the 2003 IEEE HISS Symposium

      Pages: 171-174

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] 動的輪郭モデルのハードウエア化と唇形状週出への応用について2003

    • Author(s)
      佐々木 悠介
    • Journal Title

      IEEE HISSシンポジュウム論文集

      Pages: 211-212

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] ハードウエア実現された顔領域特定アルゴリズムについて2003

    • Author(s)
      山本 貴彦
    • Journal Title

      IEEE HISSシンポジュウム論文集

      Pages: 213-214

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Hardware realization of active contour model and its application for lip shape extraction2003

    • Author(s)
      Yuusuke SASAKI, Takahiko YAMAMOTO, Takao KAWAMURA, Kazunori SUGAHARA
    • Journal Title

      Proceedings of the 2003 IEEE HISS Symposium

      Pages: 211-212

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Hardware realization of a face area extraction algorithm2003

    • Author(s)
      Takahiko YAMAMOTO, Yuusuke SASAKI, Takao KAWAMURA, Kazunori SUGAHARA
    • Journal Title

      Proceedings of the 2003 IEEE HISS Symposium

      Pages: 213-214

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Publications] 佐々木 悠介: "動的輪郭モデルのハードウエア化と唇形状抽出への応用について"IEEE HISSシンポジュウム論文集. 211-212 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 山本 貴彦: "ハードウエア実現された顔領域特定アルゴリズムについて"IEEE HISSシンポジュウム論文集. 213-214 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 山本 貴彦: "ハードウエア実現された顔領域特定アルゴリズムについて"電気学会情報システム研究会資料. IS-04-26. 25-30 (2004)

    • Related Report
      2003 Annual Research Report

URL: 

Published: 2003-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi