• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of utterance training support-equipment and lipreading assistance equipment by lip movement

Research Project

Project/Area Number 25330418
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Learning support system
Research InstitutionTokai University

Principal Investigator

Yamada Mitsuho  東海大学, 情報通信学部, 教授 (60366086)

Co-Investigator(Kenkyū-buntansha) Hoshino Yuko  東海大学, 情報通信学部情報メディア学科, 講師 (80435271)
Project Period (FY) 2013-04-01 – 2016-03-31
Project Status Completed (Fiscal Year 2015)
Budget Amount *help
¥3,770,000 (Direct Cost: ¥2,900,000、Indirect Cost: ¥870,000)
Fiscal Year 2015: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2014: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2013: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Keywords学習支援システム / 発話支援 / 口唇動作 / 発話認識 / ヒューマンインターフェイス / 発話学習 / 読唇 / 口唇動作解析 / 母音認識 / ヒューマンインタフェース
Outline of Final Research Achievements

Utterance training support-equipment by lip movement has been developed targeted for Japanese and English. First, We developed automatic extraction software for the characteristic points of the lips and we created a database of utterances by Japanese television announcers and English teachers. Utterance training of Japanese and English was performed using this equipment, and showed that the utterance ability improved. It will be possible to use this system for lipreading by improvement of the vowel utterance ability and improvement of recognition rate of utterance recognition as well as Japanese and English utterance training by an outcome of this research.

Report

(4 results)
  • 2015 Annual Research Report   Final Research Report ( PDF )
  • 2014 Research-status Report
  • 2013 Research-status Report
  • Research Products

    (16 results)

All 2016 2015 2014 Other

All Presentation (14 results) (of which Int'l Joint Research: 3 results) Remarks (2 results)

  • [Presentation] How to evaluate English pronunciation learning by lip movements2016

    • Author(s)
      Miyuki Suganuma,Tomoki Yamamura,Yuko Hoshino, Mitsuho Yamada
    • Organizer
      IMQA2016
    • Place of Presentation
      名古屋大学(愛知県名古屋市)
    • Year and Date
      2016-03-10
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 口唇動作による英語発話学習法の効果と評価2015

    • Author(s)
      菅沼美由起、山村知生、星野祐子、山田光穗
    • Organizer
      映像情報メディア学会2015冬季大会
    • Place of Presentation
      早稲田大学(東京都新宿区)
    • Year and Date
      2015-12-15
    • Related Report
      2015 Annual Research Report
  • [Presentation] 口唇動作による英語発話学習の評価法の検討2015

    • Author(s)
      菅沼美由起、山村知生、星野祐子、山田光穗
    • Organizer
      電子情報通信学会イメージメディアクオリティ研究会
    • Place of Presentation
      京都工芸繊維大学(京都府京都市)
    • Year and Date
      2015-11-27
    • Related Report
      2015 Annual Research Report
  • [Presentation] 口唇動作による日本語発話トレーニング法の練習効果2015

    • Author(s)
      山村知生、菅沼美由起、星野祐子、山田光穗
    • Organizer
      電子情報通信2015ソサイエティー大会
    • Place of Presentation
      東北大学(宮城県仙台市)
    • Year and Date
      2015-09-10
    • Related Report
      2015 Annual Research Report
  • [Presentation] 口唇動作による英語発話法の提案2015

    • Author(s)
      菅沼美由起
    • Organizer
      電子情報通信2015ソサイエティー大会
    • Place of Presentation
      東北大学
    • Year and Date
      2015-09-10
    • Related Report
      2015 Annual Research Report
  • [Presentation] The learning data management of the utterance learning system using lip movements recognition2015

    • Author(s)
      Yuko Hoshino,Tomoki Yamamura,Mitsuho Yamada
    • Organizer
      ICCAT2015
    • Place of Presentation
      くにびきメッセ(島根県松江市)
    • Year and Date
      2015-08-31
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Development of a speech training system by lip movements2015

    • Author(s)
      Tomoki Yamamura,Yuko Hoshino, Mitsuho Yamada
    • Organizer
      ICCAT2015
    • Place of Presentation
      くにびきメッセ(島根県松江市)
    • Year and Date
      2015-08-31
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 口唇動作による発話トレーニング法の評価2015

    • Author(s)
      山村知生 竹山絵美 若松英輝 星野祐子 山田光穗
    • Organizer
      電子情報通信学会2015総合大会
    • Place of Presentation
      立命館大学草津キャンパス
    • Year and Date
      2015-03-10
    • Related Report
      2014 Research-status Report
  • [Presentation] 口唇動作を用いた発話トレーニング装置の開発2014

    • Author(s)
      竹山絵美 寺尾太志 若松英輝 山田光穗
    • Organizer
      映像情報メディア学会 冬季大会
    • Place of Presentation
      東京理科大学森戸記念館
    • Year and Date
      2014-12-18
    • Related Report
      2014 Research-status Report
  • [Presentation] The Utility of the SQLite Database for An Utterance2014

    • Author(s)
      Yuko Hoshino, Eiki Wakamatsu, Mitsuho Yamada
    • Organizer
      IWCAT2014
    • Place of Presentation
      慶応大学日吉キャンパス
    • Year and Date
      2014-12-06
    • Related Report
      2014 Research-status Report
  • [Presentation] PROPOSAL FOR AN UTTERANCE TRAINING METHOD BASED ON LIP MOVEMENTS2014

    • Author(s)
      Eiki WAKAMATSU Yuko HOSHINO Mitsuho YAMADA
    • Organizer
      IMQA(Image Media Quality and Its Application) 2014
    • Place of Presentation
      千葉大学けやき会館
    • Year and Date
      2014-09-12 – 2014-09-13
    • Related Report
      2014 Research-status Report
  • [Presentation] 口唇動作を用いた発話トレーニング装置の開発2014

    • Author(s)
      若松 英輝 星野 祐子 山田 光穗
    • Organizer
      ヒューマンインターフェースシンポジウム2014
    • Place of Presentation
      京都工芸繊維大学
    • Year and Date
      2014-09-10
    • Related Report
      2014 Research-status Report
  • [Presentation] 口唇動作による発話トレーニング法の提案2014

    • Author(s)
      若松英輝
    • Organizer
      電子情報通信学会イメージ・メディア・クオリティ研究会
    • Place of Presentation
      別府コンベンションセンター
    • Related Report
      2013 Research-status Report
  • [Presentation] 口唇動作による発話トレーニング用データベースの作成2014

    • Author(s)
      若松英輝
    • Organizer
      2014電子情報通信学会総合大会
    • Place of Presentation
      新潟大学
    • Related Report
      2013 Research-status Report
  • [Remarks] 口唇動作による発話トレーニングの研究

    • URL

      http://www.yamadalab.net/UtteranceTrainingByLipMovement_JPN.htm

    • Related Report
      2015 Annual Research Report
  • [Remarks] Development of a speech training system

    • URL

      http://www.yamadalab.net/UtteranceTrainingByLipMovement_ENG.html

    • Related Report
      2015 Annual Research Report

URL: 

Published: 2014-07-25   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi