• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2014 Fiscal Year Research-status Report

ジェスチャ及び音声認識を用いたコミュニケーション能力育成教材の開発と実践評価

Research Project

Project/Area Number 25370681
Research InstitutionNational Institute of Technology, Toyama College

Principal Investigator

COOPER T・D  富山高等専門学校, 一般教養科, 准教授 (70442449)

Co-Investigator(Kenkyū-buntansha) 塚田 章  富山高等専門学校, 電子情報工学科, 教授 (40236849)
的場 隆一  富山高等専門学校, 電子情報工学科, 准教授 (30592323)
成瀬 喜則  富山高等専門学校, 国際ビジネス学科, 教授 (00249773)
Project Period (FY) 2013-04-01 – 2017-03-31
Keywordscommunication / gesture recognition / facial recognition
Outline of Annual Research Achievements

We are developing a software-based gestural [GR], facial [FR] and speech recognition [SR] system to help students perform better on English interviews and presentations.
2014
GR:The GR component was further improved to recognize basic geometric shapes allowing us to focus on facial expression detection for the coming year.
SR:Our system had a big problem that the recognition rate is very low for Japanese speaker. In this year, we adopted a sound recognition engine for the Japanese language (Julius), supporting Katakana sounds. As a result, the recognition rate was up to 80% by limiting the words.
FR: We improved the precision of facial recognition (It can identify twins who are very similar ), and published an article in a journal related the image processing and automatic recognition.

Current Status of Research Progress
Current Status of Research Progress

2: Research has progressed on the whole more than it was originally planned.

Reason

We are trying to incorporate the latest consumer technology, but also try to improve upon it and keep ahead of it. We changed our SR engine in order to create a beginner's level for Japanese high-school students.

Strategy for Future Research Activity

We will improve upon all the components of our system: GR, SR, and FR. We will also build a network system to be run by "web service" programming. Our plan is to make a better system which also focuses on the security and privacy for our data while traveling over the Internet.

Causes of Carryover

The money was to be spent on several researchers to travel overseas for a conference. A slight delay last year, coupled with the difficulties in schedule coordination led to the postponement of the excursion.

Expenditure Plan for Carryover Budget

We have had difficulties coordinating schedules among co-researchers. I also learned of my transfer to Fukui Kosen for one year, so we will postpone our plans but continue to research.

  • Research Products

    (7 results)

All 2014

All Journal Article (3 results) (of which Peer Reviewed: 3 results,  Acknowledgement Compliant: 3 results) Presentation (4 results)

  • [Journal Article] 距離画像カメラを用いた2D3D顔認証システム2014

    • Author(s)
      塚田 章,Cooper Todd
    • Journal Title

      自動認識

      Volume: 27 Pages: 30-25

    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Xtionを用いた2D3D顔認証システムについて2014

    • Author(s)
      今枝 駿,Cooper Todd,塚田 章
    • Journal Title

      第20回画像センシングシンポジウム講演論文集

      Volume: IS Pages: 2-14

    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Accent versus Mispronunciation: modifying speech recognition software to recognize speech and not a perfect accent in the ESL context2014

    • Author(s)
      Cooper, T., Tsukada, A., Matoba, R. & Naruse, Y
    • Journal Title

      Proceedings of Society for Information Technology & Teacher Education International Conference 2014

      Volume: 2014 Pages: 1096-1099

    • Peer Reviewed / Acknowledgement Compliant
  • [Presentation] Teaching Perfect Pronunciation or Productive Communication: utilizing SR technology in the Kosen EFL classroom2014

    • Author(s)
      COOPER Todd, TSUKADA Akira, NARUSE Yoshinori, MATSUNAGA, Tomoki
    • Organizer
      平成26年度COCET研究大会、東京
    • Place of Presentation
      国立オリンピック記念青少年総合センター(東京都)
    • Year and Date
      2014-09-24
  • [Presentation] Xtionより得られる正面顔を用いた2D顔認証2014

    • Author(s)
      今枝 駿,Cooper Todd,塚田 章
    • Organizer
      平成26年度電気関係学会北陸支部連合大会講演論文集,F51
    • Place of Presentation
      .富山高専(富山県)
    • Year and Date
      2014-09-12
  • [Presentation] KinectにおけるRGB画像と距離画像の位置補正2014

    • Author(s)
      若松絵里,坂田結衣,由井四海,塚田 章
    • Organizer
      平成26年度電気関係学会北陸支部連合大会講演論文集,F73
    • Place of Presentation
      .富山高専(富山県)
    • Year and Date
      2014-09-11
  • [Presentation] Big Brother is Watching You [get better at EFL interviews and presentations]! Harnessing facial, speech and gestural recognition for education.2014

    • Author(s)
      COOPER Todd, TSUKADA Akira, NARUSE Yoshinori, MATSUNAGA, Tomoki
    • Organizer
      EdMedia 2014: World Conference on Educational Media and Technology - Jun 23-26, 2014 - Tampere, Province of Western Finland, Finland
    • Place of Presentation
      Tampere University (Finland)
    • Year and Date
      2014-06-25

URL: 

Published: 2016-05-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi