• 研究課題をさがす
  • 研究者をさがす
  • KAKENの使い方
  1. 課題ページに戻る

2013 年度 実施状況報告書

ジェスチャ及び音声認識を用いたコミュニケーション能力育成教材の開発と実践評価

研究課題

研究課題/領域番号 25370681
研究種目

基盤研究(C)

研究機関富山高等専門学校

研究代表者

COOPER T・D  富山高等専門学校, 一般教養科, 准教授 (70442449)

研究分担者 塚田 章  富山高等専門学校, 電子情報工学科, 教授 (40236849)
的場 隆一  富山高等専門学校, 電子情報工学科, 助教 (30592323)
成瀬 喜則  富山高等専門学校, 国際ビジネス学科, 教授 (00249773)
研究期間 (年度) 2013-04-01 – 2016-03-31
キーワードcommunication / gesture recognition / facial recognition
研究概要

We are developing a software-based gestural [GR], facial [FR] and speech recognition [SR] system to help students perform better on English invterviews and presentations. GR evaluates users’ gestures on quality and quantity. SR automates the system giving instant feedback. FR guarantees a quick, secure and authenticated login. The project comprises 2 areas [system and databases], divided into 3 phases, with increases in test subjects, question difficulty and database size. The audio and video databases allow EFL researchers to identify common errors, assess current curricula and improve language and cognitive development. Our plan called for the modification and design of software / system prototype. First, a database of 10-15 questions and gestures for small-group study. Then increase to 50 questions: 30 basic / 20 intermediate and begin categorization. Finally increase the database to 100 questions 40 basic / 40 intermediate / 20 advanced and complete categorization. Finally, we are to present our findings at both domestic and international conferences.
2013: We created the 15 questions for the interview and carried out some tests of the SR software. We are experimenting with different SR engines and modified databases using the Sphinx SR engine. We are continuing to improve the accuracy. Through use of a 3-D camera we increased the FR accuracy and reduced the negative effect of other variables such as lighting, distance, etc. The GR component now includes a Hidden Markov Model which allows detection of key shapes and has increased the gesture accuracy.

現在までの達成度 (区分)
現在までの達成度 (区分)

3: やや遅れている

理由

We experienced a slight delay due to the fact that our research is strongly linked with emerging fields in both technology and psychology. We have not reached the accuracy levels yet for with our customized SR database. We need to collect more data for this. We are currently experimenting with new cameras with higher depth resolution which will improve the results of our final findings. The gestural databases can be only created after collecting many hours of filming student presentations and speeches. We have been compiling these videos for future analysis.

今後の研究の推進方策

Our plan for the current year is to improve the function of the GR, SR, and FR components of our system. Testing will be carried out in large groups of 40. We will increase our question database to 50 questions and begin the categorization of the questions. 10 gestural patterns will be created and tested. Our SR database will increase, thereby improving accuracy. We will also test the accuracy of several mics, as well as the use of Jawbone technology to improve the quality of our system in large classrooms with lots of background noise. Our findings will be presented to the public at at least 1 national and 1 international conference.

次年度の研究費の使用計画

We had planned to present several topics of our research at an overseas conference together in a small group. Due to the small delay in our research we decided to postpone the excursion to the following year.
Our plan is to use the money in the same way, to fund a research trip for two reserachers to present at a conference in the current academic year [2014-2015].

  • 研究成果

    (8件)

すべて 2014 2013

すべて 雑誌論文 (3件) (うち査読あり 2件) 学会発表 (5件)

  • [雑誌論文] Accent versus Mispronunciation: modifying speech recognition software to recognize speech and not a perfect accent in the ESL context2014

    • 著者名/発表者名
      T. Cooper, A. Tsukada, Y. Naruse, R. Matoba
    • 雑誌名

      Proceedings of Society for Information Technology & Teacher Education International Conference

      巻: 2014 ページ: 印刷中

    • 査読あり
  • [雑誌論文] Using Tech to Teach "Total Communication"2014

    • 著者名/発表者名
      T. Cooper, A. Tsukada, Y. Naruse, R. Matoba
    • 雑誌名

      39th Annual International Conference on Language Teaching and Learning & Educational Materials

      巻: 2014 ページ: n/a

    • 査読あり
  • [雑誌論文] "モーションセンサデバイスから得られる深度情報を用いた顔認証の基礎的検討討 "2013

    • 著者名/発表者名
      今枝 駿,Cooper Todd,塚田 章
    • 雑誌名

      電子情報通信学会技術研究報告

      巻: Vol. 113, No. 61, MBE2013-5 ページ: 19,24

  • [学会発表] Kinectを用いた3D顔認証2013

    • 著者名/発表者名
      今枝 駿,Cooper Todd,塚田 章
    • 学会等名
      第3回バイオメトリクスと認識・認証シンポジウム,A11-8(東京)
    • 発表場所
      日本科学未来館 「東京」
    • 年月日
      20131126-20131127
  • [学会発表] Xtionを用いた3D顔認証システムの基礎的検討2013

    • 著者名/発表者名
      今枝 駿,Cooper Todd,塚田 章
    • 学会等名
      平成25年度電気関係学会北陸支部連合大会講演論文集,F2-20
    • 発表場所
      金沢大学「石川」
    • 年月日
      20130921-20130922
  • [学会発表] Teaching “Total Communication” through Technology: creation of software to develop verbal and non-verbal communicative skills in English2013

    • 著者名/発表者名
      T. Cooper, A. Tsukada, Y. Naruse, R. Matoba
    • 学会等名
      平成25年度COCET研究大会
    • 発表場所
      京都府中小企業会館「京都」
    • 年月日
      20130921-20130922
  • [学会発表] スピーキング能力向上のためのバーチャルインタビューシステム教材の開発2013

    • 著者名/発表者名
      T. Cooper, A. Tsukada, A. Yamaguchi, Y. Naruse
    • 学会等名
      平成25年度全国高専教育フォーラム 教育研究発表会,
    • 発表場所
      豊橋技術科学大学「愛知」
    • 年月日
      20130821-20130823
  • [学会発表] Kinectを用いた3D顔認証の基礎的検討2013

    • 著者名/発表者名
      今枝 駿,Cooper Todd,塚田 章
    • 学会等名
      第19回画像センシングシンポジウム講演論文集 IS2-21
    • 発表場所
      パシフィコ横浜アネックスホール「神奈川」
    • 年月日
      20130612-20130914

URL: 

公開日: 2015-05-28  

サービス概要 検索マニュアル よくある質問 お知らせ 利用規程 科研費による研究の帰属

Powered by NII kakenhi