• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Sign Language Recognition System based on the Generation and Recognition Model for Human Arm Movement

Research Project

Project/Area Number 25330335
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Life / Health / Medical informatics
Research InstitutionToyohashi University of Technology

Principal Investigator

Fukumura Naohiro  豊橋技術科学大学, 工学(系)研究科(研究院), 准教授 (90293753)

Research Collaborator IGARI Shinpei  豊橋技術科学大学, 大学院工学研究科
SHISHIDO Emiko  名古屋大学, 医学系研究科, 特別研究員 (40723101)
Project Period (FY) 2013-04-01 – 2017-03-31
Project Status Completed (Fiscal Year 2016)
Budget Amount *help
¥4,810,000 (Direct Cost: ¥3,700,000、Indirect Cost: ¥1,110,000)
Fiscal Year 2015: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2014: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Fiscal Year 2013: ¥2,340,000 (Direct Cost: ¥1,800,000、Indirect Cost: ¥540,000)
Keywords手話単語認識 / 躍度最小軌道 / ヒト腕の運動 / ジェスチャー / 手話 / ジェスチャー認識 / ジャーク最小軌道 / 経由点 / DPマッチング / Multi-Stream HMM / 手話翻訳 / アイ・ハンド・コーディネーション
Outline of Final Research Achievements

A hypothesis that human skillful hand motions are generated as optimal trajectories that represent and store only constraint conditions such as a few via-points where the hand pass in addition to the start and the end point of the trajectory in the brain. We examined this hypothesis by simulating the curved hand movements and the orchestra's conducting motion trajectory and gaze measurement experiment when drawing the curve. We also proposed algorithms for sign language recognition using information about these via-points. We measured 360 sign language words and showed recognition rate of 90.2% in the case of sign language words expressed only by both arm movement and 90.0% in case of sign language words expressed only with a dominant hand, respectively.

Report

(5 results)
  • 2016 Annual Research Report   Final Research Report ( PDF )
  • 2015 Research-status Report
  • 2014 Research-status Report
  • 2013 Research-status Report
  • Research Products

    (18 results)

All 2016 2015 2014 Other

All Journal Article (1 results) (of which Peer Reviewed: 1 results,  Acknowledgement Compliant: 1 results) Presentation (15 results) (of which Int'l Joint Research: 4 results) Remarks (2 results)

  • [Journal Article] Arm Movement Pattern Recognition of Sign Language Words Based on the Minimum Jerk Model to Develop a Sign Language Translation2015

    • Author(s)
      猪狩晋平,福村直博
    • Journal Title

      電子情報通信学会論文誌D 情報・システム

      Volume: J98-D Issue: 3 Pages: 437-447

    • DOI

      10.14923/transinfj.2014PDP0007

    • ISSN
      1880-4535, 1881-0225
    • Year and Date
      2015-03-01
    • Related Report
      2014 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Presentation] Analysis of eye-movement when drawing a line2016

    • Author(s)
      Emiko SHISHIDO, Shuntaro OKAZAKI, Keiji IMOTO, Norihiro SADATO, Naohiro FUKUMURA, Norio OZAKI
    • Organizer
      第39回日本神経科学大会
    • Place of Presentation
      パシフィコ横浜
    • Year and Date
      2016-07-20
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Recognition of Japanese Sign Language Words Represented by Both Arms Using Multi-Stream HMMs2016

    • Author(s)
      S.Igari, N.Fukumura
    • Organizer
      The 7th International Multi-Conference on Complexity, Informatics and Cybernetics(IMCIC 2016)
    • Place of Presentation
      Orlando, USA
    • Year and Date
      2016-03-08
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] An LDA based Weight Estimation Method for Multi-Modal Sign Language Recognition2016

    • Author(s)
      S.Igari, N.Fukumura
    • Organizer
      The 2nd International Conference on Information Technology (ICIT 2016)
    • Place of Presentation
      Melbourne, Australia
    • Year and Date
      2016-03-03
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] 曲線をなぞる運動におけるサッケード位置の解析2016

    • Author(s)
      中村晋之介,尾崎紀夫,定藤規弘,井本敬二,宍戸恵美子,福村直博
    • Organizer
      電子情報通信学会ニューロコンピューティング研究会
    • Place of Presentation
      豊橋技術科学大学
    • Related Report
      2016 Annual Research Report
  • [Presentation] Eye-hand Coordination in Tracing Tasks of Professional and Non-professional Calligraphers2015

    • Author(s)
      E.Shishido, K. Yamsaki, T. Itoh, Y. Itoh, S. Okazaki, K. Imoto, N. Sadato, N. Fukumura, N. Ozaki
    • Organizer
      第38回日本神経科学大会
    • Place of Presentation
      神戸国際会議場
    • Year and Date
      2015-07-28
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] 書道家が線を描く時の目と腕の協調運動の特徴抽出2015

    • Author(s)
      山﨑拳志郎,伊藤竜樹,伊藤嘉邦,岡崎俊太郎,定藤規弘, 尾崎紀夫,井本敬二, 宍戸恵美子,福村直博
    • Organizer
      電子情報通信学会ニューロコンピューティング研究会
    • Place of Presentation
      玉川大学
    • Year and Date
      2015-03-16 – 2015-03-17
    • Related Report
      2014 Research-status Report
  • [Presentation] 線の描画時の視線計測に基づくアイ・ハンド・コーディネーションの解析2014

    • Author(s)
      山﨑拳志郎,伊藤竜樹,伊藤嘉邦,岡崎俊太郎,定藤規弘, 尾崎紀夫,井本敬二, 宍戸恵美子,福村直博
    • Organizer
      電子情報通信学会ニューロコンピューティング研究会
    • Place of Presentation
      名古屋大学
    • Year and Date
      2014-12-13
    • Related Report
      2014 Research-status Report
  • [Presentation] Sign Language Word Recognition using Via-point Information and Correlation of the Bimanual Movements2014

    • Author(s)
      S.Igari, N.Fukumura
    • Organizer
      International Conference on Advance Informatics: Concepts, Theory and Applications
    • Place of Presentation
      Bandung, Indonesia
    • Year and Date
      2014-08-20 – 2014-08-21
    • Related Report
      2014 Research-status Report
  • [Presentation] 線の描画運動における書道習熟度と視線先行の関係2014

    • Author(s)
      山﨑拳志郎,伊藤竜樹,伊藤嘉邦, 岡崎俊太郎,定藤規弘,尾崎紀夫,井本敬二, 宍戸恵美子,福村直博
    • Organizer
      第8回モーターコントロール研究会
    • Place of Presentation
      筑波大学
    • Year and Date
      2014-08-07 – 2014-08-09
    • Related Report
      2014 Research-status Report
  • [Presentation] A Study of Sign Language Recognition Using Via-Points based on a Minimum Jerk Model

    • Author(s)
      Shinpei Igari and Naohiro Fukumura
    • Organizer
      SICE Annual Conference
    • Place of Presentation
      名古屋大学
    • Related Report
      2013 Research-status Report
  • [Presentation] 経由点の位置と運動方向を指定したトルク変化最小軌道の検証

    • Author(s)
      山﨑拳志郎,福村直博
    • Organizer
      平成25年度電気関係学会東海支部連合大会
    • Place of Presentation
      静岡大学
    • Related Report
      2013 Research-status Report
  • [Presentation] 腕運動の経由点情報と左右の腕の相関性を用いた手話単語認識

    • Author(s)
      猪狩晋平,福村直博
    • Organizer
      電子情報通信学会WIT研究会
    • Place of Presentation
      筑波技術大学
    • Related Report
      2013 Research-status Report
  • [Presentation] Kinectを利用した腕運動と手形状に基づく手話認識手法の検討

    • Author(s)
      和田健太,福村直博
    • Organizer
      電子情報通信学会WIT研究会
    • Place of Presentation
      筑波技術大学
    • Related Report
      2013 Research-status Report
  • [Presentation] 筋電図と手形状情報を統合した把持タスクにおけるシナジー抽出

    • Author(s)
      益崎克成,福村直博
    • Organizer
      電子情報通信学会HIP研究会
    • Place of Presentation
      東京大学
    • Related Report
      2013 Research-status Report
  • [Presentation] 周期運動のジャーク最小軌道による指揮者の叩き運動の解析

    • Author(s)
      澄田慎二,福村直博
    • Organizer
      電子情報通信学会HIP研究会
    • Place of Presentation
      東京大学
    • Related Report
      2013 Research-status Report
  • [Remarks] 豊橋技術科学大学 情報・知能工学系 生体運動制御システム研究室

    • URL

      http://www.bmcs.cs.tut.ac.jp/

    • Related Report
      2016 Annual Research Report
  • [Remarks] 生体運動制御システム研究室

    • URL

      http://www.bmcs.cs.tut.ac.jp

    • Related Report
      2014 Research-status Report

URL: 

Published: 2014-07-25   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi