• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Spotting Finger Spelled Words from Sign Language Video

Research Project

Project/Area Number 25282173
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypePartial Multi-year Fund
Section一般
Research Field Rehabilitation science/Welfare engineering
Research InstitutionUniversity of Tsukuba

Principal Investigator

Fukui Kazuhiro  筑波大学, システム情報系, 教授 (40375423)

Co-Investigator(Kenkyū-buntansha) Okazaki Akio  筑波技術大学, 産業技術学部, 教授 (20516679)
Kato Nobuko  筑波技術大学, 産業技術学部, 教授 (90279555)
Project Period (FY) 2013-04-01 – 2016-03-31
Project Status Completed (Fiscal Year 2015)
Budget Amount *help
¥17,290,000 (Direct Cost: ¥13,300,000、Indirect Cost: ¥3,990,000)
Fiscal Year 2015: ¥4,420,000 (Direct Cost: ¥3,400,000、Indirect Cost: ¥1,020,000)
Fiscal Year 2014: ¥5,850,000 (Direct Cost: ¥4,500,000、Indirect Cost: ¥1,350,000)
Fiscal Year 2013: ¥7,020,000 (Direct Cost: ¥5,400,000、Indirect Cost: ¥1,620,000)
Keywords指文字 / 手話 / スポッティング / 正準相関分析 / 部分空間表現 / 動画像認識 / 多視点画像 / 動画像 / 手話認識 / 画像認識 / インターフェース
Outline of Final Research Achievements

In this research, we developed a new method for spotting specific finger alphabet words from an input sign language video. We addressed the spotting task by employing the basic idea of temporal regularized canonical correlation analysis (TRCCA). The classification accuracy of TRCCA is enhanced by incorporating two functions: 1) parallel processing with multiple time scales, 2) implicit feature mapping by nonlinear orthogonalization. The enhanced TRCCA is called “kernel orthogonal TRCCA (KOTRCCA)”. We demonstrated its effectiveness through the experiments in the task of spotting 8 kinds of finger alphabet words from a sign language vide. In addition, as another approach to spotting, we developed a randomized extension of the DTW, termed randomized time warping (RTW), which generates time elastic (TE) features by randomly sampling the sequential data while retaining the temporal information. We also demonstrated the applicability of RTW through experiments on three public datasets.

Report

(4 results)
  • 2015 Annual Research Report   Final Research Report ( PDF )
  • 2014 Annual Research Report
  • 2013 Annual Research Report
  • Research Products

    (27 results)

All 2016 2015 2014 2013 Other

All Int'l Joint Research (1 results) Journal Article (12 results) (of which Peer Reviewed: 3 results,  Acknowledgement Compliant: 8 results) Presentation (14 results) (of which Int'l Joint Research: 2 results)

  • [Int'l Joint Research] ユニーバーシティ・カレッジ・ロンドン(英国)

    • Related Report
      2015 Annual Research Report
  • [Journal Article] Spotting Finger Spelled Words from Sign Language Video by Temporally Regularized Canonical Component Analysis2016

    • Author(s)
      Shouhei Tanaka, Nobuko Kato, Akio Okazaki, Hideitsu Hino, Kazuhiro Fukui
    • Journal Title

      The IEEE International Conference on Identity, Security and Behavior Analysis (ISBA 2016) BA2016

      Volume: 1 Pages: 1-11

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] 動きを伴う指文字を含めた距離画像を用いた対話的指文字練習システムの開発と評価2015

    • Author(s)
      近藤真暉,加藤伸子,福井和広,岡崎彰夫
    • Journal Title

      電子情報通信学会 信学技法 WIT研究会

      Volume: 114 Pages: 23-28

    • Related Report
      2014 Annual Research Report
    • Acknowledgement Compliant
  • [Journal Article] 距離画像から得られる形状空間に基づく手の形状識別と姿勢推定2015

    • Author(s)
      菊池 優介, 日野 英逸,福井 和広
    • Journal Title

      情報処理学会 CVIM研究会

      Volume: 196 Pages: 1-8

    • NAID

      110009882590

    • Related Report
      2014 Annual Research Report
    • Acknowledgement Compliant
  • [Journal Article] 距離画像を用いた動きのある指文字を含めた指文字練習システムの開発2014

    • Author(s)
      近藤真暉,加藤伸子,福井和広,岡崎彰夫
    • Journal Title

      ヒューマンインタフェースシンポジウム2014予稿集

      Volume: 2532D Pages: 1-6

    • Related Report
      2014 Annual Research Report
    • Acknowledgement Compliant
  • [Journal Article] 距離動画像列からの特定ジェスチャのスポッティング2014

    • Author(s)
      田中翔平,加藤伸子,岡崎彰夫,福井和広
    • Journal Title

      FIT2014

      Volume: K-027 Pages: 1-4

    • Related Report
      2014 Annual Research Report
    • Acknowledgement Compliant
  • [Journal Article] 指文字認識システムにおける効果的な辞書生成の検討2014

    • Author(s)
      渋谷美彩, 田中翔平, 日野英逸 加藤伸子,岡崎彰夫,福井和広
    • Journal Title

      FIT2014

      Volume: K-026 Pages: 1-4

    • Related Report
      2014 Annual Research Report
    • Acknowledgement Compliant
  • [Journal Article] Hand shape recognition using position invariant feature from the sequence of depth images2014

    • Author(s)
      張燕, Chendra Hadi SURYANTO, 福井和広
    • Journal Title

      FIT2014

      Volume: J-014 Pages: 1-4

    • Related Report
      2014 Annual Research Report
    • Acknowledgement Compliant
  • [Journal Article] Gesture recognition with multiple features from hands and face using depth sensor2014

    • Author(s)
      Graciliano Garcia Torres Galindo Jr, Chendra Hadi SURYANTO, 福井和広
    • Journal Title

      FIT2014

      Volume: J-013 Pages: 1-4

    • Related Report
      2014 Annual Research Report
    • Acknowledgement Compliant
  • [Journal Article] Finger alphabets recognition with multi-depth images for developing their learning system2014

    • Author(s)
      Daisuke Takabayashi, Hideitsu Hino, Kazuhiro Fukui
    • Journal Title

      Proceedings of FCV2014

      Volume: - Pages: 154-159

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Block-based KOMSM for hand shape recognition with occlusion2014

    • Author(s)
      Bernardo Gatto, Hideitsu Hino, Kazuhiro Fukui
    • Journal Title

      Proceedings of FCV2014

      Volume: - Pages: 375-381

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] フィードバック機能を備えた指文字学習支援システムの開発2013

    • Author(s)
      高林大輔, 田中陽土, 加藤伸子, 岡崎彰夫, 福井和広
    • Journal Title

      ビジョン技術の実利用ワークショップ (ViEW2013)

      Volume: -

    • Related Report
      2013 Annual Research Report
  • [Journal Article] Kinect を用いた指文字練習システム における識別処理とユーザインタフェースの改良2013

    • Author(s)
      田中 陽土, 高林 大輔, 近藤 真暉, 加藤 伸子, 福井 和広, 岡崎 彰夫
    • Journal Title

      電子情報通信学会HCG シンポジウム 2013 論文集

      Volume: - Pages: 291-296

    • Related Report
      2013 Annual Research Report
  • [Presentation] Spotting Finger Spelled Words from Sign Language Video by Temporally Regularized Canonical Component Analysis2016

    • Author(s)
      Shouhei Tanaka, Kazuhiro Fukui
    • Organizer
      The IEEE International Conference on Identity, Security and Behavior Analysis (ISBA 2016)
    • Place of Presentation
      東北大学,宮城県仙台市
    • Year and Date
      2016-02-29
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Randomized Time Warping (RTW) for Motion Recognition2016

    • Author(s)
      Chendra Hadi Suryanto, Jing-Hao Xue, Kazuhiro Fukui
    • Organizer
      The IEEE International Conference on Identity, Security and Behavior Analysis (ISBA 2016)
    • Place of Presentation
      東北大学,宮城県仙台市
    • Year and Date
      2016-02-29
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 動きを伴う指文字を含めた距離画像を用いた対話的指文字練習システムの開発と評価2015

    • Author(s)
      近藤真暉
    • Organizer
      電子情報通信学会 WIT研究会
    • Place of Presentation
      筑波技術大(茨城)
    • Year and Date
      2015-03-13
    • Related Report
      2014 Annual Research Report
  • [Presentation] 距離画像から得られる形状空間に基づく手の形状識別と姿勢推定2015

    • Author(s)
      菊池優介
    • Organizer
      情報処理学会 CVIM研究会
    • Place of Presentation
      東北大学(宮城)
    • Year and Date
      2015-03-06
    • Related Report
      2014 Annual Research Report
  • [Presentation] 距離画像を用いた動きのある指文字を含めた指文字練習システムの開発2014

    • Author(s)
      近藤真暉
    • Organizer
      ヒューマンインタフェースシンポジウム2014
    • Place of Presentation
      はこだて未来大学(北海道)
    • Year and Date
      2014-09-11
    • Related Report
      2014 Annual Research Report
  • [Presentation] 距離動画像列からの特定ジェスチャのスポッティング2014

    • Author(s)
      田中翔平
    • Organizer
      FIT2014
    • Place of Presentation
      筑波大学(茨城)
    • Year and Date
      2014-09-04
    • Related Report
      2014 Annual Research Report
  • [Presentation] 指文字認識システムにおける効果的な辞書生成の検討2014

    • Author(s)
      渋谷美彩
    • Organizer
      FIT2014
    • Place of Presentation
      筑波大学(茨城)
    • Year and Date
      2014-09-04
    • Related Report
      2014 Annual Research Report
  • [Presentation] Hand shape recognition using position invariant feature from the sequence of depth images2014

    • Author(s)
      張燕
    • Organizer
      FIT2014
    • Place of Presentation
      筑波大学(茨城)
    • Year and Date
      2014-09-03
    • Related Report
      2014 Annual Research Report
  • [Presentation] Gesture recognition with multiple features from hands and face using depth sensor2014

    • Author(s)
      Graciliano Garcia Torres Galindo Jr
    • Organizer
      FIT2014
    • Place of Presentation
      筑波大学(茨城)
    • Year and Date
      2014-09-03
    • Related Report
      2014 Annual Research Report
  • [Presentation] 距離画像を用いた動きのある指文字を含めた 指文字練習システムの試作2014

    • Author(s)
      近藤 真暉
    • Organizer
      電子情報通信学会総合大会のポスターセッション
    • Place of Presentation
      新潟大学
    • Related Report
      2013 Annual Research Report
  • [Presentation] Finger alphabets recognition with multi-depth images for developing their learning system2014

    • Author(s)
      Daisuke Takabayashi
    • Organizer
      FCV2014
    • Place of Presentation
      沖縄
    • Related Report
      2013 Annual Research Report
  • [Presentation] Block-based KOMSM for hand shape recognition with occlusion2014

    • Author(s)
      Bernardo Gatto
    • Organizer
      FCV2014
    • Place of Presentation
      沖縄
    • Related Report
      2013 Annual Research Report
  • [Presentation] Kinect を用いた指文字練習システム における識別処理とユーザインタフェースの改良2013

    • Author(s)
      田中 陽土
    • Organizer
      電子情報通信学会HCG シンポジウム 2013
    • Place of Presentation
      松山
    • Related Report
      2013 Annual Research Report
  • [Presentation] フィードバック機能を備えた指文字学習支援システムの開発2013

    • Author(s)
      高林大輔
    • Organizer
      ビジョン技術の実利用ワークショップ (ViEW2013)
    • Place of Presentation
      横浜
    • Related Report
      2013 Annual Research Report

URL: 

Published: 2013-05-21   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi