• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Real-time Shape and Posture Estimation of Articulated Objects Based on Multiple kinds of Uncertain Feature Information Obtained from Image Sequences

Research Project

Project/Area Number 11555072
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section展開研究
Research Field Intelligent mechanics/Mechanical systems
Research InstitutionOsaka University

Principal Investigator

SHIRAI Yoshiaki  Professor, Graduate School of Engineering, Osaka University, 大学院・工学研究科, 教授 (50206273)

Co-Investigator(Kenkyū-buntansha) SAKIYAMA Takuro  Research Associate, Graduate School of Engineering, Osaka University, 大学院・工学研究科, 助手 (70335371)
SHIMADA Nobutaka  Research Associate, Graduate School of Engineering, Osaka University, 大学院・工学研究科, 助手 (10294034)
MIURA Jun  Associate Professor, Graduate School of Engineering, Osaka University, 大学院・工学研究科, 助教授 (90219585)
久野 義徳  埼玉大学, 工学部, 教授 (10252595)
佐々木 繁  富士通研究所, マルチメディアシステム研究所, 部長(研究職)
Project Period (FY) 1999 – 2001
Project Status Completed (Fiscal Year 2001)
Budget Amount *help
¥13,300,000 (Direct Cost: ¥13,300,000)
Fiscal Year 2001: ¥6,900,000 (Direct Cost: ¥6,900,000)
Fiscal Year 2000: ¥2,600,000 (Direct Cost: ¥2,600,000)
Fiscal Year 1999: ¥3,800,000 (Direct Cost: ¥3,800,000)
Keywordshand posture / gesture estimation / articulated object / measuring by image / uncertainty of information / real-time system / human interface / ジュスチャ
Research Abstract

The summarized results of this research are as follows:
1. We developed a video-rate hand posture measurement system based on hand region contour image, which consists of high speed PCs with large memories and are connected with each other by G-bit LAN system. The system can estimate almost 160000 possible shapes (including highly self-occluded hand shapes) in real-time using monocular camera setting.
2. We developed an online method to refine the initial shape of the articulated model for posture estimation. The method efficiently describes a huge set of the possible posture parameters employing a multi-dimensional ellisoid description. The method can refine the given initial model shape after the posture estimation in each timestep from a monocular image sequences, while it is still computationally heavy process and cannot be processed in real-time under the current computing environment.
3. We proposed a recognition method of Japanese Sign Language words using multiple camera images, color feature, image motion flows and observed number of the finger tips. Although each of these image features has uncertainty, we developed the system which integrates whole of the information using Hidden Markov Model learning and implements it into a gestural interface.
4. We proposed a novel time-space gestural model based on Switching Linear Dynamics architecture. Based on this model, we developed an on-line method to segment a shape-changing human hand region from a complicated background and identify it from several gesture models.

Report

(4 results)
  • 2001 Annual Research Report   Final Research Report Summary
  • 2000 Annual Research Report
  • 1999 Annual Research Report
  • Research Products

    (32 results)

All Other

All Publications (32 results)

  • [Publications] 古川大輔, 島田伸敬 久野義徳, 白井良明: "ジェスチャによるプレゼンテーション支援システム"インタラクション2000論文集. 53-54 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] N.Shimada, Y.Shirai, Y.Kuno: "Model Adaptation and Posture Estimation of Moving Articulated Object Using Monocular Camera"H.H Nagel and F.J.P.Lopez(Eds.), Articulated Motion and Deformable Objects, Lecture Notes in Computer Science 1899. 159-172 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] N.Shimada, K.Kimura, Y.Shirai: "Real-time 3-D Hand Posture Estimation based on 2-D Appearance Retrieval Using Monocular Camera"Proc. Int. WS. on RATFG-RTS. 23-30 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 谷端, 島田, 白井: "手話認識のための手指抽出と単語認識"電子情報通信学会 福祉情報工学研究会 技術報告 WIT. 2001-22. 37-42 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] M.H.Jeong, Y.Kuno, N.Shimada, Y.Shirai: "Recognition of Shape-Changing Hand Gestures"IEICE Transactions. D(to appear). (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 浜田, 島田, 白井: "遷移ネットワークに基づく多視点画像時系列からの手指形状推定"電子情報通信学会論文誌. D-II(to appear). (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] N. Shimada, K. Kimura, Y. Shirai and Y. Kuno: "3-D Hand Posture Estimation by Indexing Monocular Silhouette Images"Proc. The 6th workshop on Frontier of Computer Vision. 150-155 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] D. Furukawa, N. Shimada, Y. Kuno and Y. Shirai: "Presentation Support System by Gesture Recognition (written in Japanese)"Interaction 2000. 53-54 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] N. Shimada, K. Kimura, Y. Shirai and Y. Kuno: "Hand Posture Estimation by Combining 2-D, Appearance based and 3-D Model-based Approaches"Proc. 15th International Conference on Pattern Recognition. 709-712 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] N. Shimada, Y. Shirai and Y. Kuno: "Model Adaptation and Posture Estimation of Moving Articulated Object Using Monocular Camera"Articulated Motion and Deformable Objects 2000. 159-172 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y. Hamada, N. Shimada and Y. Shirai: "Hand Shape Estimation Using Image Transition Network"Proc. Workshop on Human Motion 2000. 161-166 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] N. Shimada, K. Kimura and Y. Shirai: "Real-time 3-D Hand Posture Estimation based on 2-D Appearance Retrieval Using Monocular Camera"Proc. Int. WS. On RATFG-RTS 2001. 23-30 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] N. Tanibata, N. Shimada and Y. Shirai: "Hand Extraction and Word Recognition Method for Sign Languages (written in Japanese)"IEICE Technical Report WIT 2001-22. 37-42 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] M.H. Jeong, Y. Kuno, N. Shimada, and Y. Shirai: "Complex Hand-Gesture Recognition Using Active Contour and Switching Linear Model"Proc. 7th Korea-Japan Joint Worksop on Computer Vision. 151-156 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] M.H. Jeong, Y. Kuno, N. Shimada, and Y. Shirai: "Recognition Of Shape-Changing Hand Gestures Based On Switching Linear Model"Proc. of 11th Int. Conf. on Image Analysis and Processing. 14-19 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] M.H. Jeong, Y. Kuno, N. Shimada, and Y. Shirai: "Recognition of Shape-Changing Hand Gestures"IEICE Transactions Division D. (to appear). (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y. Hamada, N. Shimada and Y. Shirai: "Hand Shape Estimation Using Sequence of Multiple Viewpoint Images Based on Transition Network (written in Japanese)"IEICE Transactions Division D-II. (to appear). (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] N.Shimada, K.Kimura, Y.Shirai: "Real-time 3-D Hand Posture Estimation based on 2-D Appearance Retrieval Using Monocular Camera"Proc.Int.WS.on RATFG-RTS. 23-30 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] M.H.Jeong, Y.Kuno, N.Shimada, Y.Shirai: "Recognition Of Shape-Changing Hand Gestures Based On Switching Linear Model"Proc.of 11th Int.Conf.on Image Analysis and Processing. 14-19 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 谷端, 島田, 白井: "手話認識のための手指抽出と単語認識"電子情報通信学会 福祉情報工学研究会 技術報告 WIT. 2001-22. 37-42 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] M.H.Jeong, Y.Kuno, N.Shimada, Y.Shirai: "Complex Gesture Recognition using Coupled Switching Linear Model"Proc.of Asian Conf.on Computer Vision. 132-137 (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] M.H.Jeong, Y.Kuno, N.Shimada, Y.Shirai: "Recognition of Shape-Changing Hand Gestures"IEICE Transactions. (to appear). (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] 浜田, 島田, 白井: "遷移ネットワークに基づく多視点画像時系列からの手指形状推定"電子情報通信学会論文誌. D-II(to appear). (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] 古川大輔,島田伸敬,久野義徳,白井良明: "ジェスチャによるプレゼンテーション支援システム"インタラクション2000論文集. 53-54 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] N.Shimada,K.Kimura,Y.Shirai and Y.Kuno: "Hand Posture Estimation by Combining 2-D Appearance-based and 3-D Model-based Approaches"Proc.15th International Conference on Pattern Recognition. 3. 709-712 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] N.Shimada,Y.Shirai and Y.Kuno: "Model Adaptation and Posture Estimation of Moving Articulated Object Using Monocular Camera"H.H Nagel and F.J.P.Lopez (Eds.), Articulated Motion and Deformable Objects, Lecture Notes in Computer Science 1899. 159-172 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 浜由康志,島田伸敬,白井良明: "形状遷移情報の学習を用いた時系列画像からの手指形状推定"情報処理学会研究報告CVIM-124. 9-16 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] Y.Hamada,N.Shimada and Y.Shirai: "Hand Shape Estimation Using Image Transition Network"Proc.Workshop on Human Motion 2000. 161-166 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] M.H.Jeong,Y.Kuno,N.Shimada and Y.Shirai: "Complex Hand-Gesture Recognion Using Active Contour and Switching Linear Model"Proc.7th Korea-Japan Joint WS on Computer Vision. 151-161 (2001)

    • Related Report
      2000 Annual Research Report
  • [Publications] N.Shimada,K.Kimura,Y.Shirai and Y.Kuno: "3-D Hand Posture Estimation by Indexing Monocular Silhouette Images"Proc. the 6th workshop on Frontier of Computer Vision. 150-155 (2000)

    • Related Report
      1999 Annual Research Report
  • [Publications] N.Shimada,K.Kimura Y.Kuno and Y.Shirai: "Image-based Measuring of Hand Postures with Adaptability to Individuals"Proc. International Conference on Mechatronic Technology. 404-409 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 木村光佑,島田伸敬,白井良明: "単眼輪郭画像を用いた索引による三次元手指姿勢の推定"第17回ロボット学会学術講演予稿集. 411-412 (1999)

    • Related Report
      1999 Annual Research Report

URL: 

Published: 1999-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi