• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

3-D Shape and Pose Estimation of Articulated Objects From Image Sequences

Research Project

Project/Area Number 09650471
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field 計測・制御工学
Research InstitutionOsaka University

Principal Investigator

SHIRAI Yoshiaki  Faculty of Engneering, Professor, 大学院・工学研究科, 教授 (50206273)

Co-Investigator(Kenkyū-buntansha) SHIMADA Nobutaka  Faculty Of Engneering, Research Associate, 大学院・工学研究科, 助手 (10294034)
MIURA Jun  Faculty Of Engneering, Research Associate, 大学院・工学研究科, 助手 (90219585)
KUNO Yoshinori  Faculty Of Engneering, Osaka University Associate Professor, 大学院・工学研究科, 助教授 (10252595)
Project Period (FY) 1997 – 1998
Project Status Completed (Fiscal Year 1998)
Budget Amount *help
¥3,700,000 (Direct Cost: ¥3,700,000)
Fiscal Year 1998: ¥700,000 (Direct Cost: ¥700,000)
Fiscal Year 1997: ¥3,000,000 (Direct Cost: ¥3,000,000)
Keywordshuman Interface / computer vision / gesture estimation / articulated object / image motion analysis / shape model refinement / probability distribution / constraint knowledge / 単眼視動画像
Research Abstract

In order to improve inconvenience of a conservative gesture interface instrument for human-machine interaction such as "wired-glove", we studied the newly non-tactile gesture recognizing method which estimates the 3-Dimensional shape and movement of human body from image sequences captured by TV-cameras without any special wears or marking on a user's body.
First, a hand shape and pose estimation method from monocular silhouette image sequences was studied.Given a roughly shaped model initially, the method estimates rough hand poses.Then it calculates a probability distribution of the model parameters such as finger lengths, palm size and joint angles.Combining observed image features in every image frame and prior knowledge about human hand such as possible ranges of joint angles and relationship between each finger lengths, the distribution is updated and the model shape is modified more precisely.
This estimation algorithm was implemented on a platform constructed from a 3-D highspeed graphics generator and personal computers and experimented for comuter graphics images and real hand images.It was demonstrated the joints angles, finger lengths and palm size can be well-estimated from a monocular images if many views of various shaped hand are obtained.
Since silhouettes contain very limited information about 3-D shape, a method using image motion and depth information was also studied.By precise verification of this method, the shape and pose are wrongly estimated due to approximation errors in probability calculation if accuracy of the image features isnot good.It found other method not using probability is required to resolve the problem.
Next another estimation method which aproximate the possible shape parameter region as a ellipsoid was tested for subsutitution of the probablistic method.It was found this method can correctly estimate even if the image features are errornous.However, it was also found this method is so week in a sudden large errornous input.

Report

(3 results)
  • 1998 Annual Research Report   Final Research Report Summary
  • 1997 Annual Research Report
  • Research Products

    (18 results)

All Other

All Publications (18 results)

  • [Publications] 島田信敬,白井良明,久野義徳,三浦 純: "緩やかな制約知識を利用した単眼視画像からの関節物体の形状と姿勢の同時推定" 電子情報通信学会論文誌. J81-D-II No.1. 45-53 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] N.Shimada,Y.Shirai,Y.Kuno and J.Miura: "3-D Pose Estimation and Model Refinement of an Articulated Object from a Monocular Image Sequence" Proc.3rd Asian Conference on Computer Vision. 1. 672-679 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] K.H.Jo,Y.Kuno,and Y.Shirai: "Context-based recognition of manipulative hand gestures for human computer interaction" Proc.3rd Asian Conference on Computer Vision. 2. 368-375 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 島田伸敬,白井良明,久野義徳,三浦 純: "形状の個体差に適応した精密なジェスチャ推定" インタラクション'98論文集. 5-12 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] N.Shimada,Y.Shirai,Y.Kuno and J.Miura: "3-D Pose Estimation and Model Refinement of An Articulated Object from A Monocular Image Sequence" Proc.of 3rd Conf on Face and Gesture Recognition. 1. 268-273 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 岡田隆三,白井良明,三浦 純: "オプティカルフローと距離情報の統合による3次元運動する人間の追跡" 電子情報通信学会技術研究報告,Vol.98-193,No.528. 9-16 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] N.Shimada, Y.Shirai, Y.Kuno and J.Miura: "Shape and Pose Esti-mation of an Articulated Object from a Monocular Image Se-quence Based on Loose Constraints" IEICE Transactions. J81-D-II-No.1. 45-53 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] N.Shimada, Y.Shirai, Y.Kuno and J.Miura: "3-D Pose Estimation and Model Refinement of an Articulated Object from a Monocular Image Sequence" Proc.3rd Asian Conference on Computer Vision. 672-679 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] K.H.Jo, Y.Kuno, and Y.Shirai: "Context-based Recognition Of Manipulative Hand Gestures For Human Computer Interaction" Proc.3rd Asian Conference on Computer Vision. 368-375 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] N.Shimada, Y.Shirai, Y.Kuno and J.Miura: "Precise Gesture Estimation Adaptable To Individual Body Shape" Interaction'98. 5-12 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] N.Shimada, Y.Shirai, Y.Kuno and J.Miura: "3-D Pose Estimation and Model Refinement of An Articulated Object from A Monoc-ular Image Sequence" Proc.of 3rd Conf on Face and Gesture Recognition. 268-273 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] R.Okada, Y.Shirai and J.Miura: "Person Tracking with 3-D Motion by Integrating Optical Flow and Depth" IEICE Technical Reports. Vol.98-193, No.528. 9-16 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] N.Shimada, Y.Shirai,Y.Kuno and J.Miura: "3-D Pose Estimation and Model Refinement of An Articulated Object from A Monoc-ular Image Sequence" Proc.of 3rd Conf on Face and Gesture Recognition. 1. 268-273 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] 岡田隆三,白井良明,三浦 純: "オプティカルフローと距離情報の統合による3次元運動する人間の追跡" 電子情報通信学会技術研究報告, Vol.98-193, No.528. 9-16 (1999)

    • Related Report
      1998 Annual Research Report
  • [Publications] 島田伸敬, 白井良明, 久野義徳, 三浦純: "緩やかな制約知識を利用した単眼視動画像からの関節物体の形状と姿勢の同定推定" 電子情報通信学会論文誌. J81-D-II No.1. 45-53 (1998)

    • Related Report
      1997 Annual Research Report
  • [Publications] N.Shimada, Y.Shirai, Y.Kuno and J.Miura: "3-D Pose Estimation and Model Refinement of an Articulated Object from a Monocular Image Sequence" Proc.3rd Asian Conference on Computer Vision. 1. 672-679 (1998)

    • Related Report
      1997 Annual Research Report
  • [Publications] K.H.Jo, Y.Kuno, and Y.Shirai: "Context-based recognition of manipulative hand gestures for human computer interaction" Proc.3rd Asian Conference on Computer Vision. 2. 368-375 (1998)

    • Related Report
      1997 Annual Research Report
  • [Publications] 島田伸敬, 白井良明, 久野義徳, 三浦純: "形状の個体差に適応した精密なジェスチャ推定" インタラクション'98論文集. 5-12 (1998)

    • Related Report
      1997 Annual Research Report

URL: 

Published: 1997-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi