Project/Area Number |
11555072
|
Research Category |
Grant-in-Aid for Scientific Research (B)
|
Allocation Type | Single-year Grants |
Section | 展開研究 |
Research Field |
Intelligent mechanics/Mechanical systems
|
Research Institution | Osaka University |
Principal Investigator |
SHIRAI Yoshiaki Professor, Graduate School of Engineering, Osaka University, 大学院・工学研究科, 教授 (50206273)
|
Co-Investigator(Kenkyū-buntansha) |
SAKIYAMA Takuro Research Associate, Graduate School of Engineering, Osaka University, 大学院・工学研究科, 助手 (70335371)
SHIMADA Nobutaka Research Associate, Graduate School of Engineering, Osaka University, 大学院・工学研究科, 助手 (10294034)
MIURA Jun Associate Professor, Graduate School of Engineering, Osaka University, 大学院・工学研究科, 助教授 (90219585)
久野 義徳 埼玉大学, 工学部, 教授 (10252595)
佐々木 繁 富士通研究所, マルチメディアシステム研究所, 部長(研究職)
|
Project Period (FY) |
1999 – 2001
|
Project Status |
Completed (Fiscal Year 2001)
|
Budget Amount *help |
¥13,300,000 (Direct Cost: ¥13,300,000)
Fiscal Year 2001: ¥6,900,000 (Direct Cost: ¥6,900,000)
Fiscal Year 2000: ¥2,600,000 (Direct Cost: ¥2,600,000)
Fiscal Year 1999: ¥3,800,000 (Direct Cost: ¥3,800,000)
|
Keywords | hand posture / gesture estimation / articulated object / measuring by image / uncertainty of information / real-time system / human interface / ジュスチャ |
Research Abstract |
The summarized results of this research are as follows: 1. We developed a video-rate hand posture measurement system based on hand region contour image, which consists of high speed PCs with large memories and are connected with each other by G-bit LAN system. The system can estimate almost 160000 possible shapes (including highly self-occluded hand shapes) in real-time using monocular camera setting. 2. We developed an online method to refine the initial shape of the articulated model for posture estimation. The method efficiently describes a huge set of the possible posture parameters employing a multi-dimensional ellisoid description. The method can refine the given initial model shape after the posture estimation in each timestep from a monocular image sequences, while it is still computationally heavy process and cannot be processed in real-time under the current computing environment. 3. We proposed a recognition method of Japanese Sign Language words using multiple camera images, color feature, image motion flows and observed number of the finger tips. Although each of these image features has uncertainty, we developed the system which integrates whole of the information using Hidden Markov Model learning and implements it into a gestural interface. 4. We proposed a novel time-space gestural model based on Switching Linear Dynamics architecture. Based on this model, we developed an on-line method to segment a shape-changing human hand region from a complicated background and identify it from several gesture models.
|