| Budget Amount *help |
¥15,080,000 (Direct Cost: ¥11,600,000、Indirect Cost: ¥3,480,000)
Fiscal Year 2017: ¥3,250,000 (Direct Cost: ¥2,500,000、Indirect Cost: ¥750,000)
Fiscal Year 2016: ¥4,810,000 (Direct Cost: ¥3,700,000、Indirect Cost: ¥1,110,000)
Fiscal Year 2015: ¥7,020,000 (Direct Cost: ¥5,400,000、Indirect Cost: ¥1,620,000)
|
|---|
| Outline of Final Research Achievements |
We studied modeling method of fingering process of object manipulation. We broke down whole problem into 5 sub-problems:(1) precise measurement of fingers postures and fingertip positions from image,(2) recall of human’s grasping patterns based on 3-D shape of objects by DNN,(3) describing fingering process in object manipulation as state transition model,(4) recall of next action to be taken which causes required scene/object state change,(5) controlling the robot hand based on recalled grasping pattern.We applied DNN frameworks including CNN and RNN commonly to the above sub-problems and then acquired relationships between human action and object's state as static frame and dynamic sequence from human behavior observation.
We proposed the first step methods to build process model of human’s operation of object, under several limitations.
|
