| Project/Area Number |
17200019
|
|---|
| Research Category |
Grant-in-Aid for Scientific Research (A)
|
| Allocation Type | Single-year Grants |
|---|
| Section | 一般 |
|---|
| Research Field |
Cognitive science
|
|---|
| Research Institution | Advanced Telecommunications Research Institute International |
|---|
Principal Investigator |
ANDO Hiroshi Advanced Telecommunications Research Institute International, ATR Cognitive Information Science Laboratories, Department Head (40374095)
|
|---|
| Co-Investigator(Kenkyū-buntansha) |
ASHIDA Hiroshi Kyoto University, Department of Psychology, Associate Professor (20293847)
MATSUMIYA Kazumichi Tohoku University, Human Information System Division, Research Institute Electrical Communication, 人間情報システム研究部門, Associate Professor (90395103)
NISHINO Yurie ATR Cognitive Information Science Laboratories, Researcher (50329504)
SAKANO Yuichi ATR Cognitive Information Science Laboratories, Researcher (10443904)
HAROLD Hill 株式会社国際電気通信基礎技術研究所, 人間情報科学研究所, 主任研究員 (20395099)
|
|---|
| Project Period (FY) |
2005 – 2007
|
| Project Status |
Completed (Fiscal Year 2007)
|
| Budget Amount *help |
¥37,960,000 (Direct Cost: ¥29,200,000、Indirect Cost: ¥8,760,000)
Fiscal Year 2007: ¥8,580,000 (Direct Cost: ¥6,600,000、Indirect Cost: ¥1,980,000)
Fiscal Year 2006: ¥9,490,000 (Direct Cost: ¥7,300,000、Indirect Cost: ¥2,190,000)
Fiscal Year 2005: ¥19,890,000 (Direct Cost: ¥15,300,000、Indirect Cost: ¥4,590,000)
|
|---|
| Keywords | Object recognition / Brain Mechanism / Multisensory Integration / Vision / Somatosensory Perception / Haptics / fMRI / Psychophysics |
|---|
| Research Abstract |
The purpose of this study is to investigate dynamic brain mechanisms of 3D object recognition with visual and somatosensory information through psychophysical and fMRI brain activity imaging experiments. In this study, we developed novel experimental methods using virtual and real 3D objects, and conducted psychophysical experiments to reveal cooperative and competitive mechanisms of visual and somatosensory interaction, and measured brain activities to find brain regions involved in 3D object learning and image generation with visual and haptic information.
Regarding cooperative and competitive mechanisms of visual and somatosensory interaction, we conducted psychophysical experiments on the interpretation of ambiguous visual patterns using a visual-haptic display system and found that haptic information affects human visual perception and that binocular disparity information plays an important role in 3D visual and haptic shape estimation. We further developed multi-sensory interactio
… More
n system by devising new algorithms to integrate 3D image, force feedback, and contact sounds in real-time.
In fMRI experiments on human object recognition, we used real objects produced by a 3D printer and measured brain activities when the subjects performed haptic object learning and top-down image generation tasks. The results suggested that the inferior parietal lobule is involved in haptic 3D object learning and BA7 and the precuneous regions are involved in haptic top-down judgment. We further conducted experiments on cross-modal top-down processing, showing that the visual object shape represented in the lateral occipital complex(LOC) could be retrieved from haptic object memory acquired in the inferior parietal lobule(BA40), and that the haptic object shape represented in the somatosensory areas could be retrieved from visual object memory acquired in the fusiform gyrus. The results also suggested that multi-sensory imagery could be represented in BA7 and the precuneous regions. Based on these findings, we developed a brain network model of human multi-sensory integration. Less
|
