| Project/Area Number |
19K20390
|
|---|
| Research Category |
Grant-in-Aid for Early-Career Scientists
|
| Allocation Type | Multi-year Fund |
|---|
| Review Section |
Basic Section 61060:Kansei informatics-related
|
|---|
| Research Institution | National Institute for Physiological Sciences |
|---|
Principal Investigator |
PHAM QUANG TRUNG 生理学研究所, システム脳科学研究領域, 特任研究員 (60837722)
|
|---|
| Project Period (FY) |
2019-04-01 – 2022-03-31
|
| Project Status |
Completed (Fiscal Year 2021)
|
| Budget Amount *help |
¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2021: ¥520,000 (Direct Cost: ¥400,000、Indirect Cost: ¥120,000)
Fiscal Year 2020: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
Fiscal Year 2019: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
|
|---|
| Keywords | cognitive science / somatosensory / haptics / perception / Cognitive Science / Somatosensory / Perception / Cognitive science / Haptics / Cross-modal / functional MRI / Deep Learning / Vision |
|---|
| Outline of Research at the Start |
It remains unknown how the brain construct visual imagery from haptic object signal. The purpose of this research is to seek for a computational model of the brain, by which the haptic information is processed into categorical value, using a deep learning model and functional MRI.
|
| Outline of Final Research Achievements |
In this study, I proposed a hypothesis where the fragments of haptic information are integrated into visual imagery at the intraparietal sulcus (IPS) and lateral occipital cortex (LOC) before passing to the visual ventral pathway for object recognition. For examining that hypothesis, I designed an experiment where the participants try to recognize the 3x5 dot-digits (from 0 to 9) from visual and haptic stimuli. During the experiment, I captured their brain signals using an MRI scanner. Behavioral analysis revealed that most participants can recognize the dot-digit above the chance level. Their visual performance is better than haptic performance. The fMRI analysis confirmed the involvements of IPS and LOC, and the dorsolateral prefrontal cortex (dlPFC) which is related to working-memory. I performed a representational analysis and found similar representations for both haptic and visual information at the IPS and LOC.
|
| Academic Significance and Societal Importance of the Research Achievements |
The results of this study extend our current understanding of the cross-modal processing of haptic and visual information in the brain. In the future, I expected these results to become hint for building a more efficient robotics system that mimics human brain.
|
