• 研究課題をさがす
  • 研究者をさがす
  • KAKENの使い方
  1. 課題ページに戻る

2019 年度 実施状況報告書

Study on the hierarchy of cross-modal processing using functional MRI and Deep Learning

研究課題

研究課題/領域番号 19K20390
研究機関生理学研究所

研究代表者

Pham Quang・Trung  生理学研究所, システム脳科学研究領域, 特任研究員 (60837722)

研究期間 (年度) 2019-04-01 – 2022-03-31
キーワードCognitive science / Somatosensory / Haptics / Perception
研究実績の概要

In this study, I seeks for a comprehensive computational model by which the haptic information is processed into categorical value. It has been known that the Iateral occipital complex (LOC) of the brain is engaged in both vision and haptic processing. However, different from the vision, the haptics information is usually a group of fragments provided sequentially. Hence, they must be integrated at some areas. I hypothesize that the intraparietal sulcus (IPS) plays as the middle region between primary somatosensory area (S1) and the LOC, reconstructs the visual imagery from the fragments of haptic information. By that way, the ventral stream pathway which contributes to the human's object classification, can lately process it in the same manner as visual information. To observe such activity of IPS, I have developed a specific pneumatic haptic display that can be used to display the fragments of a digit sequentially inside the Magnetic Resonance Imaging (MRI) scanner. A similar experiment has been prepared for examining the ability of visions in reconstructing visual imagery from visual fragments. Finally, I am developing a deep learning model to demonstrate how the computation occurs hierarchically in the brain during these tasks.

現在までの達成度 (区分)
現在までの達成度 (区分)

3: やや遅れている

理由

The experiment design and device preparation were slightly longer than expected. Moreover, it has not been possible to recruit any participants for the MRI experiment due to the influence of the new coronavirus.

今後の研究の推進方策

I intend to conduct the MRI experiments with a controlled closed group of colleagues for preliminarily result. Then I will verified the result with a extended group of participants in the future if possible.

次年度使用額が生じた理由

At the mean time, the required amount for preparing MRI experiments was less than expected. However, in the next fiscal year, I need to use the incurring amount for hiring an technical supporter and recruiting about twenty participants for both visions and haptics experiments.

URL: 

公開日: 2021-01-27  

サービス概要 検索マニュアル よくある質問 お知らせ 利用規程 科研費による研究の帰属

Powered by NII kakenhi