Integrative studies of neural mechanisms of haptic-visual cross-modal perception of material and surface qualities

• Project/Area Number: 24686034
• Research Category: Grant-in-Aid for Young Scientists (A)
• Allocation Type: Partial Multi-year Fund
• Research Field: Intelligent mechanics/Mechanical systems
• Research Institution: Okayama University
• Principal Investigator: Yang Jiajia 岡山大学, 自然科学研究科, 助教 (30601588)
• Project Period (FY): 2012-04-01 – 2016-03-31
• Project Status: Completed (Fiscal Year 2015)
• Budget Amount: ¥23,530,000 (Direct Cost: ¥18,100,000、Indirect Cost: ¥5,430,000); Fiscal Year 2015: ¥6,240,000 (Direct Cost: ¥4,800,000、Indirect Cost: ¥1,440,000); Fiscal Year 2014: ¥4,940,000 (Direct Cost: ¥3,800,000、Indirect Cost: ¥1,140,000); Fiscal Year 2013: ¥5,850,000 (Direct Cost: ¥4,500,000、Indirect Cost: ¥1,350,000); Fiscal Year 2012: ¥6,500,000 (Direct Cost: ¥5,000,000、Indirect Cost: ¥1,500,000)
• Keywords: 質感認知 / 視触覚クロスモーダル / fMRI / 脳機能 / 表面加工 / クロスモーダル / クロスモダール / 触覚情報処理 / 視覚情報処理

Outline of Final Research Achievements

The information about an object is built by different sensory modalities that converge somewhere in the human brain to form representations that are invariant to the input modality. To develop a high quality surface machining system, the following researches were implemented: 1) Investigation of interactions between haptic and visual perceptions of fine surface texture. 2) Development of MRI-compatible tactile and visual stimuli presentation system. 3) Investigation of brain activations related to cross-modal interactions of haptic-visual texture matching. 4) Discussion of functional asymmetry processing of haptic-visual roughness information transformation. 5) Development of a database including material and surface qualities physical parameter and brain activation patterns.

Research Products

• [Journal Article] Interactions between haptic and visual perceptions of fine surface texture (2016)
  • Author(s): Yinghua Yu, Jiajia Yang, Hiroki Matsumoto, Jinglong Wu
  • Journal Title: Neuroscience and Biomedical Engineering Volume: 00 Pages: 00-00
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Similar neural substrate for font size processing in bilinguals: An fMRI study (2016)
  • Author(s): Zhenglong Lin, Jiajia Yang, Xiujun Li, Geqi Qi, Hongzan Sun, Qiyong Guo, Jinglong Wu
  • Journal Title: Neuroscience and Biomedical Engineering Volume: 00 Pages: 00-00
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Development and Evaluation of a Tactile Cognitive Function Test Device for Alzheimer’s Disease Early Detection (2015)
  • Author(s): Jiajia Yang, Mohd Usairy Syafiq, Yinghua Yu, Satoshi Takahashi, Zhenxin Zhang, Jinglong Wu
  • Journal Title: Neuroscience and Biomedical Engineering Volume: 3(2) Pages: 58-65
  • Peer Reviewed / Int'l Joint Research / Acknowledgement Compliant
• [Journal Article] Effects of aging on pointing movements under restricted visual feedback conditions (2015)
  • Author(s): Liancun Zhang, Jiajia Yang, Yoshinobu Inai, Qiang Huang, Jinglong Wu
  • Journal Title: Human Movement Science Volume: 40 Pages: 1-13
  • Peer Reviewed / Int'l Joint Research / Acknowledgement Compliant
• [Journal Article] Speed Matching Interaction between Visual and Tactile Motion (2015)
  • Author(s): Liancun Zhang, Jiajia Yang, Yinghua Yu, Satoshi Takahashi, Yuta Araki, Qiang Huang, Jinglong Wu
  • Journal Title: Neuroscience and Biomedical Engineering Volume: 3(1) Pages: 20-26
  • Peer Reviewed / Int'l Joint Research / Acknowledgement Compliant
• [Journal Article] Tactile priming modulates the activation of the fronto-parietal circuit during tactile angle match and non-match processing (2014)
  • Author(s): Jiajia Yang, Yinghua Yu, Akinori Kunita, Qiang Huang, Jinglong Wu, Nobukatsu Sawamoto, Hidenao Fukuyama
  • Journal Title: Frontiers in Human Neuroscience Volume: 8 Pages: 926-926
  • DOI: 10.3389/fnhum.2014.00926
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] Elevated audiovisual temporal interaction in patients with migraine without aura (2014)
  • Author(s): Weiping Yang, Bingqian Chu, Jiajia Yang, Yinghua Yu, Jinglong Wu, Shengyuan Yu
  • Journal Title: The Journal of Headache and Pain Volume: 15 Issue: 1 Pages: 44-44
  • DOI: 10.1186/1129-2377-15-44
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] MRI-Compatible Tactile Orientation Stimulator to Investigate Neural Mechanisms of Tactile Orientation Discrimination (2014)
  • Author(s): Yinghua Yu, Jiajia Yang, HongZan Sun, Qiyong Guo and Jinglong Wu
  • Journal Title: International Journal of Information Volume: 17 Pages: 2463-2472
  • NAID: 40022664143
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Similar ventral occipito-temporal cortex activations in literate and illiterate adults during the Chinese character matching task: An fMRI study (2014)
  • Author(s): Geqi Qi, Xiujun Li, Tianyi Yan, Bin Wang, Jiajia Yang, Jinglong Wu, Qiyong Guo
  • Journal Title: Neuroscience Letters Volume: 566 Pages: 200-205
  • DOI: 10.1016/j.neulet.2014.02.032
  • Peer Reviewed
• [Journal Article] Limited persistence of tactile working memory resources during delay-dependent grating orientation discrimination (2013)
  • Author(s): Yinghua Yu, Jiajia Yang, Jinglong Wu
  • Journal Title: Neuroscience and Biomedical Engineering Volume: 1 Pages: 65-72
  • Peer Reviewed
• [Journal Article] Pedal Errors among Young and Older Individuals during Different Pedal Operating Conditions (2013)
  • Author(s): Jinglong Wu, Jiajia Yang, Masayuki Yoshitake
  • Journal Title: Human Factors Volume: inpress Issue: 4 Pages: 621-630
  • DOI: 10.1177/0018720813487200
  • Peer Reviewed
• [Journal Article] Development of a method to present wide-view visual stimuli in MRI for peripheral visual studies. (2013)
  • Author(s): Jinglong Wu, Bin Wang, Jiajia Yang, Yuu Hikino, 等(8名)
  • Journal Title: Journal of Neuroscience Methods Volume: 214 Issue: 2 Pages: 126-136
  • DOI: 10.1016/j.jneumeth.2013.01.021
  • Peer Reviewed
• [Journal Article] 視覚誘導自己直線運動感覚の空間特性の輝度依存性 (2013)
  • Author(s): 呉景龍, 于英花, 楊家家
  • Journal Title: 人間工学 Volume: 49 Pages: 18-24
  • NAID: 10031166233
  • Peer Reviewed
• [Journal Article] Delayed Audiovisual Integration of Patients with Mild Cognitive Impairment and Alzheimer's Disease Compared with Normal Aged Controls (2012)
  • Author(s): Jinglong Wu, Jiajia Yang, Ying hua Yu, 等(7名)
  • Journal Title: Journal of Alzheimer Disease Volume: 32 Issue: 2 Pages: 317-328
  • DOI: 10.3233/jad-2012-111070
  • Peer Reviewed
• [Presentation] 遅延弁別課題を用いた触覚空間ワーキングメモリの脳内処理過程の検討 (2015)
  • Author(s): 于 英花，楊 家家，田中 嵩大，高橋 智，繁桝 博昭，門田 宏，中原 潔，江島 義道，呉 景龍
  • Organizer: 第24回計測自動制御学会中国支部学術講演会
  • Place of Presentation: 岡山
  • Year and Date: 2015-11-28
• [Presentation] 日本語と中国語における言語処理の脳内メカニズムに関するfMRI研究 (2015)
  • Author(s): 林 正龍，楊 家家，高橋 智，呉 景龍:
  • Organizer: 第24回計測自動制御学会中国支部学術講演会
  • Place of Presentation: 岡山
  • Year and Date: 2015-11-28
• [Presentation] 視触覚クロスモーダルな粗さマッチングに関する脳イメージング研究 (2015)
  • Author(s): 楊 家家
  • Organizer: 質感のつどい 第１回公開フォーラム
  • Place of Presentation: 東京
  • Year and Date: 2015-11-25
• [Presentation] Behavioral evidence for motor learning and transfer without visual feedback (2015)
  • Author(s): Jiajia Yang, Yinghua Yu, Satoshi Takahashi, Jinglong Wu, Qiushi Fu, Marco Santello
  • Organizer: 第38回日本神経科学大会サテライトシンポジウム
  • Place of Presentation: 京都
  • Year and Date: 2015-08-01
  • Int'l Joint Research
• [Presentation] 顔と衣類の認識に関する脳内処理の性差：fMRI研究 (2015)
  • Author(s): 楊家家，王彬，松本裕子，倉橋寛明，高橋智，三宅講二，杉本盛人，呉景龍，公文 裕巳
  • Organizer: 第42回岡山脳研究セミナー
  • Place of Presentation: 岡山
  • Year and Date: 2015-06-20
  • Invited
• [Presentation] Recognition of Visual and Tactile Repetition in Japanese Word : An fMRI Study (2015)
  • Author(s): Daiki Kuzume, Qi GeQi, Lin Zhenglong, Jiajia Yang, and Hiroaki Shigemasu, Hiroshi Kadota, Kiyoshi Nakahara, Jinglong Wu
  • Organizer: 2015 ICME International Conference on Complex Medical Engineering
  • Place of Presentation: Okayama, Japan
  • Year and Date: 2015-06-18
  • Int'l Joint Research
• [Presentation] Applicability in screening tests for cognitive impairment and consideration towards decreases in tactile discrimination (2015)
  • Author(s): Mohd Usairy Syafiq, Jiajia Yang, Jinglong Wu
  • Organizer: 2015 ICME International Conference on Complex Medical Engineering
  • Place of Presentation: Okayama, Japan
  • Year and Date: 2015-06-18
  • Int'l Joint Research
• [Presentation] Behavioral evidence for motor learning and transfer without visual feedback (2015)
  • Author(s): Ryuta Kitani, Jiajia Yang, Yinghua Yu, Akinori Kunita, Satoshi Takahashi, Jinlong Wu, Qiushi Fu, Marco Santello
  • Organizer: 2015 ICME International Conference on Complex Medical Engineering
  • Place of Presentation: Okayama, Japan
  • Year and Date: 2015-06-18
  • Int'l Joint Research
• [Presentation] Neuroimaging evidence for tactile object recognition (2015)
  • Author(s): Jiajia Yang
  • Organizer: 2015 ICME International Conference on Complex Medical Engineering
  • Place of Presentation: Okayama, Japan
  • Year and Date: 2015-06-18
  • Int'l Joint Research / Invited
• [Presentation] 視触覚クロスモーダルによる表面粗さ認識の優位性の検討 (2014)
  • Author(s): 松本裕貴, 楊家家, 于英花, 高橋智, 呉景龍
  • Organizer: 第37回日本生体医工学会中国四国支部大会
  • Place of Presentation: 岡山県，日本
  • Year and Date: 2014-10-04
• [Presentation] A New Approach of Audiovisual Integration for Early Detection of Dementia (2014)
  • Author(s): Satoshi Takahashi, Jinglong Wu, Jiajia Yang, Koji Abe
  • Organizer: The 2014 International Conference on Brain Informatics and Health - (BIH)
  • Place of Presentation: Warsaw, Poland
  • Year and Date: 2014-08-11 – 2014-08-14
• [Presentation] Early Detection of Alzheimer's Disease with A Novel Tactile Cognitive Approach (2014)
  • Author(s): Jinglong Wu, Satoshi Takahashi, Jiajia Yang, Koji Abe
  • Organizer: The 2014 International Conference on Brain Informatics and Health - (BIH)
  • Place of Presentation: Warsaw, Poland
  • Year and Date: 2014-08-11 – 2014-08-14
• [Presentation] Development of a magnetic resonance-compatible tactile orientation delivery system (2014)
  • Author(s): Di Chen, JiajiaYang, Yinghua Yu，Ryousuke Goto，Satoshi Takahashi
  • Organizer: 2014 IEEE International Conference on Mechatronics and Automation-(ICMA)
  • Place of Presentation: Tianjin, China
  • Year and Date: 2014-08-03 – 2014-08-06
• [Presentation] Ability to recognize and identify the location of vibration stimulation on the fingers (2014)
  • Author(s): Yang Liu, Yinghua Yu, Jiajia Yang, Yoshinobu Inai, Jinglong Wu
  • Organizer: 2014 IEEE International Conference on Mechatronics and Automation-(ICMA)
  • Place of Presentation: Tianjin, China
  • Year and Date: 2014-08-03 – 2014-08-06
• [Presentation] The DTI Study on Visual Corte V6 of Human Brain (2014)
  • Author(s): Yang Feng, Bing Wang, Jiajia Yang, Jinglong Wu, Seiichiro Ohno, Yuuta Shibai
  • Organizer: 2014 IEEE International Conference on Mechatronics and Automation-(ICMA)
  • Place of Presentation: Tianjin, China
  • Year and Date: 2014-08-03 – 2014-08-06
• [Presentation] Effects of audiovisual interaction by temporal gaps between visual and auditory stimuli in the human brain (2014)
  • Author(s): Weiping Yang, Jiajia Yang, Xiaoyu Tang, Jinglong Wu
  • Organizer: 2014 ICME International Conference on Complex Medical Engineering - (CME)
  • Place of Presentation: Taipei, Taiwan
  • Year and Date: 2014-06-26 – 2014-06-29
• [Presentation] Tactile Cognitive Tester using for Alzheimer’s Disease Early Detection (2014)
  • Author(s): Jiajia Yang, Jinglong Wu, Koji Abe
  • Organizer: 2014 ICME International Conference on Complex Medical Engineering - (CME)
  • Place of Presentation: Taipei, Taiwan
  • Year and Date: 2014-06-26 – 2014-06-29
  • Invited
• [Presentation] Development of Tactile Stimuli Devices to Investigate Neural Mechanisms of Tactile Perception (2014)
  • Author(s): Jiajia Yang, Yinghua Yu, Satoshi Takahashi, Seiichiro Ohno, Susumu Kanazawa, Jinglong Wu
  • Organizer: 2014 ICME International Conference on Complex Medical Engineering - (CME)
  • Place of Presentation: Taipei, Taiwan
  • Year and Date: 2014-06-26 – 2014-06-29
• [Presentation] A Novel Audio-visual Based Approach for Alzheimer's Disease Early Detection (2014)
  • Author(s): Jinglong Wu, Jiajia Yang, Koji Abe
  • Organizer: 2014 ICME International Conference on Complex Medical Engineering - (CME)
  • Place of Presentation: Taipei, Taiwan
  • Year and Date: 2014-06-26 – 2014-06-29
• [Presentation] Comparison of Tactile and Visual Working Memory Capacity using N-Back Paradigm (2014)
  • Author(s): Yinghua Yu, Jiajia Yang, Akinori Kunita, Jinglong Wu
  • Organizer: 2014 ICME International Conference on Complex Medical Engineering - (CME)
  • Place of Presentation: Taipei, Taiwan
  • Year and Date: 2014-06-26 – 2014-06-29
• [Presentation] Development of a Tactile Angle Stimuli Presentation Device for Tactile Cognitive Function Discrimination (2013)
  • Author(s): Mohd Usairy Syafiq, Yinghua Yu, Jiajia Yang, Jinglong Wu
  • Organizer: 2013 IEEE International Conference on Mechatronics and Automation-(ICMA)
  • Place of Presentation: Takamatsu, Japan
• [Presentation] Development and Evaluation of Vibrotactile Stimuli Presentation Device to Investigate Tactile Working Memory (2013)
  • Author(s): Yang Liu, Jiajia Yang, Yinghua Yu, Yoshinobu Inai, Jinglong Wu
  • Organizer: 2013 IEEE International Conference on Mechatronics and Automation-(ICMA)
  • Place of Presentation: Takamatsu, Japan
• [Presentation] Age-related differences in pointing movements in restricted visual tasks and their design implication (2013)
  • Author(s): Liancun Zhang, Jiajia Yang, Inai Y., Qiang Huang, Jinglong Wu
  • Organizer: 2013 ICME International Conference on Complex Medical Engineering - (CME)
  • Place of Presentation: Beijing, China
• [Presentation] Different neural response in human ventral visual cortex for the face and house in a wide visual field (2013)
  • Author(s): Bin Wang, Tianyi Yan, Jiajia Yang, Jinglong Wu, Ohno S., Kanazawa S.
  • Organizer: 2013 ICME International Conference on Complex Medical Engineering - (CME)
  • Place of Presentation: Beijing, China
• [Presentation] Difference of audiovisual integration between Alzheimer's Disease patients and age-matched healthy controls: An fMRI study (2013)
  • Author(s): Lu Yang, Jiajia Yang, Nakamura N., Jinglong Wu, Ohno S., Kurata T., Abe K. Kanazawa S.
  • Organizer: 2013 ICME International Conference on Complex Medical Engineering - (CME)
  • Place of Presentation: Beijing, China