AR Interaction of a virtual object with a bare hand using multisensory integration

2017 Fiscal Year Final Research Report

• Project/Area Number: 15K00373
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Multi-year Fund
• Section: 一般
• Research Field: Kansei informatics
• Research Institution: Utsunomiya University
• Principal Investigator: Sato Mie 宇都宮大学, 工学(系)研究科(研究院), 教授 (00344903)
• Co-Investigator(Kenkyū-buntansha): 長谷川 光司 宇都宮大学, 工学(系)研究科(研究院), 教授 (50272761) ; 橋本 直己 電気通信大学, 大学院情報理工学研究科, 准教授 (70345354)
• Project Period (FY): 2015-04-01 – 2018-03-31
• Keywords: 感性情報処理 / インタラクション

Outline of Final Research Achievements

This study developed an AR system that allows a user to grasp a virtual object with a bare hand. With our AR system, the user can see images on a head-mounted display in which his/her bare hand is grasping a virtual object in real time. We examined visual and auditory stimuli and their multisensory integration effective in enhancing the user's perception of grasping a virtual object with a bare hand. The results showed that our AR system provides a user with a feeling of grasping a virtual object and also its pseudo-softness with a bare hand. Our bare hand interaction contributes to realizing a natural interaction with a virtual object.

Free Research Field

感性情報学