Free-hand multi-modal interaction with floating images

2014 Fiscal Year Final Research Report

• Project/Area Number: 23500161
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Multi-year Fund
• Section: 一般
• Research Field: Media informatics/Database
• Research Institution: Kobe Institute of Computing / Graduate School of Information Technology
• Principal Investigator: MARKON Sandor 神戸情報大学院大学, システム情報工学研究科(系), 教授 (30434971)
• Co-Investigator(Kenkyū-buntansha): KUWANO Mitsuhiro (50434973) ; YOSHIDA Hiroya (00461153) ; OHTERA Ryo (50590410)
• Project Period (FY): 2011-04-28 – 2015-03-31
• Keywords: 空中映像 / 多感覚刺激 / インタラクション / アミューズメント / 医療データ可視化 / 触覚刺激 / 聴覚刺激

Outline of Final Research Achievements

We have developed a system to study multimodal interaction with floating images by combining them with floating touch and floating sound stimulation. We have found optimal parameters for floating touch stimulation with air jets, and studied the effective use for interaction. As one application area, we have studied multi-modal interaction with floating images for amusement, and performed psychological experiments with games. As another application, we have developed a medical information visualisation system combining floating images with a new type of haptic stimulation device. We have also developed fingertip detection methods for interacting with the floating images. We have presented the results at international conferences and received Best Paper Award two times. The developed basic technology is expected to lead to new products in amusement and in medical visualisation.

Free Research Field

情報通信技術