Body-synchronized interface to realize the movement of mid-air images that humans want to touch

2023 Fiscal Year Final Research Report

• Project/Area Number: 21K19821
• Research Category: Grant-in-Aid for Challenging Research (Exploratory)
• Allocation Type: Multi-year Fund
• Review Section: Medium-sized Section 62:Applied informatics and related fields
• Research Institution: The University of Electro-Communications
• Principal Investigator: Naoya Koizumi 電気通信大学, 大学院情報理工学研究科, 准教授 (80742981)
• Project Period (FY): 2021-07-09 – 2024-03-31
• Keywords: 空中像 / インタラクション / ヒューマンインタフェース

Outline of Final Research Achievements

Our goal in this research was to elucidate the expression of a mid-air image that the audience can't help but reach for.
First, our first prototype is a system of body-synchronized interface in which the operator manipulates an avatar displayed as a mid-air image as if it were his or her own body. The initial plan was to have human movements correspond to the movements of the avatar, but usability problems were discovered during prototyping, and the manipulation method was solved by using a human-shaped avatar as a controller. In addition, to properly measure human hand movements, a method using a hot mirror and a time-of-flight distance sensor was designed and implemented, and an attractive application was created that actually evokes the user.

Free Research Field

バーチャルリアリティ

Academic Significance and Societal Importance of the Research Achievements

本研究で設計したインタフェースは、空中像インタラクションに標準的に使用可能なものであり、今後の様々なインタラクションに使用される可能性がある。特にホットミラーとToFセンサを組み合わせた方式は有用性が高く、標準的な手法として使用されていくことが予想される。