• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Body-synchronized interface to realize the movement of mid-air images that humans want to touch

Research Project

Project/Area Number 21K19821
Research Category

Grant-in-Aid for Challenging Research (Exploratory)

Allocation TypeMulti-year Fund
Review Section Medium-sized Section 62:Applied informatics and related fields
Research InstitutionThe University of Electro-Communications

Principal Investigator

Naoya Koizumi  電気通信大学, 大学院情報理工学研究科, 准教授 (80742981)

Project Period (FY) 2021-07-09 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥6,500,000 (Direct Cost: ¥5,000,000、Indirect Cost: ¥1,500,000)
Fiscal Year 2023: ¥2,860,000 (Direct Cost: ¥2,200,000、Indirect Cost: ¥660,000)
Fiscal Year 2022: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
Fiscal Year 2021: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Keywords空中像 / インタラクション / ヒューマンインタフェース
Outline of Research at the Start

本研究では、鑑賞者がついつい手を伸ばしてしまうような空中像の表現(映像の動きや人への反応)を解明する。具体的には人の行動を観察しながら空中像を自在に操作する技術を開発し、心理物理実験によって鑑賞者に働きかける空中像の動きを明らかにする。

Outline of Final Research Achievements

Our goal in this research was to elucidate the expression of a mid-air image that the audience can't help but reach for.
First, our first prototype is a system of body-synchronized interface in which the operator manipulates an avatar displayed as a mid-air image as if it were his or her own body. The initial plan was to have human movements correspond to the movements of the avatar, but usability problems were discovered during prototyping, and the manipulation method was solved by using a human-shaped avatar as a controller. In addition, to properly measure human hand movements, a method using a hot mirror and a time-of-flight distance sensor was designed and implemented, and an attractive application was created that actually evokes the user.

Academic Significance and Societal Importance of the Research Achievements

本研究で設計したインタフェースは、空中像インタラクションに標準的に使用可能なものであり、今後の様々なインタラクションに使用される可能性がある。特にホットミラーとToFセンサを組み合わせた方式は有用性が高く、標準的な手法として使用されていくことが予想される。

Report

(4 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Research-status Report
  • 2021 Research-status Report
  • Research Products

    (12 results)

All 2024 2023 2022 2021 Other

All Journal Article (1 results) (of which Peer Reviewed: 1 results) Presentation (8 results) (of which Int'l Joint Research: 4 results,  Invited: 1 results) Remarks (2 results) Patent(Industrial Property Rights) (1 results)

  • [Journal Article] An Optical Design for Interaction With Mid-Air Images Using the Shape of Real Objects2024

    • Author(s)
      Ando Shohei、Koizumi Naoya
    • Journal Title

      IEEE Access

      Volume: 12 Pages: 39129-39138

    • DOI

      10.1109/access.2024.3374782

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed
  • [Presentation] Mid-air image's background changes the impression of a mid-air image2023

    • Author(s)
      Yutaro Yano and Naoya Koizumi
    • Organizer
      ICAT-EGVE2023
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 空中像結像平面にある実物体の形状情報を活かしたインタラクションの提案2023

    • Author(s)
      安藤 将平,小泉 直也
    • Organizer
      エンタテインメントコンピューティングシンポジウム2023
    • Related Report
      2023 Annual Research Report
  • [Presentation] Prototype to Control a Mid-air CG Character Using Motion Capture Data of a Plush Toy2022

    • Author(s)
      Miyu Fukuoka, Shohei Ando, Naoya Koizumi
    • Organizer
      ICAT-EGVE 2022 - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments - Posters and Demos
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Floagent: Interaction with Mid-Air Image via Hidden Sensors2022

    • Author(s)
      Shohei Ando, Naoya Koizumi
    • Organizer
      SIGGRAPH Asia 2022 Emerging Technologies
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] 人形モーションキャプチャを用いた空中像キャラクターの操作2022

    • Author(s)
      福岡美結,安藤将平,小泉直也
    • Organizer
      第27回日本バーチャルリアリティ学会大会
    • Related Report
      2022 Research-status Report
  • [Presentation] ホットミラーによる赤外光反射を用いた空中像インタラクション手法の提案2022

    • Author(s)
      安藤 将平,小泉 直也.
    • Organizer
      第64回 情報処理学会エンタテインメントコンピューティング研究会
    • Related Report
      2022 Research-status Report
  • [Presentation] 各種再帰透過光学系を用いた空中カメラで撮影可能な範囲2021

    • Author(s)
      安藤 将平, 小泉 直也
    • Organizer
      第26回日本バーチャルリアリティ学会大会
    • Related Report
      2021 Research-status Report
  • [Presentation] Application of mid-air image: Interaction Technology.2021

    • Author(s)
      Naoya Koizumi
    • Organizer
      映像情報メディア学会2021年冬季大会 KIBME/ITE Joint Session ~ AR/MR/XR Technology ~
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research / Invited
  • [Remarks] Floagent

    • URL

      https://www.media.lab.uec.ac.jp/?page_id=3270

    • Related Report
      2023 Annual Research Report
  • [Remarks] ICAT-EGVE 2022でBest Demo Awardを受賞

    • URL

      https://www.uec.ac.jp/news/prize/2022/20221214_5011.html

    • Related Report
      2022 Research-status Report
  • [Patent(Industrial Property Rights)] 空中像インタラクティブ装置2022

    • Inventor(s)
      安藤 将平, 小泉 直也
    • Industrial Property Rights Holder
      安藤 将平, 小泉 直也
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2022-093116
    • Filing Date
      2022
    • Related Report
      2022 Research-status Report

URL: 

Published: 2021-07-13   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi