• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Dexterous VR interaction and user body support through coordinated robotic physical props

Research Project

Project/Area Number 21H03473
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 61020:Human interface and interaction-related
Research InstitutionTohoku University

Principal Investigator

Takashima Kazuki  東北大学, 電気通信研究所, 准教授 (60533461)

Co-Investigator(Kenkyū-buntansha) 伊藤 雄一  青山学院大学, 理工学部, 教授 (40359857)
藤田 和之  東北大学, 電気通信研究所, 助教 (70835545)
Project Period (FY) 2021-04-01 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥17,420,000 (Direct Cost: ¥13,400,000、Indirect Cost: ¥4,020,000)
Fiscal Year 2023: ¥5,070,000 (Direct Cost: ¥3,900,000、Indirect Cost: ¥1,170,000)
Fiscal Year 2022: ¥6,110,000 (Direct Cost: ¥4,700,000、Indirect Cost: ¥1,410,000)
Fiscal Year 2021: ¥6,240,000 (Direct Cost: ¥4,800,000、Indirect Cost: ¥1,440,000)
Keywordsバーチャルリアリティ / ロボット群 / ヒューマンコンピュータインタラクション / 触覚提示 / リダイレクション / 人間工学 / ロボット型タッチスクリーン / ロボット型プロップ / 空中インタラクション / タッチスクリーン / ロボット
Outline of Research at the Start

現在のVR技術を用いた空間では,インタラクション中に身体の部位を適切に支持するための機構が存在しないため,姿勢が安定し難く腕の疲労蓄積が早いという問題がる.本研究では,環境側に配置した自律動作物理デバイス群を活用して,VRユーザの作業に必要な身体支持や作業面を動的に提供することで,VRの高い動的性を阻害せずに,高精度で安定なインタラクションを導く新たなVRシステムを実現する.本研究では,自律動作デバイス群の開発,VRユーザの行動予測,デバイス群の高精度配置アルゴリズムの開発,および,精密なインタラクションの評価を実施し,ポストコロナ時代の新たなオフィス環境の実現に寄与する.

Outline of Final Research Achievements

This research aimed to solve the problems of arm fatigue and deterioration of input accuracy during aerial interactions in room-scale VR by using a variety of robotic props. Specifically, we developed technology to have a robot circle around a user wearing an HMD and provide physical support to the user when physical instructions or highly accurate input is required. We then applied this to multiple robots and developed technology to present various tactile sensations at multiple points in room-scale VR. Furthermore, we demonstrated that the advantages of a large robot-type device can be utilized to apply this technology to control the orientation of the body in room-scale VR. Through experiments, we clarified that in both cases, physical support for VR users reduces fatigue and improves the sense of realism.

Academic Significance and Societal Importance of the Research Achievements

より柔軟な働き方を実現するためルームスケールVRは未来のオフィスとして期待されてきた.しかしながら,現在のVRやHMD(頭部搭載ディスプレイ)のセットアップはコンパクトである一方で人の身体を支えることができず,本来感じるはずの触覚がない,または人が動ける空間が狭すぎて広大なVR空間を直感的に移動できない,などかなり原始的な課題が残っていた.本研究では,それらを一つずつ解決を試みたものである.依然としてロボットは工作プロトタイプの域であるが,基本的な仕様や性能や効果を本研究で確認できたことは学術的意義はもとより,VRの社会実装に向けて重要な貢献を示せたと考える.

Report

(4 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Annual Research Report
  • 2021 Annual Research Report
  • Research Products

    (9 results)

All 2024 2023 2022

All Journal Article (4 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 4 results,  Open Access: 4 results) Presentation (5 results) (of which Int'l Joint Research: 3 results)

  • [Journal Article] RedirectedDoors+: Door-Opening Redirection with Dynamic Haptics in Room-Scale VR2024

    • Author(s)
      Hoshikawa Yukai、Fujita Kazuyuki、Takashima Kazuki、Fjeld Morten、Kitamura Yoshifumi
    • Journal Title

      IEEE Transactions on Visualization and Computer Graphics

      Volume: 30 Issue: 5 Pages: 2276-2286

    • DOI

      10.1109/tvcg.2024.3372105

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] UbiSurface: A Robotic Touch Surface for Supporting Mid-air Planar Interactions in Room-Scale VR2023

    • Author(s)
      Gomi Ryota、Takashima Kazuki、Onishi Yuki、Fujita Kazuyuki、Kitamura Yoshifumi
    • Journal Title

      Proceedings of the ACM on Human-Computer Interaction

      Volume: 7 Issue: ISS Pages: 376-397

    • DOI

      10.1145/3626479

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] WaddleWalls: Room-scale Interactive Partitioning System using a Swarm of Robotic Partitions2022

    • Author(s)
      Yuki Onishi, Kazuki Takashima, Shoi Higashiyama, Kazuyuki Fujita, Yoshifumi Kitamura
    • Journal Title

      Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (UIST '22)

      Volume: NA Pages: 1-15

    • DOI

      10.1145/3526113.3545615

    • Related Report
      2022 Annual Research Report 2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] HandyGaze: A Gaze Tracking Technique for Room-Scale Environments using a Single Smartphone2022

    • Author(s)
      Nagai Takahiro、Fujita Kazuyuki、Takashima Kazuki、Kitamura Yoshifumi
    • Journal Title

      Proceedings of the ACM on Human-Computer Interaction

      Volume: 6 Issue: ISS Pages: 143-160

    • DOI

      10.1145/3567715

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] VR空間の地面の高低を提示可能な伸縮杖型デバイス2023

    • Author(s)
      上出 千隼,高嶋 和毅,藤田 和之,北村 喜文
    • Organizer
      情報処理学会インタラクション2024
    • Related Report
      2023 Annual Research Report
  • [Presentation] Demonstration of RedirectedDoors: Manipulating User’s Orientation while Opening Doors in Virtual Reality2022

    • Author(s)
      Yukai Hoshikawa, Kazuyuki Fujita, Kazuki Takashima, Morten Fjeld, Yoshifumi Kitamura
    • Organizer
      SA '22: SIGGRAPH Asia 2022 XR
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Triangular Actuating Device Stand that Dynamically Adjusts Mobile Screen’s Position2022

    • Author(s)
      Ryota Gomi, Kazuki Takashima, Kazuyuki Fujita, Yoshifumi Kitamura
    • Organizer
      Adjunct Proc. of the 35th Annual ACM Symposium on User Interface Software and Technology (UIST '22)
    • Related Report
      2022 Annual Research Report 2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] TetraForce: スマートフォンの表裏両面に対する垂直・剪断方向の力を入力可能な磁気式インタフェース2022

    • Author(s)
      土田太一,藤田和之,池松香,Sayan Sarcar,高嶋和毅,北村喜文
    • Organizer
      第30回インタラクティブシステムとソフトウェアに関するワークショップ (WISS '22)
    • Related Report
      2022 Annual Research Report
  • [Presentation] Demonstration of RedirectedDoors: Manipulating User’s Orientation while Opening Doors in Virtual Reality2022

    • Author(s)
      Yukai Hoshikawa, Kazuyuki Fujita, Kazuki Takashima, Morten Fjeld, Yoshifumi Kitamura
    • Organizer
      SA '22: SIGGRAPH Asia 2022 XR(
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research

URL: 

Published: 2021-04-28   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi