Development of quantitative evaluation method of pseudo-sensation of body movement and generation method of various sensations of movement

• Project/Area Number: 18H03283
• Research Category: Grant-in-Aid for Scientific Research (B)
• Allocation Type: Single-year Grants
• Section: 一般
• Review Section: Basic Section 61020:Human interface and interaction-related
• Research Institution: The University of Tokyo (2019-2021); NTT Communication Science Laboratories (2018)
• Principal Investigator: Amemiya Tomohiro 東京大学, 大学院情報理工学系研究科, 准教授 (70396175)
• Co-Investigator(Kenkyū-buntansha): 池井 寧 東京大学, 大学院情報理工学系研究科, 特任教授 (00202870)
• Project Period (FY): 2018-04-01 – 2021-03-31
• Project Status: Completed (Fiscal Year 2021)
• Budget Amount: ¥16,900,000 (Direct Cost: ¥13,000,000、Indirect Cost: ¥3,900,000); Fiscal Year 2020: ¥6,500,000 (Direct Cost: ¥5,000,000、Indirect Cost: ¥1,500,000); Fiscal Year 2019: ¥6,370,000 (Direct Cost: ¥4,900,000、Indirect Cost: ¥1,470,000); Fiscal Year 2018: ¥4,030,000 (Direct Cost: ¥3,100,000、Indirect Cost: ¥930,000)
• Keywords: 歩行感覚 / 触覚 / 身体感覚 / 身体近傍空間 / 錯覚 / 多感覚統合 / 前庭感覚 / VR / 体性感覚 / 多感覚情報

Outline of Final Research Achievements

In this study, we established a method to create an experience of illusory body movement without using any physical movement of the body or motor commands to muscles. The method can modulate bodily sensations through sensory interaction and adjusts gains with sensory information generated by actual body movement. We also proposed an objective index for the magnitude of the effect of the pseudo-movement generated by the presentation of vibration stimuli to the soles using objective indices such as the reduction of reaction time due to interactions between senses in the peripersonal space near the body. We compared the pseudo-walking sensation produced by vertical swaying and turning with a motion platform and the rating of VR sickness.

Academic Significance and Societal Importance of the Research Achievements

本研究成果はこれまで主観的評定にとどまっていた疑似歩行感覚を，客観的指標である反応時間で評価できる可能性を示したものである．臨場感の高いVR システムを構築する際に，臨場感やリアリティが高まれば，主観的な評定では天井効果や個人差の影響によって明確な評価を困難になってしまうため，本研究の成果のように客観的な指標でも評価することができれば，さまざまな側面から最適な感覚刺激を設計する手がかりとなりうる．また，モーションプラットフォームを用いて受動的な状況で擬似的な身体感覚を生成する研究成果は，運動機能障害を有するユーザにも多様な移動感を生成する可能性を提供するものである．

Research Products

• [Journal Article] Virtual Walking With Omnidirectional Movies and Foot Vibrations: Scene-Congruent Vibrations Enhance Walking-Related Sensations and Ground Material Perceptions (2021)
  • Author(s): Nakamura Junya、Matsuda Yusuke、Amemiya Tomohiro、Ikei Yasushi、Kitazaki Michiteru
  • Journal Title: IEEE Access Volume: 9 Pages: 168107-168120
  • DOI: 10.1109/access.2021.3136557
  • Peer Reviewed / Open Access
• [Journal Article] Pseudo-sensation of walking generated by passive whole-body motions in heave and yaw directions (2020)
  • Author(s): Tomohiro Amemiya, Michiteru Kitazaki, Yasushi Ikei
  • Journal Title: IEEE Transactions on Haptics Volume: 13 Issue: 1 Pages: 80-86
  • DOI: 10.1109/toh.2020.2965937
  • Peer Reviewed / Open Access
• [Journal Article] Passive whole-body motions for generating pseudo-sensation of walking (2019)
  • Author(s): 雨宮智浩, 北崎充晃, 池井寧
  • Journal Title: Transactions of the Virtual Reality Society of Japan Volume: 24 Issue: 4 Pages: 371-376
  • DOI: 10.18974/tvrsj.24.4_371
  • NAID: 130007777838
  • ISSN: 1344-011X, 2423-9593
  • Peer Reviewed / Open Access
• [Journal Article] Remapping Peripersonal Space by Using Foot-Sole Vibrations Without Any Body Movement (2019)
  • Author(s): Tomohiro Amemiya, Yasushi Ikei, Michiteru Kitazaki
  • Journal Title: Psychological Science Volume: 30 Issue: 10 Pages: 1522-1532
  • DOI: 10.1177/0956797619869337
  • Peer Reviewed
• [Journal Article] Virtual walking sensation by prerecorded oscillating optic flow and synchronous foot vibration (2019)
  • Author(s): Michiteru Kitazaki, Takeo Hamada, Katsuya Yoshiho, Ryota Kondo, Tomohiro Amemiya, Koichi Hirota, Yasushi Ikei
  • Journal Title: i-Perception Volume: 10 Issue: 5 Pages: 1-14
  • DOI: 10.1177/2041669519882448
  • Peer Reviewed / Open Access
• [Journal Article] Concept of bodily reliving experience and prototype implementation―Sharing past experiences of a walk/run by multisensory motion presentation (2019)
  • Author(s): 池井寧, 広田光一, 阿部浩二, 雨宮智浩, 佐藤誠, 北崎充晃
  • Journal Title: Transactions of the Virtual Reality Society of Japan Volume: 24 Issue: 2 Pages: 153-164
  • DOI: 10.18974/tvrsj.24.2_153
  • NAID: 130007670309
  • ISSN: 1344-011X, 2423-9593
  • Peer Reviewed / Open Access
• [Presentation] VR基盤に向けて (2021)
  • Author(s): 雨宮智浩
  • Organizer: サービスVRシンポジウム ～サービスVRの挑戦～
  • Invited
• [Presentation] Virtual Walking Generator from Omnidirectional Video with Ground-dependent Foot Vibrations (2021)
  • Author(s): Junya Nakamura,Yusuke Matsuda,Tomohiro Amemiya,Yasushi Ikei,Michiteru Kitazaki
  • Organizer: IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops
  • Int'l Joint Research
• [Presentation] Feedback of Rotational Sensation Experienced by Body for Immersive Telepresence (2021)
  • Author(s): Vibol Yem,Tsubasa Morita,Tomohiro Amemiya,Michiteru Kitazaki,Yasushi Ikei
  • Organizer: SIGGRAPH 2021: Special Interest Group on Computer Graphics and Interactive Techniques Conference
  • Int'l Joint Research
• [Presentation] Novel Motion Display for Virtual Walking (2021)
  • Author(s): Minori Unno,Ken Yamaoka,Vibol Yem,Tomohiro Amemiya,Michiteru Kitazaki,Yasushi Ikei
  • Organizer: Human Interface and the Management of Information. Information-Rich and Intelligent Environments - Thematic Area
  • Int'l Joint Research
• [Presentation] Asymmetric Gravitational Oscillation on Fingertips Increased the Perceived Heaviness of a Pinched Object (2021)
  • Author(s): Tomohiro Amemiya
  • Organizer: Human Interface and the Management of Information. Information Presentation and Visualization - Thematic Area
  • Int'l Joint Research
• [Presentation] 全天球動画の地面質感を考慮した足裏振動によるバーチャル歩行感覚 (2021)
  • Author(s): 中村 純也,松田 勇祐,雨宮 智浩,池井 寧,北崎 充晃
  • Organizer: 日本VR学会第26回大会
• [Presentation] No Motion VRの挑戦 (2021)
  • Author(s): 雨宮 智浩
  • Organizer: 日本VR学会第26回大会オーガナイズドセッション
  • Invited
• [Presentation] 歩行VRにおける旋回歩行表現のためのヨー回転前庭刺激の効果に関する研究 (2021)
  • Author(s): 海野 みのり,YEM VIBOL,雨宮 智浩,北崎 充晃,佐藤 誠,池井 寧
  • Organizer: 日本VR学会第26回大会
• [Presentation] VR空間とアバターの構築技術とVRシリーズ書籍 (2021)
  • Author(s): 池井 寧,北崎 充晃,大下 岳志, 雨宮 智浩
  • Organizer: 日本VR学会第26回大会オーガナイズドセッション
  • Invited
• [Presentation] 身体性を揺さぶる感覚運動インターフェース技術 (2020)
  • Author(s): 雨宮智浩
  • Organizer: 東京大学オープンイノベーションフォーラム「ロボティクスの新展開」
  • Invited
• [Presentation] アバタ化コミュニケーションの事例報告 (2020)
  • Author(s): 雨宮智浩
  • Organizer: 日本VR学会第25回大会オーガナイズドセッション
  • Invited
• [Presentation] 身体感覚インタフェースのデザイン ～ぶるなび誕生秘話とVR応用展開～ (2020)
  • Author(s): 雨宮智浩
  • Organizer: 自動車技術会ヒューマンファクター部門委員会
  • Invited
• [Presentation] Perception of Walking Self-body Avatar Enhances Virtual-walking Sensation (2020)
  • Author(s): Yusuke Matsuda,Junya Nakamura,Tomohiro Amemiya,Yasushi Ikei,Michiteru Kitazaki
  • Organizer: 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops
  • Int'l Joint Research
• [Presentation] Resizing of the peripersonal space for the seated for different step frequencies of vibrations at the soles. (2020)
  • Author(s): Tomohiro Amemiya
  • Organizer: 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops
  • Int'l Joint Research
• [Presentation] Virtual Reality Applications Using Pseudo-attraction Force by Asymmetric Oscillation (2020)
  • Author(s): Tomohiro Amemiya
  • Organizer: Human Interface and the Management of Information. Designing Information - Thematic Area
  • Int'l Joint Research
• [Presentation] Sense of Agency in Drum Trainer with Multiple Sensation Feedback (2020)
  • Author(s): Vibol Yem,Fumiya Miyashita,Tomohiro Amemiya,Michiteru Kitazaki,Yasushi Ikei
  • Organizer: SIGGRAPH 2020: Special Interest Group on Computer Graphics and Interactive Techniques Conference
  • Int'l Joint Research
• [Presentation] 搭乗感覚共有システムにおけるVR酔いの低減手法に関する研究 (2020)
  • Author(s): 森田 翼,梨木 玲穏,ヤェム ヴィボル,雨宮 智浩,池井 寧
  • Organizer: 日本VR学会第25回大会
• [Presentation] 旋回歩行感覚生成のための前庭刺激の提示手法 (2020)
  • Author(s): 海野 みのり,清水 広一,雨宮 智浩,北崎 充晃,YEM VIBOL,池井 寧
  • Organizer: 日本VR学会第25回大会
• [Presentation] 多感覚フィードバック提示ドラム訓練における運動主体感の調査 (2020)
  • Author(s): YEM VIBOL,宮下 史也,雨宮 智浩,北崎 充晃,池井 寧
  • Organizer: 日本VR学会第25回大会
• [Presentation] 下肢運動提示による旋回歩行感覚特性に関する研究 (2020)
  • Author(s): 山岡 憲太郎,YEM VIBOL,雨宮 智浩,北崎 充晃,佐藤 誠,池井 寧
  • Organizer: 日本VR学会第25回大会
• [Presentation] 実空間歩行における視覚刺激の速度操作と歩行速度変化の関係性 (2020)
  • Author(s): 谷崎 充,松本 啓吾,葛岡 英明,雨宮 智浩,廣瀬 通孝
  • Organizer: 日本VR学会第25回大会
• [Presentation] 歩行感覚生成のための腕振り運動と身体姿勢に関する研究 (2020)
  • Author(s): 末田 岳,ヤェム ヴィボル,雨宮 智浩,北崎 充晃,佐藤 誠,池井 寧
  • Organizer: 日本VR学会第25回大会
• [Presentation] VR applications using pseudo-attraction force by asymmetric oscillation (2020)
  • Author(s): Tomohiro Amemiya
  • Organizer: Proceedings of HCII 2020
  • Int'l Joint Research
• [Presentation] Virtual turning walking by passive arm swing (2020)
  • Author(s): Gaku Sueta, Naoyuki Saka, Vibol Yem, Tomohiro Amemiya, Michiteru Kitazaki, Makoto Sato, Yasushi Ikei
  • Organizer: Proceedings of HCII 2020
  • Int'l Joint Research
• [Presentation] Resizing of the peripersonal space for the seated for different step frequencies of vibrations at the soles (2020)
  • Author(s): Tomohiro Amemiya
  • Organizer: Proceedings of 1st IEEE Workshop on Seated Virtual Reality at IEEE VR 2020
  • Int'l Joint Research
• [Presentation] TwinCam Go: Proposal of Vehicle-Ride Sensation Sharing with Stereoscopic 3D Visual Perception and Vibro-Vestibular Feedback for Immersive Remote Collaboration (2019)
  • Author(s): Vibol Yem, Reon Nashiki, Tsubasa Morita, Fumiya Miyashita, Tomohiro Amemiya, Yasushi Ikei
  • Organizer: Proceedings of ACM SIGGRAPH Asia 2019
  • Int'l Joint Research
• [Presentation] Generation of Turning Walking Sensation by a Vestibular Display (2019)
  • Author(s): Minori Unno, Kouichi Shimizu, Tomohiro Amemiya, Michiteru Kitazaki, Vibol Yem, Yasushi Ikei
  • Organizer: Proceedings of the 17th International Conference on Virtual-Reality Continuum and its Applications in Industry (VRCAI 2019)
  • Int'l Joint Research
• [Presentation] Rendering of Walking Sensation for a Sitting User by Lower Limb Motion Display (2019)
  • Author(s): Kentaro Yamaoka, Ren Koide, Tomohiro Amemiya, Michiteru Kitazaki, Vibol Yem, Yasushi Ikei
  • Organizer: Proceedings of International Conference on Artificial Reality and Telexistence & Eurographics Symposium on Virtual Environments (ICAT-EGVE 2019)
  • Int'l Joint Research
• [Presentation] Footstep Sound for Suppression of VR Sickness and Promotion of Sense of Agency (2019)
  • Author(s): Reon Nashiki, Vibol Yem, Tomohiro Amemiya, Yasushi Ikei
  • Organizer: Proceedings of ICAT-EGVE
  • Int'l Joint Research
• [Presentation] Generation of Walking Sensation by Upper Limb Motion (2019)
  • Author(s): Gaku Sueta, Naoyuki Saka, Vibol Yem, Tomohiro Amemiya, Michiteru Kitazaki, Makoto Sato, Yasushi Ikei
  • Organizer: Proceedings of ICAT-EGVE
  • Int'l Joint Research
• [Presentation] Airflow Presentation Method for Turning Motion Feedback in VR Environment (2019)
  • Author(s): Yujin Suzuki, Vibol Yem, Koichi Hirota, Tomohiro Amemiya, Michiteru Kitazaki, Yasushi Ikei
  • Organizer: Proceedings of ICAT-EGVE
  • Int'l Joint Research
• [Presentation] Vehicle-Ride Sensation Sharing for Immersive Remote Collaboration with Vestibular Haptic Chair to reduce VR Sickness (2019)
  • Author(s): Tsubasa Morita, Vibol Yem, Tomohiro Amemiya, Yasushi Ikei
  • Organizer: Proceedings of ICAT-EGVE
  • Int'l Joint Research
• [Presentation] Visual Presentation For Sports Skill Learning in VR (2019)
  • Author(s): Fumiya Miyashita, Tomohiro Amemiya, Michiteru Kitazaki, Keiko Kasamatsu, Vibol Yem, Yasushi Ikei
  • Organizer: Proceedings of ICAT-EGVE
  • Int'l Joint Research
• [Presentation] VR Sickness Reduction in Stereoscopic Video Streaming System 'TwinCam' for a Remote Experience (2019)
  • Author(s): Ryunosuke Yagi, Toi Fujie, Tomohiro Amemiya, Michiteru Kitazaki, Vibol Yem, Yasushi Ikei
  • Organizer: Proceedings of ICAT-EGVE
  • Int'l Joint Research
• [Presentation] System for Body Motion Capture While Moving in Large Area (2019)
  • Author(s): Yusuke Yuasa, Hideki Tamura, Vibol Yem, Tomohiro Amemiya, Michiteru Kitazaki, Yasushi Ikei
  • Organizer: Proceedings of ICAT-EGVE
  • Int'l Joint Research
• [Presentation] Rendering of Virtual Walking Sensation by a Vestibular Display (2019)
  • Author(s): Koichi Shimizu, Vibol Yem, Kentaro Yamaoka, Gaku Sueta, Tomohiro Amemiya, Michiteru Kitazaki, Yasushi Ikei
  • Organizer: Proceedings of HCII 2019
  • Int'l Joint Research
• [Presentation] Resizing of the peripersonal space by vibrations at the soles or forearms (2019)
  • Author(s): Tomohiro Amemiya, Michiteru Kitazaki, Yasushi Ikei
  • Organizer: Proceedings of IEEE World Haptics 2019
  • Int'l Joint Research
• [Presentation] Live Stereoscopic 3D Image with Constant Capture Direction of 360 Cameras for High-Quality Visual Telepresence (2019)
  • Author(s): Yasushi Ikei, Vibol Yem, Kento Tashiro, Toi Fujie, Tomohiro Amemiya, Michiteru Kitazaki
  • Organizer: Proceedings of IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR 2019)
  • Int'l Joint Research
• [Presentation] Leg-jack: generation of the sensation of walking by electrical and kinesthetic stimuli to the lower limbs (2018)
  • Author(s): Kaneko Hirofumi、Amemiya Tomohiro、Yem Vibol、Ikei Yasushi、Hirota Koichi、Kitazaki Michiteru
  • Organizer: ACM SIGGRAPH Asia 2018 Emerging Technologies
  • Int'l Joint Research
• [Presentation] FiveStar VR: shareable travel experience through multisensory stimulation to the whole body (2018)
  • Author(s): Shimizu Koichi、Sato Makoto、Hirota Koichi、Kitazaki Michiteru、Sueta Gaku、Yamaoka Kentaro、Sawamura Kazuki、Suzuki Yujin、Yoshida Keisuke、Yem Vibol、Ikei Yasushi、Amemiya Tomohiro、Sato Makoto、Hirota Koichi、Michiteru Kitazaki
  • Organizer: ACM SIGGRAPH Asia 2018 Virtual & Augmented Reality
  • Int'l Joint Research
• [Presentation] Haptic Interface Technologies Using Perceptual Illusions (2018)
  • Author(s): Amemiya Tomohiro
  • Organizer: 20th International Conference on Human-Computer Interaction
  • Int'l Joint Research
• [Presentation] Airflow for Body Motion Virtual Reality (2018)
  • Author(s): Kurosawa Masato、Ikei Yasushi、Suzuki Yujin、Amemiya Tomohiro、Hirota Koichi、Kitazaki Michiteru
  • Organizer: 20th International Conference on Human-Computer Interaction
  • Int'l Joint Research
• [Presentation] Vestibular Display for Walking Sensation in a Virtual Space (2018)
  • Author(s): Shimizu Koichi、Ikei Yasushi、Amemiya Tomohiro、Hirota Koichi、Kitazaki Michiteru
  • Organizer: 20th International Conference on Human-Computer Interaction
  • Int'l Joint Research
• [Book] ＶＲ／ＡＲ技術における感覚の提示、拡張技術と最新応用事例 (2021)
  • Author(s): 執筆者:64名、技術情報協会
  • Total Pages: 576
  • Publisher: 技術情報協会
  • ISBN: 4861048508
• [Book] オンライン・ファースト (2020)
  • Author(s): 東京大学情報理工学系研究科
  • Total Pages: 290
  • Publisher: 東京大学出版会
  • ISBN: 9784130634571
• [Book] テクノロジー・ロードマップ2021-2030 全産業編2020 (2020)
  • Author(s): 出川通，他92名
  • Total Pages: 608
  • Publisher: 日経BP
  • ISBN: 9784296107353
• [Patent(Industrial Property Rights)] 情報提示システム、およびプログラム (2019)
  • Inventor(s): 雨宮智浩
  • Industrial Property Rights Holder: 雨宮智浩
  • Industrial Property Rights Type: 特許
  • Industrial Property Number: 2019-027311
  • Filing Date: 2019