• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Elucidation of the influence of body appearance in the integration of vision and proprioception and its application

Research Project

Project/Area Number 20K21801
Research Category

Grant-in-Aid for Challenging Research (Exploratory)

Allocation TypeMulti-year Fund
Review Section Medium-sized Section 61:Human informatics and related fields
Research InstitutionThe University of Tokyo

Principal Investigator

Narumi Takuji  東京大学, 大学院情報理工学系研究科, 准教授 (70614353)

Project Period (FY) 2020-07-30 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥6,370,000 (Direct Cost: ¥4,900,000、Indirect Cost: ¥1,470,000)
Fiscal Year 2021: ¥2,990,000 (Direct Cost: ¥2,300,000、Indirect Cost: ¥690,000)
Fiscal Year 2020: ¥3,380,000 (Direct Cost: ¥2,600,000、Indirect Cost: ¥780,000)
Keywordsバーチャルリアリティ / 多感覚統合 / アバタ / 身体所有感 / 行為主体感
Outline of Research at the Start

本研究の目的は,バーチャルリアリティ(VR)環境で操るアバタの見た目を変化させる実験から,身体の見た目が視覚と体性感覚の統合に与える影響とその機序を明らかにすることである.視覚と体性感覚の統合におけるずれの問題を扱う領野は広い.ずれが意識に上らない閾値が調べられてきた一方,閾値を操作して多感覚統合を促進/抑制する手法は未踏である.そこでアバタの見た目が視覚と体性感覚の統合に与える影響の解明から応用まで狙う挑戦的研究として,アバタの見た目の変化による多感覚統合の閾値の変化とその機序の検証,多感覚統合を促進/抑制するアバタ設計法の確立に取り組む.

Outline of Final Research Achievements

In this study, we report for the first time that the anthropomorphism of avatars in virtual reality (VR) affects the threshold for detecting the misalignment of visual and proprioceptive senses, and explore the mechanism by which body appearance changes the multisensory integration of vision and proprioception. Utilizing the obtained knowledge, we proposed a method that places multiple hand avatars with different characteristics in a virtual environment and switches between them with the gaze, as a method that enables intuitive and accurate object manipulation in VR, taking multisensory integration into consideration. The effectiveness of the proposed method is demonstrated by suggesting that efficiency and accuracy of object manipulation can be improved by using different hand avatars with different sizes, appearances, movement gains, etc. depending on the work area.

Academic Significance and Societal Importance of the Research Achievements

本研究の学術的意義は,視覚を通じて知る手の位置と体性感覚を通じて知る手の位置を統合して尤もらしい身体の位置を推定する多感覚統合の過程において,身体の見かけという位置とは関係のない情報が視覚と体性感覚の統合のされ方に影響することをバーチャルリアリティを使った実験によって世界で初めて示し,それが身体所有感ではなく身体姿勢情報の尤度を介して身体定位に影響するためであることを示唆し,身体知覚研究に新たな知見を提供した点にある.さらに,この知見を活かして,さまざまな産業で活用が広がっているバーチャルリアリティ向けに直観的かつ作業精度の高い新たなユーザインタフェースを提案した点で社会的意義も高い.

Report

(5 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Research-status Report
  • 2021 Research-status Report
  • 2020 Research-status Report
  • Research Products

    (52 results)

All 2023 2022 2021 2020 Other

All Int'l Joint Research (1 results) Journal Article (11 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 10 results,  Open Access: 10 results) Presentation (39 results) (of which Int'l Joint Research: 14 results,  Invited: 14 results) Book (1 results)

  • [Int'l Joint Research] INRIA(フランス)

    • Related Report
      2020 Research-status Report
  • [Journal Article] The left-right reversed visual feedback of the hand affects multisensory interaction within peripersonal space2023

    • Author(s)
      Mine Daisuke、Narumi Takuji
    • Journal Title

      Attention, Perception, & Psychophysics

      Volume: 86 Issue: 1 Pages: 285-294

    • DOI

      10.3758/s13414-023-02788-0

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Improving a Sense of Flying up and down in a Standing Position by Foot-Sole Vibrations in Virtual Environments2022

    • Author(s)
      大倉 直也、松本 啓吾、鳴海 拓志、葛岡 英明、雨宮 智浩
    • Journal Title

      Transactions of the Virtual Reality Society of Japan

      Volume: 27 Issue: 4 Pages: 369-379

    • DOI

      10.18974/tvrsj.27.4_369

    • ISSN
      1344-011X, 2423-9593
    • Year and Date
      2022-12-28
    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Looking-around Interface for Seated VR Using Rotational Gain and Force Feedback2022

    • Author(s)
      近藤 哲太、平尾 悠太朗、鳴海 拓志、小川 奈美
    • Journal Title

      Transactions of the Virtual Reality Society of Japan

      Volume: 27 Issue: 1 Pages: 65-75

    • DOI

      10.18974/tvrsj.27.1_65

    • ISSN
      1344-011X, 2423-9593
    • Year and Date
      2022-03-31
    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Basics of Integrated Perception and its Application to the Multi Sensory Interface2022

    • Author(s)
      大野雅貴・横澤一彦・鳴海拓志
    • Journal Title

      Transactions of the Virtual Reality Society of Japan

      Volume: 27 Issue: 1 Pages: 18-28

    • DOI

      10.18974/tvrsj.27.1_18

    • ISSN
      1344-011X, 2423-9593
    • Year and Date
      2022-03-31
    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Revisiting Walking-in-Place by Introducing Step-Height Control, Elastic Input, and Pseudo-Haptic Feedback2022

    • Author(s)
      Hirao Yutaro、Narumi Takuji、Argelaguet Ferran、Lecuyer Anatole
    • Journal Title

      IEEE Transactions on Visualization and Computer Graphics

      Volume: - Issue: 7 Pages: 1-14

    • DOI

      10.1109/tvcg.2022.3228171

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Sensation of Anteroposterior and Lateral Body Tilt Induced by Electrical Stimulation of Ankle Tendons2022

    • Author(s)
      Takahashi Nozomi、Amemiya Tomohiro、Narumi Takuji、Kuzuoka Hideaki、Hirose Michitaka、Aoyama Kazuma
    • Journal Title

      Frontiers in Virtual Reality

      Volume: 3 Pages: 800884-800884

    • DOI

      10.3389/frvir.2022.800884

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Redirection Controller Using Reinforcement Learning2021

    • Author(s)
      Chang Yuchen、Matsumoto Keigo、Narumi Takuji、Tanikawa Tomohiro、Hirose Michitaka
    • Journal Title

      IEEE Access

      Volume: 9 Pages: 145083-145097

    • DOI

      10.1109/access.2021.3118056

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] バーチャルリアリティによる知覚・運動・認知の変容がバイオメカニクスにもたらす可能性2021

    • Author(s)
      鳴海拓志
    • Journal Title

      整形・災害外科

      Volume: 64

    • Related Report
      2021 Research-status Report
  • [Journal Article] Virtual Co-Embodiment: Evaluation of the Sense of Agency while Sharing the Control of a Virtual Body among Two Individuals2020

    • Author(s)
      Fribourg Rebecca、Ogawa Nami、Hoyet Ludovic、Argelaguet Ferran、Narumi Takuji、Hirose Michitaka、Lecuyer Anatole
    • Journal Title

      IEEE Transactions on Visualization and Computer Graphics

      Volume: - Issue: 10 Pages: 4023-4038

    • DOI

      10.1109/tvcg.2020.2999197

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] The relationship between the body and the environment in the virtual world: The interpupillary distance affects the body size perception2020

    • Author(s)
      Daisuke Mine, Nami Ogawa, Takuji Narumi, and Kazuhiko Yokosawa
    • Journal Title

      PLOS ONE

      Volume: 15 Issue: 4 Pages: e0232290-e0232290

    • DOI

      10.1371/journal.pone.0232290

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Effect of Avatar Appearance on Detection Thresholds for Remapped Hand Movements2020

    • Author(s)
      Nami Ogawa, Takuji Narumi, Michitaka Hirose
    • Journal Title

      IEEE Transactions on Visualization and Computer Graphics

      Volume: - Issue: 7 Pages: 1-1

    • DOI

      10.1109/tvcg.2020.2964758

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access
  • [Presentation] Avatars for Good Drinking: An Exploratory Study of The Effects of Avatar's Body Shape on Beverage Perception2023

    • Author(s)
      Yusuke Koseki, Yusuke Arikawa, Kizashi Nakano, Takuji Narumi
    • Organizer
      SIGGRAPH Asia 2023 Posters
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] TableMorph: Haptic Experience with Movable Tables and Redirection2023

    • Author(s)
      Amane Yamaguchi, Sotaro Yokoi, Keigo Matsumoto, Takuji Narumi
    • Organizer
      SIGGRAPH Asia 2023 Emerging Technologies
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Hitchhiking Hands: Remote Interaction by Switching Multiple Hand Avatars with Gaze2023

    • Author(s)
      Reigo Ban, Keigo Matsumoto, Takuji Narumi
    • Organizer
      SIGGRAPH Asia 2023 Emerging Technologies
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Expansion of Detection Thresholds for Hand Redirection using Noisy Tendon Electrical Stimulation2023

    • Author(s)
      Maki Ogawa, Keigo Matsumoto, Kazuma Aoyama, Takuji Narumi
    • Organizer
      ISMAR2023
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Effect of Avatar Anthropomorphism on Bodily Awareness and Time Estimation in Virtual Reality2023

    • Author(s)
      Sota Mizoguchi, Keigo Matsumoto, Takato Mizuho and Takuji Narumi
    • Organizer
      SAP2023
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 手のヒッチハイク:VRにおける視線を用いた複数バーチャルハンドの切り替え2023

    • Author(s)
      伴 玲吾、松本 啓吾、鳴海 拓志
    • Organizer
      第28回日本バーチャルリアリティ学会大会
    • Related Report
      2023 Annual Research Report
  • [Presentation] バーチャル環境において隣接した2人のアバタによるwe-mode生起の調査2023

    • Author(s)
      李暁トウ、畑田 裕二、鳴海 拓志
    • Organizer
      第28回日本バーチャルリアリティ学会大会
    • Related Report
      2023 Annual Research Report
  • [Presentation] 多感覚統合とバーチャルリアリティ2023

    • Author(s)
      鳴海拓志
    • Organizer
      第3回感覚研究シンポジウム
    • Related Report
      2023 Annual Research Report
    • Invited
  • [Presentation] 感覚間相互作用を活用した五感インタフェースの展開2023

    • Author(s)
      鳴海拓志
    • Organizer
      2023年度フォトニクス技術フォーラム
    • Related Report
      2023 Annual Research Report
    • Invited
  • [Presentation] Effects of Wearing Knee-tightening Devices and Presenting Shear Forces to the Knee on Redirected Walking2023

    • Author(s)
      Gaku Fukui, Takuto Nakamura, Keigo Matsumoto, Takuji Narumi and Hideaki Kuzuoka
    • Organizer
      Augmented Humans 2023
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] 身体変容がもたらす無意識的/意識的自己変容2023

    • Author(s)
      鳴海拓志
    • Organizer
      無意識の知性研究会
    • Related Report
      2022 Research-status Report
    • Invited
  • [Presentation] 五感統合の編集による感覚と自己のデザイン2023

    • Author(s)
      鳴海拓志
    • Organizer
      五感統合とnew essential-分子・認知・工学の融合が導く未来のウェルビーイング-
    • Related Report
      2022 Research-status Report
    • Invited
  • [Presentation] Studying the Role of Self and External Touch in the Appropriation of Dysmorphic Hands2022

    • Author(s)
      Antonin Cheymol, Rebecca Fribourg, Nami Ogawa, Anatole Lecuyer, Yutaro Hirao, Takuji Narumi, Ferran Argelaguet Sanz, Jean-Marie Normand
    • Organizer
      ISMAR2022
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] 身体所有感に着目したリダイレクテッドハンドの知覚閾値の拡大可能性の検証2022

    • Author(s)
      小川真輝,松本啓吾,鳴海 拓志
    • Organizer
      第27回日本バーチャルリアリティ学会大会
    • Related Report
      2022 Research-status Report
  • [Presentation] VRにおけるpseudo-hapticsの拡張を目的とした腱振動の活用2022

    • Author(s)
      平尾悠太朗,雨宮智浩,鳴海拓志,Argelaguet Ferran,Lecuyer Anatole
    • Organizer
      第27回日本バーチャルリアリティ学会大会
    • Related Report
      2022 Research-status Report
  • [Presentation] 膝におけるハンガー反射による歩行誘導の研究2022

    • Author(s)
      福井岳,中村拓人,松本啓吾,鳴海拓志,葛岡英明
    • Organizer
      第27回日本バーチャルリアリティ学会大会
    • Related Report
      2022 Research-status Report
  • [Presentation] 前庭電気刺激を用いた着座姿勢における疑似歩行感覚の生起2022

    • Author(s)
      小山大嘉,青山一真,鳴海拓志,葛岡英明,雨宮智浩
    • Organizer
      第27回日本バーチャルリアリティ学会大会
    • Related Report
      2022 Research-status Report
  • [Presentation] 乳様突起への骨伝導振動刺激が上下ベクションに与える効果の検証2022

    • Author(s)
      近藤哲太,平尾悠太朗,鳴海拓志,雨宮智浩
    • Organizer
      第27回日本バーチャルリアリティ学会大会
    • Related Report
      2022 Research-status Report
  • [Presentation] アバターによる身体拡張が変える人間と社会2022

    • Author(s)
      鳴海拓志
    • Organizer
      マルチメディア推進フォーラム
    • Related Report
      2022 Research-status Report
    • Invited
  • [Presentation] アバタの生態系 われわれはどこから来てどこへ向かうのか2022

    • Author(s)
      鳴海拓志
    • Organizer
      バーチャル学会2022
    • Related Report
      2022 Research-status Report
    • Invited
  • [Presentation] Designing Cross-modal Interfaces Based on The Mechanism of Multi-sensory Integration2022

    • Author(s)
      Takuji Narumi
    • Organizer
      The 29th International Display Workshops
    • Related Report
      2022 Research-status Report
    • Invited
  • [Presentation] Relationship Between the Sensory Processing Patterns and the Detection Threshold of Curvature Gain2022

    • Author(s)
      Keigo Matsumoto, Takuji Narumi
    • Organizer
      IEEE VR 2022
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] 腱電気刺激と視覚的斜面提示が及ぼす地面の傾斜感覚への効果2022

    • Author(s)
      高橋希実,雨宮智浩,松本啓吾,鳴海拓志,葛岡英明,廣瀬通孝,青山一真
    • Organizer
      MVE研究会
    • Related Report
      2021 Research-status Report
  • [Presentation] Redirected Walking Using Noisy Galvanic Vestibular Stimulation2021

    • Author(s)
      Keigo Matsumoto, Kazuma Aoyama, Takuji Narumi, Hideaki Kuzuoka
    • Organizer
      ISMAR2021
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Perception of Illusory Body Tilt Induced by Electrical Tendon Stimulation2021

    • Author(s)
      Nozomi Takahashi, Tomohiro Amemiya, Takuji Narumi, Hideaki Kuzuoka, Michitaka Hirose, Kazuma Aoyama
    • Organizer
      HCI International 2021
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] 身体融合時の動的な寄与率制御による行為主体感向上2021

    • Author(s)
      児玉大樹,瑞穂嵩人,畑田裕二,鳴海拓志,廣瀬通孝
    • Organizer
      第26回日本バーチャルリアリティ学会大会
    • Related Report
      2021 Research-status Report
  • [Presentation] SHeF-WIP: Walking-in-Place based on Step Height and Frequency for Wider Range of Virtual Speed2021

    • Author(s)
      Yutaro Hirao, Takuji Narumi, Ferran Argelaguet Sanz, Anatole Lecuyer
    • Organizer
      IEEE VR 2021
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Determining the Target Point of the Mid-Air Pinch Gesture2020

    • Author(s)
      Reigo Ban, Yutaro Hirao, and Takuji Narumi
    • Organizer
      IEEE VR 2021
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Do You Feel Like Passing Through Walls?: Effect of Self-Avatar Appearance on Facilitating Realistic Behavior in Virtual Environments2020

    • Author(s)
      Nami Ogawa, Takuji Narumi, Michitaka Hirose
    • Organizer
      CHI2020
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] 筋肉質アバタを用いたプロテウス効果が重さ知覚に与える影響2020

    • Author(s)
      角田賢太朗,小川奈美,鳴海拓志,廣瀬通孝
    • Organizer
      第25回日本バーチャルリアリティ学会大会
    • Related Report
      2020 Research-status Report
  • [Presentation] 鏡アバタの自律行動と容貌が運動タスクの作業速度に与える影響2020

    • Author(s)
      田崎大也,小川奈美,鳴海拓志,廣瀬通孝
    • Organizer
      第25回日本バーチャルリアリティ学会大会
    • Related Report
      2020 Research-status Report
  • [Presentation] 融合身体を用いた身体スキル伝達に関する基礎調査2020

    • Author(s)
      伊東亮太,小川奈美,鳴海拓志,廣瀬通孝
    • Organizer
      第25回日本バーチャルリアリティ学会大会
    • Related Report
      2020 Research-status Report
  • [Presentation] 本来の能力を引き出すためのツールVRのさらなる可能性2020

    • Author(s)
      鳴海拓志
    • Organizer
      第38回超教育協会オンラインシンポジウム
    • Related Report
      2020 Research-status Report
    • Invited
  • [Presentation] バーチャルだからうまくいく アバタ時代のコミュニケーション2020

    • Author(s)
      鳴海拓志
    • Organizer
      令和2年度北陸信越工学教育協会石川県支部講演会
    • Related Report
      2020 Research-status Report
    • Invited
  • [Presentation] Designing ourselves via embodiment in VR2020

    • Author(s)
      Takuji Narumi
    • Organizer
      The 23rd EA-RTM Symposium on Smart Entertainment
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] バーチャルリアリティと行動変容2020

    • Author(s)
      鳴海拓志
    • Organizer
      日本臨床バイオメカニクス学会 特別シンポジウム「メカニクスの基礎、計測技術、IT応用の最前線 -工学系研究者からのメッセージ-」
    • Related Report
      2020 Research-status Report
    • Invited
  • [Presentation] なりたい自分になれる? マスク時代のコミュニケーションと自己演出・自己変容2020

    • Author(s)
      鳴海拓志
    • Organizer
      ヒューマンインタフェース学会サイバーコロキウム ワークショップ5「マスク時代のコミュニケーション」
    • Related Report
      2020 Research-status Report
    • Invited
  • [Presentation] 身体の見た目の制御による知覚・認知・行動の変容2020

    • Author(s)
      鳴海拓志
    • Organizer
      日本心理学会第84回大会公募シンポジウム9「バーチャルリアリティ(VR)と心理学」
    • Related Report
      2020 Research-status Report
    • Invited
  • [Presentation] バーチャルだからうまくいく アバタ時代のコミュニケーションと人間観の変容2020

    • Author(s)
      鳴海拓志
    • Organizer
      第3回SICEポストコロナ未来社会ワークショップ
    • Related Report
      2020 Research-status Report
    • Invited
  • [Book] プロジェクション・サイエンス2020

    • Author(s)
      鈴木宏昭、田中 彰吾、大住 倫弘、信迫 悟志、嶋田 総太郎、森岡 周、鳴海 拓志、小野 哲雄、中田 龍三郎、川合 信幸、外山 紀子、久保(川合)南海子、鳥居 修晃、望月 登志子、薬師神 玲子
    • Total Pages
      256
    • Publisher
      近代科学社
    • ISBN
      476490621X
    • Related Report
      2020 Research-status Report

URL: 

Published: 2020-08-03   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi