• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Device-less visuo-haptic display system using self-contact sensation and visuo-haptic interaction

Research Project

Project/Area Number 15K12075
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field Human interface and interaction
Research InstitutionThe University of Tokyo

Principal Investigator

HIROSE Michitaka  東京大学, 大学院情報理工学系研究科, 教授 (40156716)

Co-Investigator(Renkei-kenkyūsha) TANIKAWA Tomohiro  東京大学, 大学院情報理工学系研究科, 特任准教授 (80418657)
NARUMI Takuji  東京大学, 大学院情報理工学系研究科, 講師 (70614353)
Research Collaborator BAN Yuki  
Project Period (FY) 2015-04-01 – 2018-03-31
Project Status Completed (Fiscal Year 2017)
Budget Amount *help
¥3,510,000 (Direct Cost: ¥2,700,000、Indirect Cost: ¥810,000)
Fiscal Year 2016: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2015: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
Keywords視触力覚間相互作用 / 触覚提示 / 自己接触感 / 拡張現実感 / クロスモーダル / Pseudo-haptics / 食力覚提示 / 手形状変形 / 深部感覚 / 触力覚提示
Outline of Final Research Achievements

In this study, we realized a visuo-haptic augmented reality (AR) system which delivers pinching and pulling interactions with AR objects. The system employs a cross-modal effect at the point where fingers feel an equivalent contacting sensation when pinching an object. It controls bathyesthesia sensation with visuo-haptic interaction based on a rendering algorithm that evokes haptic sensations without using haptic devices.Through a psychophysical experiments, we confirmed that this method enabled us to present as if they were touching a virtual object as same size as they were watching when the diameter of the virtual object is 25 mm or less.

Report

(4 results)
  • 2017 Annual Research Report   Final Research Report ( PDF )
  • 2016 Research-status Report
  • 2015 Research-status Report
  • Research Products

    (48 results)

All 2018 2017 2016 2015

All Journal Article (5 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 2 results,  Open Access: 3 results) Presentation (39 results) (of which Int'l Joint Research: 14 results,  Invited: 16 results) Book (4 results)

  • [Journal Article] Ascending and Descending in Virtual Reality: Simple and Safe System Using Passive Haptics2018

    • Author(s)
      Ryohei Nagao, Keigo Matsumoto, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose
    • Journal Title

      IEEE Transactions on Visualization and Computer Graphics (TVCG)

      Volume: Vol.24, No.4 Issue: 4 Pages: 1584-1593

    • DOI

      10.1109/tvcg.2018.2793038

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] クロスモーダル知覚のインタフェース応用2018

    • Author(s)
      鳴海拓志
    • Journal Title

      映像情報メディア学会誌

      Volume: Vol.72, No.1 Pages: 2-7

    • Related Report
      2017 Annual Research Report
  • [Journal Article] Pseudo-haptics応用インタフェースの展望:疑似触力覚提示からその先へ2017

    • Author(s)
      鳴海拓志
    • Journal Title

      システム制御情報学会誌

      Volume: Vol.61 No.11 Pages: 463-468

    • NAID

      130006742770

    • Related Report
      2017 Annual Research Report
  • [Journal Article] Presenting resistive force by modifying joint angles of an avatar2017

    • Author(s)
      茂山丈太郎,小川奈美,鳴海拓志,谷川智洋,廣瀬通孝
    • Journal Title

      Transactions of the Virtual Reality Society of Japan

      Volume: 22 Issue: 3 Pages: 369-378

    • DOI

      10.18974/tvrsj.22.3_369

    • NAID

      130006107991

    • ISSN
      1344-011X, 2423-9593
    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Technological applications of multisensory perception2017

    • Author(s)
      鳴海拓志
    • Journal Title

      The Japanese Journal of Psychonomic Science

      Volume: 36 Issue: 1 Pages: 129-132

    • DOI

      10.14947/psychono.36.24

    • NAID

      130006247250

    • ISSN
      0287-7651, 2188-7977
    • Related Report
      2017 Annual Research Report
    • Open Access
  • [Presentation] クロスモーダルな表現と体験のデザイン2017

    • Author(s)
      鳴海拓志
    • Organizer
      JEITA ヒューマンインタラクションデザイン専門委員会講演会
    • Place of Presentation
      東京大学,東京
    • Year and Date
      2017-03-27
    • Related Report
      2016 Research-status Report
    • Invited
  • [Presentation] Turn physically curved paths into virtual curved paths2017

    • Author(s)
      Keigo Matsumoto, Takuji Narumi, Yuki Ban, Tomohiro Tanikawa, and Michitaka Hirose
    • Organizer
      IEEE VR 2017
    • Place of Presentation
      Los Angeles, USA
    • Year and Date
      2017-03-18
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Distortion in perceived size and body-based scaling in virtual environments2017

    • Author(s)
      Nami Ogawa, Takuji Narumi and Michitaka Hirose
    • Organizer
      Augmented Human 2017
    • Place of Presentation
      Silicon Valley
    • Year and Date
      2017-03-16
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Presenting pseudo-haptic feedback in immersive VR environment by modifying avatar’s joint angle2017

    • Author(s)
      Jotaro Shigeyama, Nami Ogawa, Takuji Narumi, Tomohiro Tanikawa, Michitaka Hirose
    • Organizer
      World Haptics 2017
    • Related Report
      2017 Annual Research Report 2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] クロスモーダルが創り出す超現実2017

    • Author(s)
      鳴海拓志
    • Organizer
      新潟大学公開講演会 クロスモーダルが創り出す超現実
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] Magic Table: Deformable Props Using Visuo Haptic Redirection2017

    • Author(s)
      Keigo Matsumoto, Takeru Hashimoto, Junya Mizutani, Hibiki Yonahara, Ryohei Nagao, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose
    • Organizer
      SIGGRAPH ASIA 2017 Emerging Technologies
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] アバタの関節角補正による疑似触力覚提示手法の基礎検討2017

    • Author(s)
      茂山丈太郎,小川奈美,鳴海拓志,谷川智洋,廣瀬通孝
    • Organizer
      電子情報通信学会MVE研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] Infinite Stairs: Simulating Stairs in Virtual Reality based on Visuo-haptic Interaction2017

    • Author(s)
      Ryohei Nagao, Keigo Matsumoto, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose
    • Organizer
      SIGGRAPH2017 Emerging Technologies
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 多感覚知覚が作り出すリアリティ2017

    • Author(s)
      鳴海拓志
    • Organizer
      第9回多感覚研究会
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] Factors and Influences of Body Ownership over Virtual Hands2017

    • Author(s)
      Nami Ogawa, Takuji Narumi, Michitaka Hirose
    • Organizer
      HCII2017
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 視触覚間相互作用を用いた歩行による昇降感覚提示システム2017

    • Author(s)
      長尾涼平,松本啓吾,鳴海拓志,谷川智洋,廣瀬通孝
    • Organizer
      第21回日本バーチャルリアリティ学会大会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 並進移動量操作を用いた坂昇降感覚提示手法の研究2017

    • Author(s)
      松本啓吾,長尾涼平,鳴海拓志,谷川智洋,廣瀬通孝
    • Organizer
      第21回日本バーチャルリアリティ学会大会
    • Related Report
      2017 Annual Research Report
  • [Presentation] こころと上手につきあっていくためのVR技術2017

    • Author(s)
      鳴海拓志
    • Organizer
      科学・技術交流サロン「人の感性を科学する -認知科学と先端技術の融合にむけて-」第4回
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] 視触覚間相互作用を用いた疑似上昇感覚提示の基礎検討2017

    • Author(s)
      長尾涼平,松本啓吾,鳴海拓志,谷川智洋,廣瀬通孝
    • Organizer
      電子情報通信学会MVE研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] オンラインで調べる認知と行動:インタフェース研究の観点から2017

    • Author(s)
      鳴海拓志
    • Organizer
      FIT2017シンポジウム「インターネットは心理学にFITするか?」
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] 研究20連発(鳴海拓志)2017

    • Author(s)
      鳴海拓志
    • Organizer
      FIT2017 情報理工学系研究科研究100連発
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] 今後のゲームデザインに必須な『sense of ○○』とは何か?2017

    • Author(s)
      鳴海拓志
    • Organizer
      CEDEC 2017
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] VR で変える五感と自分2017

    • Author(s)
      鳴海拓志
    • Organizer
      デジタルミュージアムフォーラムin函館
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] VRで変える五感と自分2017

    • Author(s)
      鳴海拓志
    • Organizer
      第3回こころと身体の学際会議
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] クロスモーダルインタフェースと体験のデザイン2017

    • Author(s)
      鳴海拓志
    • Organizer
      第7回AIITイノベーションデザインフォーラム
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] バーチャルリアリティが変える身体,心,現実2017

    • Author(s)
      鳴海拓志
    • Organizer
      VRは私たちに何をもたらすのか?─変わりゆく<現実(リアリティ)>と、その社会的インパクトについて,
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] 感覚のハッキング2017

    • Author(s)
      鳴海拓志
    • Organizer
      KYO-SHITSU #16
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] 五感に訴えるバーチャルリアリティの新展開2017

    • Author(s)
      鳴海拓志
    • Organizer
      印刷興行会商業印刷部会勉強会
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] 視覚触覚間の感覚間相互作用を利用した形状伝送システムの研究開発2016

    • Author(s)
      鳴海拓志
    • Organizer
      戦略的情報通信研究開発セミナー2017
    • Place of Presentation
      機械振興会館,東京
    • Year and Date
      2016-12-21
    • Related Report
      2016 Research-status Report
    • Invited
  • [Presentation] Multi-sensorial virtual reality and augmented human food interaction2016

    • Author(s)
      Takuji Narumi
    • Organizer
      International Conference on Multimodal Interaction 2016
    • Place of Presentation
      タイム24ビル,東京
    • Year and Date
      2016-11-16
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] バーチャル身体の形状と動きの変換が身体所有感と身体図式に与える影響2016

    • Author(s)
      小川奈美,伴祐樹,櫻井翔,鳴海拓志,谷川智洋,廣瀬通孝
    • Organizer
      第21回日本バーチャルリアリティ学会大会
    • Place of Presentation
      つくば国際会議場,茨城
    • Year and Date
      2016-09-14
    • Related Report
      2016 Research-status Report
  • [Presentation] Unlimited Corridor: Redirected Walking Techniques using Visuo Haptic Interaction2016

    • Author(s)
      Keigo Matsumoto, Yuki Ban, Takuji Narumi, Yohei Yanase, Tomohiro Tanikawa, and Michitaka Hirose
    • Organizer
      SIGGRAPH 2016 Emerging Technologies
    • Place of Presentation
      Anaheim (アメリカ)
    • Year and Date
      2016-07-24
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Diminished Agency: Attenuating a sense of agency for problem finding on personal physical performance2016

    • Author(s)
      Sho Sakurai, Yuki Ban, Nami Ogawa, Takuji Narumi, Tomohiro Tanikawa, Michitaka Hirose
    • Organizer
      HCII2016
    • Place of Presentation
      Toronto, Canada
    • Year and Date
      2016-07-17
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] 拡張する身体,変容する現実2016

    • Author(s)
      鳴海拓志
    • Organizer
      第2回身体性メディアコンソーシア
    • Place of Presentation
      Fabcafe,東京
    • Year and Date
      2016-07-15
    • Related Report
      2016 Research-status Report
    • Invited
  • [Presentation] Combining Passive Haptic Cues with Redirected Walking for Improving the Manipulation Techniques2016

    • Author(s)
      Keigo Matsumoto, Yuki Ban, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose
    • Organizer
      3DUI 2016
    • Place of Presentation
      Greenville (アメリカ)
    • Year and Date
      2016-03-19
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] えくす手: 変調バーチャルハンドへの即応的な身体所有感の生起による身体拡張システム2016

    • Author(s)
      小川奈美,伴祐樹,櫻井翔,鳴海拓志,谷川智洋,廣瀬通孝
    • Organizer
      インタラクション2016
    • Place of Presentation
      東京都千代田区科学技術館(東京)
    • Year and Date
      2016-03-02
    • Related Report
      2015 Research-status Report
  • [Presentation] Supporting precise manual-handling task using visuo-haptic interaction2016

    • Author(s)
      Akira Nomoto, Yuki Ban, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose
    • Organizer
      Augmented Human 2016
    • Place of Presentation
      Geneva (スイス)
    • Year and Date
      2016-02-25
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Metamorphosis Hand: Dynamically Transforming Hands2016

    • Author(s)
      Nami Ogawa, Yuki Ban, Sho Sakurai, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose
    • Organizer
      Augmented Human 2016
    • Place of Presentation
      Geneva (スイス)
    • Year and Date
      2016-02-25
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] バーチャルハンドの形状と動きの変容が身体所有感の生起に与える影響の検討2015

    • Author(s)
      小川奈美,伴祐樹, 櫻井翔, 鳴海拓志,谷川智洋,廣瀬通孝
    • Organizer
      第3回VRと超臨場感研究会
    • Place of Presentation
      東京都日野市首都大学東京(東京)
    • Year and Date
      2015-12-28
    • Related Report
      2015 Research-status Report
  • [Presentation] Yubi-Toko: Finger Walking in Snowy Scene using Pseudo-haptic technique on Touchpad2015

    • Author(s)
      Yusuke Ujitoko, Yuki Ban, Takuji Narumi, Tomohiro Tanikawa, Koichi Hirota and Michitaka Hirose
    • Organizer
      SIGGRAPH ASIA 2015 Emerging Technologies
    • Place of Presentation
      兵庫県神戸市神戸国際展示場(兵庫)
    • Year and Date
      2015-11-02
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] 自己接触感を利用したバーチャル物体把持感の提示2015

    • Author(s)
      伴祐樹, 鳴海拓志, 谷川智洋, 廣瀬通孝
    • Organizer
      第20回日本バーチャルリアリティ学会大会
    • Place of Presentation
      東京都江東区芝浦工業大学(東京)
    • Year and Date
      2015-09-09
    • Related Report
      2015 Research-status Report
  • [Presentation] 押下圧力計測に基づく視触力覚相互作用の評価2015

    • Author(s)
      鳴海拓志, 国分新, 伴祐樹, 谷川智洋, 廣瀬通孝
    • Organizer
      第20回日本バーチャルリアリティ学会大会
    • Place of Presentation
      東京都江東区芝浦工科大学(東京)
    • Year and Date
      2015-09-09
    • Related Report
      2015 Research-status Report
  • [Presentation] Air Haptics: Displaying feeling of contact with AR object using visuo-haptic interaction2015

    • Author(s)
      Yuki Ban, Takuji Narumi, Tomohiro Tanikawa, Michitaka Hirose
    • Organizer
      SIGGRAPH 2015
    • Place of Presentation
      Los Angeles (アメリカ)
    • Year and Date
      2015-08-09
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] visuo-hapticsを用いた作業精度向上支援手法の基礎的検討2015

    • Author(s)
      野元彰,伴祐樹,鳴海拓志,谷川智洋,廣瀬通孝
    • Organizer
      第25回人工現実感研究会
    • Place of Presentation
      東京都文京区東京大学(東京)
    • Year and Date
      2015-07-02
    • Related Report
      2015 Research-status Report
  • [Book] 図説 視覚の事典2018

    • Author(s)
      日本視覚学会 編
    • Publisher
      朝倉書店
    • Related Report
      2017 Annual Research Report
  • [Book] VR/AR技術の開発動向と最新応用事例2018

    • Author(s)
      鳴海拓志ほか
    • Total Pages
      552
    • Publisher
      技術情報協会
    • Related Report
      2017 Annual Research Report
  • [Book] S&T出版2018

    • Author(s)
      鳴海拓志ほか
    • Total Pages
      653
    • Publisher
      狙いどおりの触覚・触感をつくる技術
    • Related Report
      2017 Annual Research Report
  • [Book] AR (拡張現実) の基礎・発展・実践2015

    • Author(s)
      蔵田武志, 清川清(監修)
    • Total Pages
      390
    • Publisher
      科学技術出版
    • Related Report
      2015 Research-status Report

URL: 

Published: 2015-04-16   Modified: 2019-03-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi