• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Perception-based Shape Display using Visual Feedback with Hand Posture Modification

Research Project

Project/Area Number 25540077
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field Human interface and interaction
Research InstitutionThe University of Tokyo

Principal Investigator

Hirose Michitaka  東京大学, 情報理工学(系)研究科, 教授 (40156716)

Co-Investigator(Renkei-kenkyūsha) TANIKAWA TOMOHIRO  東京大学, 大学院情報理工学系研究科, 講師 (80418657)
NARUMI TAKUJI  東京大学, 大学院情報理工学系研究科, 助教 (70614353)
Project Period (FY) 2013-04-01 – 2016-03-31
Project Status Completed (Fiscal Year 2015)
Budget Amount *help
¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000)
Fiscal Year 2014: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Fiscal Year 2013: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Keywords触力覚提示 / Pseudo-haptics / 深部感覚 / 手形状変形 / バーチャルリアリティ / 形状提示 / 感覚間相互作用
Outline of Final Research Achievements

In this research, we proposed a visuo-haptic system that can provide users with the sensation of touching various virtual shapes, by realizing the Pseudo-Haptics that can adapt to a touching with multi-fingers. The previous way, which modifies the movement of virtual hand to alter a shape perception, evokes a spatial inconsistency when it's used for a touching with multi-fingers. To solve this problem, our research constructs a real-time video processing method that can compose visual stimuli with spatial consistency in that situation, by modifying a hand image's posture naturally with an image deformation algorithm. Through user experiments, we revealed that this method can modify the perception of shape and stiffness when users handle an object with multi fingers. Furthermore, we applied these findings to a modeling system and a haptic display on the mobile device, and confirmed these effect through exhibitions.

Report

(4 results)
  • 2015 Annual Research Report   Final Research Report ( PDF )
  • 2014 Research-status Report
  • 2013 Research-status Report
  • Research Products

    (38 results)

All 2016 2015 2014 2013

All Journal Article (4 results) (of which Peer Reviewed: 3 results,  Acknowledgement Compliant: 1 results) Presentation (33 results) (of which Int'l Joint Research: 5 results,  Invited: 5 results) Book (1 results)

  • [Journal Article] 手形状変形フィードバックを利用した把持動作における硬さ知覚操作2014

    • Author(s)
      伴祐樹,鳴海拓志,谷川智洋,廣瀬通孝
    • Journal Title

      日本バーチャルリアリティ学会論文誌,

      Volume: Vol.19 No.4 Pages: 523-532

    • Related Report
      2014 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] 背面タッチパネルを用いた擬似力覚によるモバイル端末での触覚提示2014

    • Author(s)
      国分新,伴祐樹,鳴海拓志,谷川智洋,廣瀬通孝
    • Journal Title

      日本バーチャルリアリティ学会論文誌,

      Volume: Vol.19 No.4 Pages: 571-580

    • Related Report
      2014 Research-status Report
    • Peer Reviewed
  • [Journal Article] Pseudo-hapticsを用いたMR空間内での力作業支援2014

    • Author(s)
      對間祐毅,伴祐樹,鳴海拓志,谷川智洋,廣瀬通孝
    • Journal Title

      日本バーチャルリアリティ学会論文誌,

      Volume: Vol.19 No.4 Pages: 533-540

    • Related Report
      2014 Research-status Report
    • Peer Reviewed
  • [Journal Article] Modifying Perceived Size of a Handled Object through Hand Image Deformation2013

    • Author(s)
      Yuki Ban, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose
    • Journal Title

      Presence: Teleoperators and Virtual Environments

      Volume: Summer 2013, Vol. 22, No. 3 Issue: 3 Pages: 255-270

    • DOI

      10.1162/pres_a_00154

    • Related Report
      2013 Research-status Report
  • [Presentation] Unlimited Corridor: Redirected Walking Techniques using Visuo Haptic Interaction2016

    • Author(s)
      Keigo Matsumoto, Yuki Ban, Takuji Narumi, Yohei Yanase, Tomohiro Tanikawa and Michitaka Hirose
    • Organizer
      SIGGRAPH 2016 Emerging Technologies
    • Place of Presentation
      Anaheim (アメリカ)
    • Year and Date
      2016-07-24
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Combining Passive Haptic Cues with Redirected Walking for Improving the Manipulation Techniques2016

    • Author(s)
      Keigo Matsumoto, Yuki Ban, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose
    • Organizer
      3DUI 2016
    • Place of Presentation
      Greenville (アメリカ)
    • Year and Date
      2016-03-19
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] えくす手: 変調バーチャルハンドへの即応的な身体所有感の生起による身体拡張システム2016

    • Author(s)
      小川奈美,伴祐樹,櫻井翔,鳴海拓志,谷川智洋,廣瀬通孝
    • Organizer
      インタラクション2016
    • Place of Presentation
      東京都千代田区科学技術館(東京)
    • Year and Date
      2016-03-02
    • Related Report
      2015 Annual Research Report
  • [Presentation] Supporting precise manual-handling task using visuo-haptic interaction2016

    • Author(s)
      Akira Nomoto, Yuki Ban, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose
    • Organizer
      Augmented Human 2016
    • Place of Presentation
      Geneva (スイス)
    • Year and Date
      2016-02-25
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Metamorphosis Hand: Dynamically Transforming Hands2016

    • Author(s)
      Nami Ogawa, Yuki Ban, Sho Sakurai, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose
    • Organizer
      Augmented Human 2016
    • Place of Presentation
      Geneva (スイス)
    • Year and Date
      2016-02-25
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] バーチャルハンドの形状と動きの変容が身体所有感の生起に与える影響の検討2015

    • Author(s)
      小川奈美,伴祐樹, 櫻井翔, 鳴海拓志,谷川智洋,廣瀬通孝
    • Organizer
      第3回VRと超臨場感研究会
    • Place of Presentation
      東京都日野市首都大学東京(東京)
    • Year and Date
      2015-12-28
    • Related Report
      2015 Annual Research Report
  • [Presentation] 押下圧力計測に基づく視触力覚相互作用の評価2015

    • Author(s)
      鳴海拓志, 国分新, 伴祐樹, 谷川智洋, 廣瀬通孝
    • Organizer
      第20回日本バーチャルリアリティ学会大会
    • Place of Presentation
      東京都江東区芝浦工科大学(東京)
    • Year and Date
      2015-09-09
    • Related Report
      2015 Annual Research Report
  • [Presentation] 自己接触感を利用したバーチャル物体把持感の提示2015

    • Author(s)
      伴祐樹, 鳴海拓志, 谷川智洋, 廣瀬通孝
    • Organizer
      第20回日本バーチャルリアリティ学会大会
    • Place of Presentation
      東京都江東区芝浦工科大学(東京)
    • Year and Date
      2015-09-09
    • Related Report
      2015 Annual Research Report
  • [Presentation] visuo-hapticsを用いた作業精度向上支援手法の基礎的検討2015

    • Author(s)
      野元彰,伴祐樹,鳴海拓志,谷川智洋,廣瀬通孝
    • Organizer
      第20回日本バーチャルリアリティ学会大会
    • Place of Presentation
      東京都江東区芝浦工科大学(東京)
    • Year and Date
      2015-09-09
    • Related Report
      2015 Annual Research Report
  • [Presentation] Air Haptics: Displaying feeling of contact with AR object using visuo-haptic interaction2015

    • Author(s)
      Yuki Ban, Takuji Narumi, Tomohiro Tanikawa, Michitaka Hirose
    • Organizer
      SIGGRAPH 2015
    • Place of Presentation
      Los Angeles (アメリカ)
    • Year and Date
      2015-08-09
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Virtual Jizai-Ryu: Hi-fidelity Interactive Virtual Exhibit with Digital Display Case2015

    • Author(s)
      Yuki Ban, Takashi Kajinami, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose
    • Organizer
      HCII2015
    • Place of Presentation
      Los Angeles, アメリカ
    • Year and Date
      2015-08-02 – 2015-08-07
    • Related Report
      2014 Research-status Report
  • [Presentation] Modifying a body perception and an actual motion by visual stimuli of distorted physical exercise using shadow metapho2015

    • Author(s)
      Yuki Ban, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose
    • Organizer
      ASIAGRAPH 2015
    • Place of Presentation
      台南,台湾
    • Year and Date
      2015-04-24 – 2015-04-27
    • Related Report
      2014 Research-status Report
  • [Presentation] MagicPot360: Free Viewpoint shape Display Modifying the Perception of shape2015

    • Author(s)
      Yuki Ban, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose
    • Organizer
      IEEE VR 2015
    • Place of Presentation
      Arles, フランス
    • Year and Date
      2015-03-23 – 2015-03-27
    • Related Report
      2014 Research-status Report
  • [Presentation] High-Definition Digital Display Case with the Image-based Interaction2015

    • Author(s)
      Yuki Ban, Takashi Kajinami, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose
    • Organizer
      IEEE VR 2015
    • Place of Presentation
      Arles, フランス
    • Year and Date
      2015-03-23 – 2015-03-27
    • Related Report
      2014 Research-status Report
  • [Presentation] Rapid Fire Research 102015

    • Author(s)
      Takuji Narumi
    • Organizer
      Nico Nico Gakkai Beta Singapore Rapid Fire research 100 @ SCIENCE CENTER SINGAPORE
    • Place of Presentation
      Singapore, シンガポール
    • Year and Date
      2015-03-11
    • Related Report
      2014 Research-status Report
    • Invited
  • [Presentation] Displaying shapes with various types of surfaces using visuo-haptic interaction2014

    • Author(s)
      Yuki Ban, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose
    • Organizer
      20th ACM Symposium on Virtual Reality Software and Technology
    • Place of Presentation
      Edinburgh, イギリス
    • Year and Date
      2014-11-11 – 2014-11-13
    • Related Report
      2014 Research-status Report
  • [Presentation] クロスモーダルインタフェースと行動誘発型AR2014

    • Author(s)
      鳴海拓志
    • Organizer
      チームつかもと研究交流会2014
    • Place of Presentation
      はこだて未来大学,北海道
    • Year and Date
      2014-09-25
    • Related Report
      2014 Research-status Report
    • Invited
  • [Presentation] 背面タッチパネルを用いた手の画像の変調提示による擬似力覚の生成2014

    • Author(s)
      国分新,伴祐樹,鳴海拓志,谷川智洋,廣瀬通孝
    • Organizer
      日本バーチャルリアリティ学会第19回大会
    • Place of Presentation
      名古屋大学,愛知
    • Year and Date
      2014-09-17 – 2014-09-19
    • Related Report
      2014 Research-status Report
  • [Presentation] Pseudo-hapticsによる全天周映像鑑賞時の行動誘発孝2014

    • Author(s)
      對間祐毅,伴祐樹,鳴海拓志,谷川智洋,廣瀬通
    • Organizer
      日本バーチャルリアリティ学会第19回大会
    • Place of Presentation
      名古屋大学,愛知
    • Year and Date
      2014-09-17 – 2014-09-19
    • Related Report
      2014 Research-status Report
  • [Presentation] 視触覚間相互作用を利用した不連続面を含む三次元曲面に対する形状知覚操作2014

    • Author(s)
      伴祐樹,鳴海拓志,谷川智洋,廣瀬通孝
    • Organizer
      日本バーチャルリアリティ学会第19回大会
    • Place of Presentation
      名古屋大学,愛知
    • Year and Date
      2014-09-17 – 2014-09-19
    • Related Report
      2014 Research-status Report
  • [Presentation] リアルを侵食するSF的拡張現実感技術の現在2014

    • Author(s)
      鳴海拓志
    • Organizer
      第53回日本SF大会
    • Place of Presentation
      つくば国際会議場,茨城
    • Year and Date
      2014-07-19 – 2014-07-20
    • Related Report
      2014 Research-status Report
    • Invited
  • [Presentation] クロスモーダルデザインを探る2014

    • Author(s)
      鳴海拓志
    • Organizer
      第6回クロスモーダルデザインWS
    • Place of Presentation
      Bed Gallery ASLEEP, 東京
    • Year and Date
      2014-05-30
    • Related Report
      2014 Research-status Report
    • Invited
  • [Presentation] Controlling Perceived Stiffness of Pinched Objects Using Visual Feedback of Hand Deformation2014

    • Author(s)
      Yuki Ban, Takuji Narumi, Tomohiro Tanikawa, Michitaka Hirose
    • Organizer
      Haptics Symposium 2014
    • Place of Presentation
      DoubleTree by Hilton Hotel, Houston, アメリカ
    • Related Report
      2013 Research-status Report
  • [Presentation] Controlling Fatigue while Lifting Objects using Pseudo-haptics in a Mixed Reality Space2014

    • Author(s)
      Yuki Taima, Yuki Ban, Takuji Narumi, Tomohiro Tanikawa, Michitaka Hirose
    • Organizer
      Haptics Symposium 2014
    • Place of Presentation
      DoubleTree by Hilton Hotel, Houston, アメリカ
    • Related Report
      2013 Research-status Report
  • [Presentation] Representing Normal and Shearing Forces on the Mobile Device with Visuo-haptic Interaction and a Rear Touch Interface2014

    • Author(s)
      Arata Kokubun, Yuki Ban, Takuji Narumi, Tomohiro Tanikawa, Michitaka Hirose
    • Organizer
      Haptics Symposium 2014
    • Place of Presentation
      DoubleTree by Hilton Hotel, Houston, アメリカ
    • Related Report
      2013 Research-status Report
  • [Presentation] Augmenting Human Experience with Perception-Based Displays Utilizing Illusions2013

    • Author(s)
      Takuji Narumi
    • Organizer
      International Display Workshop '13
    • Place of Presentation
      Sapporo Convention Center,北海道
    • Related Report
      2013 Research-status Report
    • Invited
  • [Presentation] ARAtouch: Visuo-haptic Interaction with Mobile Rear Touch Interface2013

    • Author(s)
      Arata Kokubun, Yuki Ban, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose
    • Organizer
      ACM SIGGRAPH ASIA 2013 Emerging Technologies
    • Place of Presentation
      Hongkong Convention Center,香港,香港
    • Related Report
      2013 Research-status Report
  • [Presentation] 視触覚間相互作用を用いた自由視点形状提示システム2013

    • Author(s)
      伴祐樹, 鳴海拓志, 谷川智洋, 廣瀬通孝
    • Organizer
      日本バーチャルリアリティ学会第18回大会
    • Place of Presentation
      グランフロント大阪,大阪
    • Related Report
      2013 Research-status Report
  • [Presentation] Visuo-haptic interaction with mobile rear touch interface2013

    • Author(s)
      Arata Kokubun, Yuki Ban, Takuji Narumi, Tomohiro Tanikawa, Michitaka Hirose
    • Organizer
      SIGGRAPH 2013 Posters
    • Place of Presentation
      Anaheim Convention Center,Anaheim,アメリカ
    • Related Report
      2013 Research-status Report
  • [Presentation] Pot the magic pot: interactive modification of the perceived angular shape2013

    • Author(s)
      Yuki Ban, Takuji Narumi, Tomohiro Tanikawa, Michitaka Hirose
    • Organizer
      SIGGRAPH 2013 Posters
    • Place of Presentation
      Anaheim Convention Center,Anaheim,アメリカ
    • Related Report
      2013 Research-status Report
  • [Presentation] 見かけの移動量の操作による持ち上げ時重量知覚の操作2013

    • Author(s)
      對間祐毅,伴祐樹,鳴海拓志,谷川智洋,廣瀬通孝
    • Organizer
      マルチメディア・仮想環境基礎研究会
    • Place of Presentation
      東京大学,東京
    • Related Report
      2013 Research-status Report
  • [Presentation] 背面タッチパネルによる擬似力覚の生成と利用に関する基礎的検討2013

    • Author(s)
      国分新,伴祐樹,鳴海拓志,谷川智洋,廣瀬通孝
    • Organizer
      マルチメディア・仮想環境基礎研究会
    • Place of Presentation
      東京大学,東京
    • Related Report
      2013 Research-status Report
  • [Presentation] Augmented Endurance: Controlling Fatigue while Handling Objects by Affecting Weight Perception using Augmented Reality2013

    • Author(s)
      Yuki Ban, Takuji Narumi, Tatsuya Fujii, Sho Sakurai, Jun Imura, Tomohiro Tanikawa and Michitaka Hirose
    • Organizer
      ACM CHI2013
    • Place of Presentation
      Palais de Congres de Paris, Paris, フランス
    • Related Report
      2013 Research-status Report
  • [Book] AR (拡張現実) の基礎・発展・実践2015

    • Author(s)
      蔵田武志, 清川清(監修)
    • Total Pages
      390
    • Publisher
      科学技術出版
    • Related Report
      2015 Annual Research Report

URL: 

Published: 2014-07-25   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi