Elucidation and Modeling of Body Image Expansion Based on Body Conjugate Systems

• Project/Area Number: 15H01701
• Research Category: Grant-in-Aid for Scientific Research (A)
• Allocation Type: Single-year Grants
• Section: 一般
• Research Field: Human interface and interaction
• Research Institution: The University of Tokyo
• Principal Investigator: INAMI Masahiko 東京大学, 先端科学技術研究センター, 教授 (00345117)
• Co-Investigator(Kenkyū-buntansha): 南澤 孝太 慶應義塾大学, メディアデザイン研究科(日吉), 准教授 (10585623) ; 杉本 麻樹 慶應義塾大学, 理工学部(矢上), 准教授 (50517399) ; 北崎 充晃 豊橋技術科学大学, 工学(系)研究科(研究院), 教授 (90292739)
• Project Period (FY): 2015-04-01 – 2019-03-31
• Project Status: Completed (Fiscal Year 2018)
• Budget Amount: ¥43,160,000 (Direct Cost: ¥33,200,000、Indirect Cost: ¥9,960,000); Fiscal Year 2018: ¥10,400,000 (Direct Cost: ¥8,000,000、Indirect Cost: ¥2,400,000); Fiscal Year 2017: ¥10,660,000 (Direct Cost: ¥8,200,000、Indirect Cost: ¥2,460,000); Fiscal Year 2016: ¥10,140,000 (Direct Cost: ¥7,800,000、Indirect Cost: ¥2,340,000); Fiscal Year 2015: ¥11,960,000 (Direct Cost: ¥9,200,000、Indirect Cost: ¥2,760,000)
• Keywords: 環境身体ダイナミクス / 身体能力拡張 / 超人スポーツ / ヒューマンインタフェース / 身体環境ダイナミクス / インタラクション / 身体像 / 身体拡張 / 認知心理 / バーチャルリアリティ / マルチモーダルインタフェース / 自己投射性 / 自己投射 / 感覚提示 / 自在化 / 身体共役系

Outline of Final Research Achievements

In this study, with the aim of constructing a "body conjugate system" that projects our body image to control targets in various shapes, we studied on design guidelines and design limits of the body conjugate system by using VR avatars and wearable robots. We examined our cognition on the body conjugate system in the case of constructing it with not only the whole body but also with the local elements of the body. As a result of this study, we acquired the concept of "body schema editing" according to physical tasks.

Academic Significance and Societal Importance of the Research Achievements

本研究の実施を通じて，多様な操作対象の身体像をユーザに投射する「身体共役系」のコンセプトを提案し，実証システムの構築を行うとともに，VR環境を活用しながら，こうした拡張された身体像によって生じる認知について検証を進めた．本研究を通じて，多様な操作対象を直感的に操作するための身体像の投射に関する設計指針と知見を獲得することができた．

Research Products

• [Journal Article] MusiArm: Extending Prosthesis to Musical Expression. (2019)
  • Author(s): Kaito Hatakeyama, MHD Yamen Saraiji, Kouta Minamizawa.
  • Journal Title: In Proceedings of Augmented Human 2019 Volume: 29 Pages: 8-8
  • Peer Reviewed
• [Journal Article] Prosthetic Tail: Artificial Anthropomorphic Tail for Extending Innate Body Functions. (2019)
  • Author(s): Junichi Nabeshima, MHD Yamen Saraiji, Kouta Minamizawa.
  • Journal Title: In Proceedings of AH2019 Volume: 36 Pages: 4-4
  • DOI: 10.1145/3311823.3311848
  • NAID: 130007774241
  • Peer Reviewed
• [Journal Article] MusiArm: Extending Prosthesis to Musical Expression. (2019)
  • Author(s): Kaito Hatakeyama, MHD Yamen Saraiji, Kouta Minamizawa.
  • Journal Title: Laval Virtual ReVolution Volume: -
• [Journal Article] Illusory body ownership of an invisible body interpolated between virtual hands and feet via visual-motor synchronicity (2018)
  • Author(s): Kondo,R., Sugimoto, M., Minamizawa, K., Hoshi, T., Inami, M., and Kitazaki, M.
  • Journal Title: Scientific Reports Volume: 8 Issue: 1 Pages: 7541-7541
  • DOI: 10.1038/s41598-018-25951-2
  • Peer Reviewed
• [Journal Article] Fusion: full body surrogacy for collaborative communication (2018)
  • Author(s): MHD Yamen Saraiji, Tomoya Sasaki, Reo Matsumura, Kouta Minamizawa, and Masahiko Inami
  • Journal Title: In Proceedings of ACM SIGGRAPH 2018 Emerging Technologies Volume: 7
  • DOI: 10.1145/3214907.3214912
  • Peer Reviewed
• [Journal Article] MetaArmS: Body Remapping Using Feet-Controlled Artificial Arms (2018)
  • Author(s): MHD Yamen Saraiji, Tomoya Sasaki, Kai Kunze, Kouta Minamizawa, Masahiko Inami
  • Journal Title: In Proceedings of ACM UIST 2018 Volume: - Pages: 65-74
  • DOI: 10.1145/3242587.3242665
  • Peer Reviewed
• [Journal Article] MetaArms: Body Remapping Using Feet-Controlled Artificial Arms. (2018)
  • Author(s): Tomoya Sasaki, MHD Yamen Saraiji, Kouta Minamizawa, and Masahiko Inami.
  • Journal Title: In Proccedings of ACM UIST 2018 Volume: - Pages: 140-142
  • DOI: 10.1145/3266037.3271628
  • Peer Reviewed
• [Journal Article] 身体イメージに基づいた装着型機器の使用による 行動・心理への影響に関する検討 (2018)
  • Author(s): 竹腰美夏, 南澤孝太
  • Journal Title: 第 23 回日本バーチャルリアリティ学会大会論文集 Volume: -
• [Journal Article] Invisible long arm illusion: illusory body ownership by synchronous movement of hands and feet (2018)
  • Author(s): Kondo, R., Ueda, S., Sugimito, M., Minamizawa, K., Inami, M., and Kitazaki, M
  • Journal Title: International Conference on Artificial Reality and Telexistence Eurographics Symposium on Virtual Environments Volume: - Pages: 21-28
• [Journal Article] 四肢先端の視覚運動同期による伸張四肢透明身体への所有感生成 (2018)
  • Author(s): 近藤亮太, 杉本麻樹, 南澤孝太, 稲見昌彦,北崎充晃
  • Journal Title: 第 23 回日本バーチャルリアリティ学会大会論文集 Volume: -
• [Journal Article] 実指とバーチャルな腕の同期運動による身体所有感の変容 (2018)
  • Author(s): 谷大和，近藤亮太, 杉本麻樹, 南澤孝太, 稲見昌彦,北崎充晃
  • Journal Title: 第 23 回日本バーチャルリアリティ学会大会論文集 Volume: -
• [Journal Article] サイバー空間と実空間をつなぐwe-modeの可能性 (2017)
  • Author(s): 北崎充晃
  • Journal Title: 心理学評論 Volume: 59（3） Pages: 312-323
  • NAID: 130006337920
• [Presentation] MetaArms: Body Remapping Using Feet-Controlled Artificial Arms (2018)
  • Author(s): Tomoya Sasaki, MHD Yamen Saraiji, Kouta Minamizawa, Masahiko Inami
  • Organizer: UIST 2018 Demo
  • Int'l Joint Research
• [Presentation] MetaArms: Body Remapping Using Feet-Controlled Artificial Arms (2018)
  • Author(s): MHD Yamen Saraiji, Tomoya Sasaki, Kai Kunze, Kouta Minamizawa, Masahiko Inami
  • Organizer: UIST 2018
  • Int'l Joint Research
• [Presentation] Fusion: Full Body Surrogacy for Collaborative Communication (2018)
  • Author(s): MHD Yamen Saraiji, Tomoya Sasaki, Reo Matsumura, Kouta Minamizawa, Masahiko Inami
  • Organizer: SIGGRAPH 2018 Emerging Technologies
• [Presentation] Vection modulated by awareness to the own body. (2018)
  • Author(s): Kitazaki, M., Fujisawa, S., Sugimoto, M. and Inami, M
  • Organizer: VSS (Vision Sciences Society meeting)
• [Presentation] 3D Reconstruction of Hand Postures by Measuring Skin Deformation on Back Hand (2018)
  • Author(s): Wakaba Kuno, Yuta Sugiura, Nao Asano, Wataru Kawai, and Maki Sugimoto,
  • Organizer: International Conference on Artificial Reality and Telexistence & Eurographics Symposium on Virtual Environments (ICAT-EGVE2017)
  • Int'l Joint Research
• [Presentation] Illusory body ownership between different body parts: Synchronization of right thumb and right arm (2018)
  • Author(s): Kondo, R., Tani, Y., Sugimoto, M., Minamizawa, K., Inami, M. and Kitazaki, M.
  • Organizer: IEEE Virtual
  • Int'l Joint Research
• [Presentation] 人はロボットにも共感する (2018)
  • Author(s): 北崎充晃
  • Organizer: 日本心理学会公開シンポジウム・科学としての心理学シリーズ「共感する心を科学する」
  • Invited
• [Presentation] 指と腕の同期運動による身体部位リマッピング (2018)
  • Author(s): 近藤亮太, 谷大和, 杉本麻樹, 南澤孝太, 稲見昌彦, 北崎充晃
  • Organizer: 脳と心のメカニズム第18回冬のワークショップ
• [Presentation] 義手のエンターテイメント性の拡張を目指した義手楽器「Musiarm」 (2018)
  • Author(s): 畠山海人, 中村開, 金箱淳一, 南澤孝太
  • Organizer: 情報処理学会アクセシビリティ研究会第6回研究会
• [Presentation] Spatial Calibration of Airborne Ultrasound Tactile Display and Projector-Camera System Using Fur Material (2017)
  • Author(s): Shigo Ko, Yuta Itoh, Yuta Sugiura, Takayuki Hoshi, and Maki Sugimoto
  • Organizer: TEI 2017 Work in Progress
  • Place of Presentation: Yokohama, Japan
  • Year and Date: 2017-03-20
  • Int'l Joint Research
• [Presentation] The illusory body ownership: Remapping of the right finger to the left arm by vision-action contingency of different body parts (2017)
  • Author(s): Kondo, R., Sugimoto, M., Minamizawa, K., Hoshi, T., Inami, M., and Kitazaki, M.
  • Organizer: IEEE Symposium on 3D User Interfaces
  • Place of Presentation: Los Angeles, CA, USA
  • Year and Date: 2017-03-18
  • Int'l Joint Research
• [Presentation] 人間拡張のためのユーザの脚部位を用いたロボットアームの制御手法. (2017)
  • Author(s): 佐々木智也, MHD Yamen Saraiji, Charith Lasantha Fernando, 南深孝太, 北崎充晃, 稲見昌彦.
  • Organizer: ロボティクス・メカトロニクス講演会
• [Presentation] MetaLimbs: Multiple Arms Interaction Metamorphism (2017)
  • Author(s): Tomoya Sasaki, MHD Yamen Saraiji, Charith Lasantha Fernando, Kouta Minamizawa, Masahiko Inami
  • Organizer: ACM SIGGRAPH 2017
  • Int'l Joint Research
• [Presentation] ゆりカモ目: 2台の360°カメラによるレール上浮遊体験 (2017)
  • Author(s): 坂井俊介, 勝又航生, 星貴之, 稲見昌彦
  • Organizer: エンタテイメントコンピューティング2017
• [Presentation] 光学迷彩における撮影系・投影系の共役配置 (2017)
  • Author(s): 泉原厚史, 川原田美雪, 脇坂崇平, 星貴之, 稲見昌彦
  • Organizer: 第22回日本バーチャルリアリティ学会大会
• [Presentation] 部位代替による複数の腕を用いた身体変容の研究 (2017)
  • Author(s): 佐々木智也, サライジムハマドヤメン, フェルナンドチャリス, 南澤孝太, 北崎充晃, 稲見昌彦
  • Organizer: 第22回 日本バーチャルリアリティ学大会
• [Presentation] Body and mind in virtual environment (2017)
  • Author(s): 北崎充晃
  • Organizer: The 2017 International Conference On Advanced Informatics: Concepts, Theory And Application (ICAICTA2017),
  • Int'l Joint Research / Invited
• [Presentation] Proprioceptive self-localization modulated by vection (2017)
  • Author(s): 北崎充晃
  • Organizer: VSS (Vision Sciences Society meeting)
  • Int'l Joint Research
• [Presentation] テレプレゼンスと自己運動，身体所有感覚, テレイグジスタンスOS, 3F2-03, (2017)
  • Author(s): 北崎充晃
  • Organizer: 第22回日本バーチャルリアリティ学会大会
• [Presentation] 手の甲の皮膚変形計測による手形状の三次元再構成 (2017)
  • Author(s): 久能若葉，杉浦裕太，浅野直生，河合航，杉本麻樹
  • Organizer: 第22回日本バーチャルリアリティ学会大会
• [Presentation] Changing Perceived Leg Length and Motion on Virtual Walking Generator (2016)
  • Author(s): Hamada, T., Yoshiho, K., Kondo, R., Ikei, Y., Hirota, K., Amemiya, T., and Kitazaki, M.
  • Organizer: The 8th International Conference on 3D Systems and Applications (3DSA2016)
  • Place of Presentation: Fukuoka, Japan
  • Year and Date: 2016-12-07
  • Int'l Joint Research
• [Presentation] Minimal virtual reality system for virtual walking in a real scene (2016)
  • Author(s): Kitazaki, M., Hirota, K. and Ikei, Y.
  • Organizer: 18th International Conference, HCI International 2016
  • Place of Presentation: Toronto, Canada
  • Year and Date: 2016-07-17
  • Int'l Joint Research
• [Presentation] Virtual walking generator by rhythmical modulation of omnidirectional images and foot sensations (2016)
  • Author(s): Hamada, T., Yoshiho, K., Kondo, R., Ikei, Y., Hirota, K. and Kitazaki, M.
  • Organizer: Eurohaptics 2016
  • Place of Presentation: London, UK
  • Year and Date: 2016-07-04
  • Int'l Joint Research
• [Presentation] Changing body ownership using visual metamorphosis (2016)
  • Author(s): Sasaki, T., Saraiji, M. Y., Minamizawa, K., Kitazaki, M. and Inami, M.
  • Organizer: Virtual Reality International Conference
  • Place of Presentation: Laval(France)
  • Year and Date: 2016-03-23
  • Int'l Joint Research
• [Presentation] Perceptual analysis of walking re-experience using 2ch vibrations on heels and walker's viewing motion images (2016)
  • Author(s): Kitazaki, M., Yoshiho, K., Ikei, Y., and Hirota, K.
  • Organizer: ASIAGRAPH2016
  • Place of Presentation: Toyama(Japan)
  • Year and Date: 2016-03-05
  • Int'l Joint Research
• [Presentation] Perceiving one's own invisible body through subjective completion of body parts with vision-action contingency (2016)
  • Author(s): Kondo, R., Inami, M., and Kitazaki, M.
  • Organizer: VSS (Vision Sciences Society meeting)
  • Place of Presentation: St. Pete Beach, Florida, USA
  • Int'l Joint Research
• [Presentation] 前庭感覚電気刺激による回旋性眼球運動への姿勢が与える影響に関する研究 (2015)
  • Author(s): 中村文彦，プルノマキシム，永谷直久，杉本麻樹
  • Organizer: 第20回日本バーチャルリアリティ学会大会論文集
  • Place of Presentation: 芝浦工業大学(東京都江東区)
  • Year and Date: 2015-09-09