• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Analysis of Reality Distorted Spatio-Temporal Field to Improve Human Skill and Motivation

Research Project

Project/Area Number 19H01129
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Review Section Medium-sized Section 61:Human informatics and related fields
Research InstitutionWaseda University

Principal Investigator

Morishima Shigeo  早稲田大学, 理工学術院, 教授 (10200411)

Co-Investigator(Kenkyū-buntansha) 稲見 昌彦  東京大学, 先端科学技術研究センター, 教授 (00345117)
野嶋 琢也  電気通信大学, 大学院情報理工学研究科, 准教授 (10392870)
暦本 純一  東京大学, 大学院情報学環・学際情報学府, 教授 (20463896)
小池 英樹  東京工業大学, 情報理工学院, 教授 (70234664)
持丸 正明  国立研究開発法人産業技術総合研究所, 情報・人間工学領域, 研究センター長 (90358169)
Project Period (FY) 2019-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥45,500,000 (Direct Cost: ¥35,000,000、Indirect Cost: ¥10,500,000)
Fiscal Year 2021: ¥14,690,000 (Direct Cost: ¥11,300,000、Indirect Cost: ¥3,390,000)
Fiscal Year 2020: ¥14,690,000 (Direct Cost: ¥11,300,000、Indirect Cost: ¥3,390,000)
Fiscal Year 2019: ¥16,120,000 (Direct Cost: ¥12,400,000、Indirect Cost: ¥3,720,000)
Keywords歪曲時空間制御 / ヴァーチャルリアリティ / スポーツトレーニング / 適用的可変速シャドーイングシステム / マーカーレスモーションキャプチャ / ARスポーツ観戦システム / 3次元プレイヤーモデリング / スキーシミュレータ / VR歪曲時空間環境 / リアルタイム着弾点予測 / プレイヤートラッキング / 適応的可変速シャドーウィングシステム / Cyber時空間制御 / 仮実空間相互接続 / Virtual Reality / Augmented Reality / 人間拡張 / Projection Mapping
Outline of Research at the Start

従来のVR/AR等,Cyber空間に関連する最先端研究においては, 空間の拡張・歪曲が主な研究課題となっており, 情報空間の時間軸自体を歪曲させる研究はあまり例がなかった. 空間だけでなく時間をも主観的に違和感なく歪曲させた現実歪曲時空間内での経験や訓練がPhysical世界での人の行動・知覚に与える影響を調査することが本研究課題である. 具体的な研究対象として,スポーツ,語学訓練等を例に取りあげ,具体的な現実歪曲時空間構成技術の確立および評価システム構築を行い,時間を歪曲されたCyber世界での経験や訓練の成果が,Physical世界にフィードバックされる効果を検証することが研究目的である.

Outline of Final Research Achievements

Previous state-of-the-art research topics in VR/AR are focusing mainly on expansion or distortion of 3D virtual space. There are rarely research topic about the control of the time scale in virtual information space. Not only 3D space but also time scale are modified subjectively natural in this research project and the influence of this Reality Distorted Spatio-Temporal Field to human activity or perception in physical world is accessed. Sports training and a language training are picked up as application examples and a concrete Reality Distorted Spatio-Temporal Field is designed and constructed. And the result of system evaluation shows the superiority that the sports or language training in our space-time distorted space brings effectively a feedback to trainees in physical world.

Academic Significance and Societal Importance of the Research Achievements

VR/AR技術は実用化の時代を迎えているが,従来の技術は空間の拡張に主眼がおかれており,時間軸を直接制御する技術は存在しなかった.そこで本研究課題では,バーチャル世界の3次元空間情報のみならず,時間スケールをもコントロール可能な歪曲時空間制御技術を提案し,スポーツトレーニングと語学訓練にターゲットを置いて,仮想世界の歪曲時空間制御によって,従来よりも効率的にスポーツや語学のスキル獲得が実現できる効果を評価実験により実証した.

Report

(5 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Annual Research Report
  • 2019 Comments on the Screening Results   Annual Research Report
  • Research Products

    (49 results)

All 2022 2021 2020 2019 Other

All Int'l Joint Research (3 results) Journal Article (22 results) (of which Int'l Joint Research: 8 results,  Peer Reviewed: 21 results,  Open Access: 18 results) Presentation (22 results) (of which Int'l Joint Research: 11 results,  Invited: 3 results) Remarks (1 results) Patent(Industrial Property Rights) (1 results)

  • [Int'l Joint Research] Durham University(英国)

    • Related Report
      2020 Annual Research Report
  • [Int'l Joint Research] University of South California(米国)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] Northumbria University(英国)

    • Related Report
      2019 Annual Research Report
  • [Journal Article] Developing the Thrower Detection System for Seamless Player-Ball Interaction in Augmented Dodgeball2021

    • Author(s)
      Kadri Rebane, David Hoernmark, Ryota Shijo, Sho Sakurai, Koichi Hirota, Takuya Nojima
    • Journal Title

      Transactions of the Virtual Reality Society of Japan

      Volume: 26 Issue: 2 Pages: 129-138

    • DOI

      10.18974/tvrsj.26.2_129

    • NAID

      130008058977

    • ISSN
      1344-011X, 2423-9593
    • Year and Date
      2021-06-30
    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Augmenting Team Games With a Ball to Promote Cooperative Play2021

    • Author(s)
      Kadri Rebane, Yo Inoue, David Hornmark, Ryota Shijo, Sho Sakurai, Koichi Hirota, and Takuya Nojima
    • Journal Title

      Augmented Human Research

      Volume: Vol. 6, Article No.7 Issue: 1 Pages: 1-13

    • DOI

      10.1007/s41133-021-00045-3

    • Related Report
      2021 Annual Research Report 2020 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Lower lung-volume level induces lower vertical center of mass position and alters swimming kinematics during front-crawl swimming2021

    • Author(s)
      Sohei Washino, Akihiko Murai, Hirotoshi Mankyu, Futoshi Ogita, Hiroaki Kanehisa, Yasuhide Yoshitake
    • Journal Title

      Journal of biomechanics

      Volume: Volume 121 Pages: 1-6

    • DOI

      10.1016/j.jbiomech.2021.110428

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] JustSpeak: Automated, User-Configurable, Interactive Agents for Speech Tutoring2021

    • Author(s)
      Xinlei Zhang, Takashi Miyaki, and Jun Rekimoto
    • Journal Title

      Proc. ACM Hum.-Comput. Interact. 5, EICS

      Volume: Article 202 Issue: EICS Pages: 24-24

    • DOI

      10.1145/3459744

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] A Language Acquisition Support System that Presents Differences and Distances from Model Speech2021

    • Author(s)
      Kazuki Kawamura and Jun Rekimoto
    • Journal Title

      The Adjunct Publication of the 34th Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery

      Volume: - Pages: 44-46

    • DOI

      10.1145/3474349.3480225

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Human Augmentation for Skill Acquisition and Skill Transfer2021

    • Author(s)
      Hideki Koike, Jun Rekimoto, Junichi Ushiba, Shinichi Furuya, and Asa Ito
    • Journal Title

      In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (CHI EA '21). Association for Computing Machinery

      Volume: Article 93 Pages: 1-3

    • DOI

      10.1145/3411763.3441354

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed
  • [Journal Article] MirrorNet: A Deep Reflective Approach to 2D Pose Estimation for Single-Person Images2021

    • Author(s)
      Takayuki Nakatsuka, Kazuyoshi Yoshii, Yuki Koyama, Satoru Fukayama, Masataka Goto, Shigeo Morishima
    • Journal Title

      Journal of Information Processing

      Volume: 29 Issue: 0 Pages: 406-423

    • DOI

      10.2197/ipsjjip.29.406

    • NAID

      130008038621

    • ISSN
      1882-6652
    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] 3D car shape reconstruction from a contour sketch using GAN and lazy learning2021

    • Author(s)
      Nozawa Naoki、Shum Hubert P. H.、Feng Qi、Ho Edmond S. L.、Morishima Shigeo
    • Journal Title

      The Visual Computer

      Volume: - Issue: 4 Pages: 1317-1330

    • DOI

      10.1007/s00371-020-02024-y

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Do We Need Sound for Sound Source Localization?2021

    • Author(s)
      Oya Takashi、Iwase Shohei、Natsume Ryota、Itazuri Takahiro、Yamaguchi Shugo、Morishima Shigeo
    • Journal Title

      Computer Vision - ACCV 2020

      Volume: 12627 Pages: 119-136

    • DOI

      10.1007/978-3-030-69544-6_8

    • ISBN
      9783030695439, 9783030695446
    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Song2Face: Synthesizing Singing Facial Animation from Audio2020

    • Author(s)
      Iwase Shohei、Kato Takuya、Yamaguchi Shugo、Yukitaka Tsuchiya、Morishima Shigeo
    • Journal Title

      ACM SIGGRAPH ASIA 2020 Technical Communication

      Volume: no.12 Pages: 1-4

    • DOI

      10.1145/3410700.3425435

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Audio-guided Video Interpolation via Human Pose Features2020

    • Author(s)
      Nakatsuka Takayuki、Hamanaka Masatoshi、Morishima Shigeo
    • Journal Title

      Proceedings of the 15th International Conference on Computer Vision Theory and Applications (VISAPP 2020)

      Volume: Volume 5: VISAPP Pages: 27-35

    • DOI

      10.5220/0008876600270035

    • Related Report
      2020 Annual Research Report 2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] LinSSS: linear decomposition of heterogeneous subsurface scattering for real-time screen-space rendering2020

    • Author(s)
      Yatagawa Tatsuya、Yamaguchi Yasushi、Morishima Shigeo
    • Journal Title

      The Visual Computer

      Volume: 36 Issue: 10-12 Pages: 1979-1992

    • DOI

      10.1007/s00371-020-01915-4

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Resolving hand‐object occlusion for mixed reality with joint deep learning and model optimization2020

    • Author(s)
      Feng Qi、Shum Hubert P. H.、Morishima Shigeo
    • Journal Title

      Computer Animation and Virtual Worlds

      Volume: 31 Issue: 4-5

    • DOI

      10.1002/cav.1956

    • Related Report
      2020 Annual Research Report
    • Open Access / Int'l Joint Research
  • [Journal Article] Foreground-aware Dense Depth Estimation for 360 Images2020

    • Author(s)
      Feng Qi、Shum Hubert P. H.、Shimamura Ryo、Morishima Shigeo
    • Journal Title

      Journal of WSCG

      Volume: 28 Issue: 1-2 Pages: 79-88

    • DOI

      10.24132/jwscg.2020.28.10

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] WithYou: Automated Adaptive Speech Tutoring With Context-Dependent Speech Recognition2020

    • Author(s)
      Zhang Xinlei、Miyaki Takashi、Rekimoto Jun
    • Journal Title

      CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

      Volume: - Pages: 1-12

    • DOI

      10.1145/3313831.3376322

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Mediated-Timescale Learning: Manipulating Timescales in Virtual Reality to Improve Real-World Tennis Forehand Volley2020

    • Author(s)
      Jiang Shixin、Rekimoto Jun
    • Journal Title

      VRST '20: 26th ACM Symposium on Virtual Reality Software and Technology

      Volume: No.: 63 Pages: 1-2

    • DOI

      10.1145/3385956.3422128

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] FuturePong: Real-time Table Tennis Trajectory Forecasting using Pose Prediction Network2020

    • Author(s)
      Wu Erwin、Koike Hideki
    • Journal Title

      CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

      Volume: - Pages: 1-8

    • DOI

      10.1145/3334480.3382853

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Association between Changes in Swimming Velocity, Vertical Center of Mass Position, and Projected Frontal Area during Maximal 200-m Front Crawl2020

    • Author(s)
      Washino, S., Murai, A., Mankyu, H., & Yoshitake, Y
    • Journal Title

      Multidisciplinary Digital Publishing Institute Proceedings

      Volume: 49

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Toward Augmented Reality Displays for Sports Spectators: A Preliminary Study2020

    • Author(s)
      Hertzog Clara、Sakurai Sho、Hirota Koichi、Nojima Takuya
    • Journal Title

      Proceedings of The 13th Conference of the International Sports Engineering Association

      Volume: 49 Pages: 129-129

    • DOI

      10.3390/proceedings2020049129

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Real-time Rendering of Layered Materials with Anisotropic Normal Distributions2020

    • Author(s)
      Yamaguchi Tomoya, Yatagawa Tatsuya, Tokuyoshi Yusuke, Morishima Shigeo
    • Journal Title

      Computational Visual Media

      Volume: 6 Issue: 1 Pages: 29-36

    • DOI

      10.1007/s41095-019-0154-z

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Data compression for measured heterogeneous subsurface scattering via scattering profile blending2019

    • Author(s)
      Yatagawa Tatsuya、Todo Hideki、Yamaguchi Yasushi、Morishima Shigeo
    • Journal Title

      The Visual Computer

      Volume: - Issue: 3 Pages: 1-18

    • DOI

      10.1007/s00371-018-01626-x

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Real‐time Indirect Illumination of Emissive Inhomogeneous Volumes using Layered Polygonal Area Lights2019

    • Author(s)
      Kuge Takahiro、Yatagawa Tatsuya、Morishima Shigeo
    • Journal Title

      Computer Graphics Forum

      Volume: 38 Issue: 7 Pages: 449-460

    • DOI

      10.1111/cgf.13851

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] Skiing, Fast and Slow: Evaluation of Time Distortion for VR Ski Training2022

    • Author(s)
      Takashi Matsumoto, Erwin Wu, and Hideki Koike
    • Organizer
      In Augmented Humans 2022 (AHs 2022)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A System for Augmenting Humans’ ability to Learn Kendama Tricks through Virtual Reality Training2022

    • Author(s)
      Hitoshi Kawasaki, Sohei Wakisaka, Hiroto Saito, Atsushi Hiyama, and Masahiko Inami
    • Organizer
      In Augmented Humans 2022 (AHs 2022). Association for Computing Machinery
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 大学体育における超人スポーツの可能性2022

    • Author(s)
      稲見昌彦
    • Organizer
      第13回大学体育指導者養成研修会
    • Related Report
      2021 Annual Research Report
    • Invited
  • [Presentation] A Study on the Integration Method of Sports Practice and Video Games2021

    • Author(s)
      Sakuto Hoshi, Kazutaka Kurihara, Sho Sakurai, Koichi Hirota & Takuya Nojima
    • Organizer
      HCII 2021: HCI International 2021 - Late Breaking Posters, 2021, pp 443-450, 国際学会
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] VR空間内における近接感覚の生成に関する研究2021

    • Author(s)
      松村 悠司、櫻井 翔、広田 光一、野嶋 琢也
    • Organizer
      第26回日本バーチャルリアリティ学会大会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 遠隔地のスポーツ観戦者同士の一体感醸成手法に関する提案2021

    • Author(s)
      樫村 侑樹、櫻井 翔、広田 光一、野嶋 琢也
    • Organizer
      第26回日本バーチャルリアリティ学会大会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 時間歪曲機能を用いたVRスキートレーニングの拡張2021

    • Author(s)
      松本 高,Erwin Wu,小池 英樹
    • Organizer
      日本ソフトウェア科学会 第29回インタラクティブシステムとソフトウェアに関するワークショップ(WISS2021)
    • Related Report
      2021 Annual Research Report
  • [Presentation] ボールジャグリング練習映像に基づいた教示推薦システムの構築と応用2021

    • Author(s)
      岡田健嗣, 脇坂崇平, 髙原慧一, 荒川陸, 稲見昌彦
    • Organizer
      第35回身体知研究会
    • Related Report
      2021 Annual Research Report
  • [Presentation] Virtual Cyborg: Beyond Human Limits2021

    • Author(s)
      Masahiko Inami
    • Organizer
      NICOGRAPH International 2021, 2021.7
    • Related Report
      2021 Annual Research Report
    • Invited
  • [Presentation] LSTM-SAKT: LSTM-Encoded SAKT-like Transformer for Knowledge Tracing2021

    • Author(s)
      Takashi Oya, Shigeo Morishima
    • Organizer
      AAAI 2021 Workshop on Imaging Post-COVID Education with AI
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] DATSURYOKU:身体環境インタラクションが筋活動をデザインする2021

    • Author(s)
      村井昭彦, 鷲野壮平, 持丸正明
    • Organizer
      第26回ロボティクスシンポジア予稿集
    • Related Report
      2020 Annual Research Report
  • [Presentation] 異なるタイプのデジタルヒューマンモデルが運動中のモデル体積に及ぼす影響2021

    • Author(s)
      鷲野壮平, 村井昭彦
    • Organizer
      第26回ロボティクスシンポジア予稿集
    • Related Report
      2020 Annual Research Report
  • [Presentation] ジャグリングにおけるスロー・キャッチ動作学習支援のための時間軸を操作可能な力触覚提示 VR システムの提案2020

    • Author(s)
      原口純也, 脇坂崇平, Alfonso Balandra, 前川和純, 堀江新, 佐々木智也, 檜山敦史, 長谷川晶一, 稲見昌彦
    • Organizer
      計測自動制御学会システムインテグレーション部門
    • Related Report
      2020 Annual Research Report
  • [Presentation] Asynchronous Eulerian Liquid Simulation2020

    • Author(s)
      Tatsuya Koike, Shigeo Morishima, Ryoichi Ando
    • Organizer
      Eurographics 2020
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] WithYou: Automated Adaptive Speech Tutoring With Context-Dependent Speech Recognition2020

    • Author(s)
      Xinlei Zhang, Takashi Miyaki & Jun Rekimoto
    • Organizer
      CHI 2020
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization2019

    • Author(s)
      Shunsuke Saito, Zeng Huang, Ryota Natsume, Shigeo Morishima, Angjoo Kanazawa, Hao Li
    • Organizer
      International Conference on Computer Vision 2019
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Automatic Sign Dance Synthesis from Gesture-based SignLanguag2019

    • Author(s)
      Naoya Iwamoto, Hubert P. H. Shum, Wakana Asahina, Shigeo Morishima
    • Organizer
      MIG 2019
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] SiCloPe: Silhouette-Based Clothed People2019

    • Author(s)
      Ryota Natsume, Shunsuke Saito, Zeng Huang, Weikai Chen, Chongyang Ma, Hao Li, Shigeo Morishima
    • Organizer
      CVPR 2019
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Real-time Table Tennis Forecasting System Based on Long Short-term Pose Prediction Network2019

    • Author(s)
      Erwin Wu, Florian Perteneder, Hideki Koike
    • Organizer
      SIGGRAPH 2019
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 身体環境インピーダンスのモデル化とデザイン2019

    • Author(s)
      村井昭彦
    • Organizer
      ロボティクス・メカトロニクス講演会2019
    • Related Report
      2019 Annual Research Report
  • [Presentation] Augmented Dodgeball AR Viewer for Spectators2019

    • Author(s)
      Shota Azuma, Clara Hertzog, Sho Sakurai, Koichi Hirota, and Takuya Nojima
    • Organizer
      International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments(ICAT-EGVE)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 既存スポーツと既存ビデオゲームを融合させた競技の提案と実装2019

    • Author(s)
      山田 恭平, 栗原 一貴, 野嶋 琢也
    • Organizer
      WISS 2019
    • Related Report
      2019 Annual Research Report
  • [Remarks] 早稲田大学 森島研究室

    • URL

      http://www.mlab.phys.waseda.ac.jp/

    • Related Report
      2019 Annual Research Report
  • [Patent(Industrial Property Rights)] 画像レンダリング方法、画像レンダリングシステム及びプログラム2019

    • Inventor(s)
      久家隆宏、谷田川達也、森島繁生(出願者は早稲田大学)
    • Industrial Property Rights Holder
      学校法人早稲田大学
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2019-159051
    • Filing Date
      2019
    • Related Report
      2019 Annual Research Report

URL: 

Published: 2019-04-18   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi