• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A high speed procam and its application to particle display

Research Project

Project/Area Number 16H02856
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Human interface and interaction
Research InstitutionTokyo Institute of Technology

Principal Investigator

Koike Hideki  東京工業大学, 情報理工学院, 教授 (70234664)

Project Period (FY) 2016-04-01 – 2020-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥16,120,000 (Direct Cost: ¥12,400,000、Indirect Cost: ¥3,720,000)
Fiscal Year 2019: ¥2,340,000 (Direct Cost: ¥1,800,000、Indirect Cost: ¥540,000)
Fiscal Year 2018: ¥3,120,000 (Direct Cost: ¥2,400,000、Indirect Cost: ¥720,000)
Fiscal Year 2017: ¥4,030,000 (Direct Cost: ¥3,100,000、Indirect Cost: ¥930,000)
Fiscal Year 2016: ¥6,630,000 (Direct Cost: ¥5,100,000、Indirect Cost: ¥1,530,000)
Keywords立体ディスプレイ / モーションキャプチャ / 実時間追跡 / プロジェクション / プロジェクションマッピング / カルマンフィルタ / 予測投影 / 3次元ディスプレイ / プロジェクション・マッピング / 3次元ディスプレイ
Outline of Final Research Achievements

Unlike projection mapping on a static object, projection on a fast moving object causes a delay in projection. Previous research has proposed a method to predict the position of an object using a Kalman filter, but this method does not deal with projections onto objects with three-dimensional shapes. In this study, we attempted to solve the above delay by learning the object's motion using deep learning, simultaneously predicting the object's position and 3D posture in about 0.5 seconds, and projecting the object. As a result of the experiment, we were able to improve the projection accuracy compared to the case of no prediction and Kalman filter prediction only.

Academic Significance and Societal Importance of the Research Achievements

近年,プロジェクションマッピングが一般化しているが,これらは建築物や低速で移動する物体のみを対象としていた.これに対し,本研究は,高速に移動する任意の形状の物体への正確なプロジェクションマッピングを実現した.本研究成果は,今後,立体ディスプレイへの応用,さらには,舞台芸術,テーマパーク,さらにはスポーツ等への応用が期待できる.

Report

(5 results)
  • 2020 Final Research Report ( PDF )
  • 2019 Annual Research Report
  • 2018 Annual Research Report
  • 2017 Annual Research Report
  • 2016 Annual Research Report
  • Research Products

    (5 results)

All 2020 2017 2016 Other

All Journal Article (1 results) (of which Peer Reviewed: 1 results) Presentation (3 results) (of which Int'l Joint Research: 3 results) Remarks (1 results)

  • [Journal Article] Qoom: An Interactive Omnidirectional Ball Display2017

    • Author(s)
      Miyafuji Shio、Sato Toshiki、Li Zhengqing、Koike Hideki
    • Journal Title

      Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology

      Volume: UIST2017 Pages: 599-609

    • DOI

      10.1145/3126594.3126607

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Presentation] MirAIProjection: Real-time Projection onto High-speed Objects by Predicting Their 3D Position and Pose using DNNs2020

    • Author(s)
      Maeda Kosuke、Koike Hideki
    • Organizer
      AVI '20: Proceedings of the International Conference on Advanced Visual Interfaces
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Ballumiere: Real-Time Tracking and Spherical Projection for High-Speed Moving Balls2016

    • Author(s)
      Shio Miyafuji, Masato Sugasaki, Hideki Koike
    • Organizer
      the 2016 ACM on Interactive Surfaces and Spaces (ISS'16)
    • Place of Presentation
      Niagara Falls, Canada
    • Year and Date
      2016-11-06
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Ballumiere: Real-Time Tracking and Projection for High-Speed Moving Balls2016

    • Author(s)
      Shio Miyafuji, Masato Sugasaki, Hideki Koike
    • Organizer
      the 29th Annual Symposium on User Interface Software and Technology (UIST2016)
    • Place of Presentation
      Tokyo Japan
    • Year and Date
      2016-10-16
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Remarks] Ballumiere

    • URL

      http://www.vogue.cs.titech.ac.jp/projects/vision-based-hci/ballumiere

    • Related Report
      2016 Annual Research Report

URL: 

Published: 2016-04-21   Modified: 2022-01-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi