• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Dynamic material augmentation on arbitrary objects by high-speed invisible light measurement

Research Project

Project/Area Number 18K18086
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 61020:Human interface and interaction-related
Research InstitutionThe University of Tokyo

Principal Investigator

Miyashita Leo  東京大学, 情報基盤センター, 特任講師 (40808721)

Project Period (FY) 2018-04-01 – 2021-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥3,380,000 (Direct Cost: ¥2,600,000、Indirect Cost: ¥780,000)
Fiscal Year 2020: ¥390,000 (Direct Cost: ¥300,000、Indirect Cost: ¥90,000)
Fiscal Year 2019: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2018: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Keywords質感 / プロジェクションマッピング / 拡張現実 / 反射特性 / 弾性 / マーカーレス / モデルレス / 高速法線計測 / 不可視光
Outline of Final Research Achievements

In this project, visual material overwriting with techniques of dynamic projection mapping that enables projection also onto a dynamically moving and deforming object has been studied. As a result, methods to overwrite optical and kinetic material by projection without any markers and shape models of a target have been established. These methods realize dynamic and flexible virtual material representation, and are expected to be utilized in the entertainment field and scientific investigation for human visual recognition ability to materials.

Academic Significance and Societal Importance of the Research Achievements

本研究成果は、これまで扱えなかったマーカーや形状モデルを設定できない物体や非協力的な物体、さらに流体や群体といった物体に対して事前の準備なしにプロジェクションマッピングを施し、視覚的に質感を書き換える技術である.この技術はCGにおける仮想的な質感を実世界に投影して質感表現を拡張し、人間の質感に対する認識能力を科学的に解明するための質感提示システムとして活用が期待されるものである.

Report

(4 results)
  • 2020 Annual Research Report   Final Research Report ( PDF )
  • 2019 Research-status Report
  • 2018 Research-status Report
  • Research Products

    (7 results)

All 2021 2020 2019 2018

All Journal Article (1 results) (of which Peer Reviewed: 1 results) Presentation (6 results) (of which Int'l Joint Research: 3 results,  Invited: 3 results)

  • [Journal Article] MIDAS projection: markerless and modelless dynamic projection mapping for material representation2018

    • Author(s)
      Miyashita Leo、Watanabe Yoshihiro、Ishikawa Masatoshi
    • Journal Title

      ACM Transactions on Graphics

      Volume: 37 Issue: 6 Pages: 1-12

    • DOI

      10.1145/3272127.3275045

    • Related Report
      2018 Research-status Report
    • Peer Reviewed
  • [Presentation] 世界を書き換えるダイナミックプロジェクションマッピング2021

    • Author(s)
      宮下令央
    • Organizer
      IPSJ ONE 2021
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] High-speed simultaneous measurement of depth and normal for real-time 3D reconstruction2021

    • Author(s)
      Leo Miyashita, Yohta Kimura, Satoshi Tabata, Masatoshi Ishikawa
    • Organizer
      SPIE Optical Engineering + Applications, Applications of Digital Image Processing XLIV
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] ElaMorph Projection: Deformation of 3D Shape by Dynamic Projection Mapping2020

    • Author(s)
      Kentaro Fukamizu, Leo Miyashita, Masatoshi Ishikawa
    • Organizer
      International Symposium on Mixed and Augmented Reality (ISMAR2020)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] MIDAS Projection: マーカーレス・モデルレスの動的プロジェクションマッピングによる質感表現2019

    • Author(s)
      宮下 令央, 渡辺 義浩, 石川 正俊
    • Organizer
      Visual Computing (VC 2019)
    • Related Report
      2019 Research-status Report
    • Invited
  • [Presentation] MIDAS Projection: Markerless and Modelless Dynamic Projection Mapping for Material Representation2019

    • Author(s)
      宮下 令央, 渡辺 義浩, 石川 正俊
    • Organizer
      第22回画像の認識・理解シンポジウム (MIRU2019)
    • Related Report
      2019 Research-status Report
    • Invited
  • [Presentation] MIDAS projection: markerless and modelless dynamic projection mapping for material representation2018

    • Author(s)
      Leo Miyashita
    • Organizer
      ACM SIGGRAPH ASIA 2018
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2018-04-23   Modified: 2022-01-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi