• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

3D motion visualization by spatio-temporal light field projection

Research Project

Project/Area Number 20H04209
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 61010:Perceptual information processing-related
Research InstitutionNagoya Institute of Technology

Principal Investigator

Sakaue Fumihiko  名古屋工業大学, 工学(系)研究科(研究院), 准教授 (00432287)

Co-Investigator(Kenkyū-buntansha) 佐藤 淳  名古屋工業大学, 工学(系)研究科(研究院), 教授 (20303688)
Project Period (FY) 2020-04-01 – 2023-03-31
Project Status Completed (Fiscal Year 2022)
Budget Amount *help
¥17,810,000 (Direct Cost: ¥13,700,000、Indirect Cost: ¥4,110,000)
Fiscal Year 2022: ¥5,070,000 (Direct Cost: ¥3,900,000、Indirect Cost: ¥1,170,000)
Fiscal Year 2021: ¥5,460,000 (Direct Cost: ¥4,200,000、Indirect Cost: ¥1,260,000)
Fiscal Year 2020: ¥7,280,000 (Direct Cost: ¥5,600,000、Indirect Cost: ¥1,680,000)
Keywordsコンピュテーショナルプロジェクション / コンピュテーショナルフォトグラフィ / ライトフィールド処理 / ライトフィールドプロジェクション / 運動情報の可視化 / 高速プロジェクタ / 時空間ライトフィールド / 観測における時間積分 / カメラを用いないCV技術 / 視覚特性計測
Outline of Research at the Start

本課題では,光を投影するだけで運動情報を視覚情報として可視化する技術の研究・開発を行う.この技術では,プロジェクタなどの制御可能な光源から対象に対して特殊なパターンの投影を行い,ユーザ(人間)がこれを観測する.ここで,対象が運動を行うと,ユーザが観測する結果が劇的に変化し,その変化により運動情報を直感的に理解することが可能となる.この技術はカメラや計算機を一切用いることなく運動情報を解析することが可能な新しい技術であり,リアルタイムでの運動解析や,運転支援など,即応性が必要とされる様々なシステムへの応用が期待できる.

Outline of Final Research Achievements

This technique does not use a camera to acquire scene information and a computer to analyze the acquired information, which are commonly used in conventional image processing techniques. Instead, a light field projector consisting of multiple controllable projectors is used to project a special pattern of light rays (light field) onto the object to complete the analysis of scene motion information and presentation of the analyzed information. In this system, the superimposition of light rays on the object's surface and the observer's observation of the light rays are regarded as a kind of arithmetic process, and the analysis and presentation of motion can be realized through these operations. The system is highly responsive, eliminating factors that cause delays in the presentation of information, such as the use of a camera to capture the scene and image processing on a computer.

Academic Significance and Societal Importance of the Research Achievements

本課題で提案する方法は,本来観測系と計算機によって構成されるデータ解析を,光の足し合わせによる物理現象によって置き換えるといった点で画期的な方法であるといえる.この方法を利用することで,観測・処理に伴う時間遅延を原理的に0にすることが可能である.そのため,わずかな遅延が致命的な事態を引き起こすシーンにおいては絶大な効果が得られると考えられる.例えば,運転支援の前処理などで使用することで,全体の処理の高速化・安定化などの実現が期待できる.

Report

(4 results)
  • 2022 Annual Research Report   Final Research Report ( PDF )
  • 2021 Annual Research Report
  • 2020 Annual Research Report
  • Research Products

    (14 results)

All 2023 2022 2021 2020

All Presentation (14 results) (of which Int'l Joint Research: 9 results)

  • [Presentation] Eyesight Free Image Representation by Tomographic Display2023

    • Author(s)
      K. Yamamoto, F. Sakaue and J. Sato
    • Organizer
      Proc. International Conference on Computer Vision Theory and Applications (VISAPP2023)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Multimodal Light-Field Camera with External Optical Filters Based on Unsupervised Learning2023

    • Author(s)
      T. Shibata, F. Sakaue and J. Sato
    • Organizer
      Proc. International Conference on Computer Vision Theory and Applications (VISAPP2023)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Inverse Rendering Based on Compressed Spatiotemporal Information by Nural Networks2023

    • Author(s)
      E. Itonaga, F. Sakaue and J. Sato
    • Organizer
      Proc. International Conference on Computer Vision Theory and Applications (VISAPP2023)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 運動に応じて観測結果が変化する多重画像提示2022

    • Author(s)
      川口真, 坂上文彦, 佐藤淳
    • Organizer
      第25回 画像の認識・理解シンポジウム(MIRU2022)
    • Related Report
      2022 Annual Research Report
  • [Presentation] ライトフィールドディスプレイを用いた視力に依存しない鮮明な画像提示2022

    • Author(s)
      山本敬信, 坂上文彦, 佐藤淳
    • Organizer
      第25回 画像の認識・理解シンポジウム(MIRU2022)
    • Related Report
      2022 Annual Research Report
  • [Presentation] 混合焦点カメラを用いた高密度なライトフィールド撮影2022

    • Author(s)
      廣瀬正人, 坂上文彦, 佐藤淳
    • Organizer
      第25回 画像の認識・理解シンポジウム(MIRU2022)
    • Related Report
      2022 Annual Research Report
  • [Presentation] Modelling Reflections on Complex Microstructures for Multiplex Image Projection2022

    • Author(s)
      N. Takahashi, F. Sakaue and J. Sato
    • Organizer
      International Workshop on Advanced Image Technology
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Adaptive Image Projection onto Scattering Medium2022

    • Author(s)
      S. Akatsuka, F. Sakaue and J. Sato
    • Organizer
      International Workshop on Advanced Image Technology (IWAIT2022) (2022.1)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Image Encoding Display and Decoding Observation based on Coded Aperture Considering Semantic Image Distance2022

    • Author(s)
      J. Umetsu, F. Sakaue, J. Sato
    • Organizer
      International Joint Conference on Computer Vision, Theory and Applications
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 視覚の時間積分特性および時間応答特性に基づく多重画像提示2022

    • Author(s)
      川口 真,坂上文彦,佐藤 淳
    • Organizer
      情報処理学会 第84回全国大会
    • Related Report
      2021 Annual Research Report
  • [Presentation] Distance Measurement in Fog using Polarized ToF Camera2021

    • Author(s)
      Y. Watarai, F. Sakaue, J. Sato
    • Organizer
      International Conference on Computer Vision Theory and Applications (VISAPP2021)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Depth Recovery from Non-uniform Haze Image2021

    • Author(s)
      T. Suzuki, F. Sakaue, J. Sato
    • Organizer
      International Conference on Computer Vision Theory and Applications (VISAPP2021)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Active 3D Motion Visualization Based on Spatiotemporal Light-Ray Integration2020

    • Author(s)
      F. Sakaue, J. Sato
    • Organizer
      IEEE Conference on Computer Vision and Pattern Recognition (CVPR2020)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 時空間符号化画像提示と復号観測2020

    • Author(s)
      梅津潤也, 坂上文彦, 佐藤淳
    • Organizer
      第23回 画像の認識・理解シンポジウム(MIRU2020)
    • Related Report
      2020 Annual Research Report

URL: 

Published: 2020-04-28   Modified: 2024-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi