• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Spatio-temporal modulation imaging toward measurements of shape and physical properties

Research Project

Project/Area Number 23K20382
Project/Area Number (Other) 20H04215 (2020-2023)
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeMulti-year Fund (2024)
Single-year Grants (2020-2023)
Section一般
Review Section Basic Section 61010:Perceptual information processing-related
Research InstitutionUniversity of Tsukuba (2021-2024)
National Institute of Informatics (2020)

Principal Investigator

Tsuyoshi Takatani  筑波大学, システム情報系, 助教 (90809758)

Co-Investigator(Kenkyū-buntansha) 鄭 銀強  東京大学, 大学院情報理工学系研究科, 教授 (30756896)
青砥 隆仁  筑波大学, システム情報系, 助教 (00785462)
Project Period (FY) 2024-04-01 – 2025-03-31
Project Status Completed (Fiscal Year 2024)
Budget Amount *help
¥17,680,000 (Direct Cost: ¥13,600,000、Indirect Cost: ¥4,080,000)
Fiscal Year 2024: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2023: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Fiscal Year 2022: ¥2,990,000 (Direct Cost: ¥2,300,000、Indirect Cost: ¥690,000)
Fiscal Year 2021: ¥3,770,000 (Direct Cost: ¥2,900,000、Indirect Cost: ¥870,000)
Fiscal Year 2020: ¥7,800,000 (Direct Cost: ¥6,000,000、Indirect Cost: ¥1,800,000)
Keywordsコンピュテーショナルイメージング / コンピュテーショナルフォトグラフィ / コンピュータビジョン
Outline of Research at the Start

従来のコンピュータビジョン研究では,縮退した2次元画像を入力とすることを前提としてきたが,これはカメラという古典的計測デバイスの制約によるものである.本研究では,時空間的な光の挙動に基づくシーン理解を可能とする時空間変調イメージングという新しい計測の枠組みを確立し,その有用性を示すことでコンピュータビジョンにおける前提に革新をもたらすことを目的とする.時空間的な光の挙動は,物体の形状や材質の光学特性,内部構造などと深い関連を持つため,シーン理解において重要な手がかりとなる.

Outline of Final Research Achievements

The main objective of this research was to establish the foundation of "spatio-temporal modulation imaging," a new framework that modulates illumination light in both space and time, and we achieved development beyond our initial plans. As outcomes, we developed distance measurement and material discrimination methods using Time-of-Flight (ToF) imaging, which is a form of temporal modulation, and realized high-speed shape measurement by combining rotating modulated light sources with event cameras. Additionally, we pioneered a new ToF measurement method that temporally modulates polarization states.

Academic Significance and Societal Importance of the Research Achievements

これまでに距離計測手法と認識されてきたToF計測を,異なる応用である材料計測に用いれることを示し,計測手法の応用範囲を拡大した.また,イベントカメラを用いた測光学的な計測は学術的にも産業的にも新しい挑戦であり,イベントカメラ応用の多様化および新しい機械視覚の実現に貢献した.さらに,新しい方式のToF計測は距離画像の空間解像度向上に寄与する可能性を秘めており,学術的・社会的意義は大きい.

Report

(6 results)
  • 2024 Annual Research Report   Final Research Report ( PDF )
  • 2023 Annual Research Report
  • 2022 Annual Research Report
  • 2021 Annual Research Report
  • 2020 Annual Research Report
  • Research Products

    (23 results)

All 2025 2024 2023 2022 2021 2020 2019 Other

All Int'l Joint Research (1 results) Journal Article (3 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 3 results,  Open Access: 3 results) Presentation (17 results) (of which Int'l Joint Research: 6 results,  Invited: 3 results) Book (2 results)

  • [Int'l Joint Research] Beijing Institute of Technology(中国)

    • Related Report
      2024 Annual Research Report
  • [Journal Article] Polarization-Modulated Optical Homodyne for Time-of-Flight Imaging with Standard CMOS Sensors2025

    • Author(s)
      Ebisu Ayaka、Aoto Takahito、Takatani Tsuyoshi
    • Journal Title

      Sensors

      Volume: 25 Issue: 6 Pages: 1886-1886

    • DOI

      10.3390/s25061886

    • Related Report
      2024 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] EventHDR: From Event to High-Speed HDR Videos and Beyond2025

    • Author(s)
      Zou Yunhao、Fu Ying、Takatani Tsuyoshi、Zheng Yinqiang
    • Journal Title

      IEEE Transactions on Pattern Analysis and Machine Intelligence

      Volume: 47 Issue: 1 Pages: 32-50

    • DOI

      10.1109/tpami.2024.3469571

    • Related Report
      2024 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Time-resolved Far Infrared Light Transport for Thermal Photometric Stereo2019

    • Author(s)
      K. Tanaka, Nobuhiro Ikeya, Tsuyoshi Takatani, H. Kubo, T. Funatomi, V. Ravi, A. Kadambi, Y. Mukaigawa
    • Journal Title

      IEEE Transaction on Pattern Analysis and Machine Intelligence

      Volume: EA Issue: 6 Pages: 1-12

    • DOI

      10.1109/tpami.2019.2959304

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] Event-based Computational Imaging using Modulated Illumination2024

    • Author(s)
      Tsuyoshi Takatani
    • Organizer
      6th International Workshop on Image Sensors and Imaging Systems (IWISS2024)
    • Related Report
      2024 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Time-of-Flightイメージングを用いた材質分類における距離依存性の除去2024

    • Author(s)
      金澤 樹希, 青砥 隆仁, 髙谷 剛志
    • Organizer
      第27回 画像の認識・理解シンポジウム(MIRU2024)
    • Related Report
      2024 Annual Research Report
  • [Presentation] イベントカメラと運動光源を用いた法線推定2024

    • Author(s)
      北沢 一真, 青砥 隆仁, 池畑 諭, 髙谷 剛志
    • Organizer
      第27回 画像の認識・理解シンポジウム(MIRU2024)
    • Related Report
      2024 Annual Research Report
  • [Presentation] イベントカメラと運動光源を用いた外観検査手法2024

    • Author(s)
      北沢 一真, 髙谷 剛志
    • Organizer
      第30回 画像センシングシンポジウム(SSII2024)
    • Related Report
      2024 Annual Research Report
  • [Presentation] 運動光源下におけるイベント間隔に基づく法線推定2024

    • Author(s)
      北沢 一真, 青砥 隆仁, 池畑 諭, 髙谷 剛志
    • Organizer
      情報処理学会コンピュータビジョンとイメージメディア研究会プログラム(第238回)
    • Related Report
      2024 Annual Research Report
  • [Presentation] 時間相関を用いた双対画像の生成2023

    • Author(s)
      山﨑 啓太, 髙谷 剛志, 青砥 隆仁
    • Organizer
      第26回 画像の認識・理解シンポジウム(MIRU2023)
    • Related Report
      2023 Annual Research Report
  • [Presentation] 光の時間遅れと偏光状態を用いた材質分類の検討2023

    • Author(s)
      金澤 樹希, 青砥 隆仁, 髙谷 剛志
    • Organizer
      第26回 画像の認識・理解シンポジウム(MIRU2023)
    • Related Report
      2023 Annual Research Report
  • [Presentation] 偏光変調を用いた相関演算による間接Time-of-Flight法の検討2023

    • Author(s)
      蛭子 綾花, 青砥 隆仁, 北野 和哉, 髙谷 剛志
    • Organizer
      第26回 画像の認識・理解シンポジウム(MIRU2023)
    • Related Report
      2023 Annual Research Report
  • [Presentation] 時間遅れと偏光状態に基づく材質分類の検討2023

    • Author(s)
      金澤 樹希, 青砥 隆仁, 髙谷 剛志
    • Organizer
      研究報告コンピュータビジョンとイメージメディア(CVIM)
    • Related Report
      2023 Annual Research Report
  • [Presentation] Event-guided Video Clip Generation from Blurry Images2022

    • Author(s)
      Xin Ding*, Tsuyoshi Takatani* (*Joint First), Zhongyuan Wang, Ying Fu, and Yinqiang Zheng
    • Organizer
      the 30th ACM International Conference on Multimedia (MM ’22)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] イベントカメラを用いたコンピュータビジョンの最先端2022

    • Author(s)
      髙谷 剛志
    • Organizer
      Optics & Photonics International Exhibition(OPIE’22)
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] イベントカメラを用いたコンピュータビジョン研究2022

    • Author(s)
      髙谷剛志
    • Organizer
      情報処理学会コンピュータビジョンとイメージメディア研究会
    • Related Report
      2021 Annual Research Report
    • Invited
  • [Presentation] Event-based Bispectral Photometry using Temporally Modulated Illumination2021

    • Author(s)
      Tsuyoshi Takatani, Yuzuha Ito, Ayaka Ebisu, Yinquiang Zheng, Takahito Aoto
    • Organizer
      IEEE Conference on Computer Vision and Pattern Recognition
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Learning to Reconstruct High Speed and High Dynamic Range Videos from Events2021

    • Author(s)
      Yunhao Zou, Yinquiang Zheng, Tsuyoshi Takatani , Ying Fu
    • Organizer
      IEEE Conference on Computer Vision and Pattern Recognition
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Event-based Bispectral Photometry using Temporally Modulated Illumination2021

    • Author(s)
      Tsuyoshi Takatani, Yuzuha Ito, Ayaka Ebisu, Yinquiang Zheng, Takahito Aoto
    • Organizer
      IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Learning to Reconstruct High Speed and High Dynamic Range Videos from Events2021

    • Author(s)
      Yunhao Zou, Yinquiang Zheng, Tsuyoshi Takatani , Ying Fu
    • Organizer
      IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 二波長強度変調照明下におけるイベント情報に基づく光吸収差分の可視化2020

    • Author(s)
      伊藤柚葉,髙谷剛志,蛭子綾香,鄭銀強,青砥隆仁
    • Organizer
      画像の認識・理解シンポジウム(MIRU2020)
    • Related Report
      2020 Annual Research Report
  • [Book] コンピュータビジョン最前線 Autumn 20242024

    • Author(s)
      牛久祥孝, 上田樹, 福原吉博, 久保谷善記, 大竹ひな, 前田孝泰, 浮田宗伯, 田所龍, 髙谷剛志, 中村凌, はも (編: 井尻善久, 牛久祥孝, 片岡裕雄, 藤吉弘亘, 延原章平)
    • Total Pages
      138
    • Publisher
      共立出版
    • ISBN
      9784320125537
    • Related Report
      2024 Annual Research Report
  • [Book] 5分で分かる!? 有名論文ナナメ読み:Mark Sheinin, Dorian Chan, Matthew O'Toole, and Srinivas Narasimhan : Dual-Shutter Optical Vibration Sensing2023

    • Author(s)
      髙谷 剛志
    • Total Pages
      2
    • Publisher
      情報処理学会
    • Related Report
      2023 Annual Research Report

URL: 

Published: 2020-04-28   Modified: 2026-01-16  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi