• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Camera Calibration with Kaleidoscopic Imaging

Research Project

Project/Area Number 18K19815
Research Category

Grant-in-Aid for Challenging Research (Exploratory)

Allocation TypeMulti-year Fund
Review Section Medium-sized Section 61:Human informatics and related fields
Research InstitutionKyoto University

Principal Investigator

Nobuhara Shohei  京都大学, 情報学研究科, 准教授 (00423020)

Project Period (FY) 2018-06-29 – 2021-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥6,370,000 (Direct Cost: ¥4,900,000、Indirect Cost: ¥1,470,000)
Fiscal Year 2020: ¥2,600,000 (Direct Cost: ¥2,000,000、Indirect Cost: ¥600,000)
Fiscal Year 2019: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
Fiscal Year 2018: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Keywordsカメラキャリブレーション / 3次元形状復元 / 鏡映変換 / 偏光 / コンピュータビジョン / コンピュテーショナルフォトグラフィー / 鏡
Outline of Final Research Achievements

This research realized a novel camera calibration from mirror reflections. It parses the structure of kaleidoscopic images automatically, and exploits the estimated structure to realize a robust and accurate calibration. Extensive evaluations demonstrate that the proposed algorithm outperforms the state-of-the-art methods quantitatively. In addition to this calibration, this research also studied extensions to refraction, Fresnel reflection, absorption by Beer-Lambert law, and polarization. Each of them realized a novel 3D surface normal and shape recovery algorithm and a calibration method for the novel capture setup. These achievements open new avenues for applications in underwater and outdoor 3D sensing.

Academic Significance and Societal Importance of the Research Achievements

本研究によって実現された複合鏡を用いたカメラキャリブレーションは,コンピュータビジョン技術に基づいた実世界の3次元計測を行う上で不可欠であるカメラキャリブレーションを簡便かつ頑健に実現させる新たな手法として幅広く利用することができる.またこの研究を足掛かりとして取り組んだ光の吸収や偏光を利用した水中および屋外環境における3次元形状計測は,これまでコンピュータビジョン技術の適用が困難であった領域に対してよりシンプルな計測手段を提供することができる.

Report

(4 results)
  • 2020 Annual Research Report   Final Research Report ( PDF )
  • 2019 Research-status Report
  • 2018 Research-status Report

Research Products

(8 results)

All 2021 2020 2019

All Journal Article (2 results) (of which Peer Reviewed: 2 results) Presentation (5 results) (of which Int'l Joint Research: 4 results) Patent(Industrial Property Rights) (1 results)

  • [Journal Article] Structure of Multiple Mirror System from Kaleidoscopic Projections of Single 3D Point2020

    • Author(s)
      Kosuke Takahashi and Shohei Nobuhara
    • Journal Title

      IEEE Transactions on Pattern Analysis and Machine Intelligence

      Volume: -

    • DOI

      10.1109/tpami.2021.3070347

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Non-Rigid Shape from Water2020

    • Author(s)
      Meng-Yu Jennifer Kuo, Ryo Kawahara, Shohei Nobuhara, and Ko Nishino
    • Journal Title

      IEEE Transactions on Pattern Analysis and Machine Intelligence

      Volume: -

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Presentation] Polarimetric Normal Stereo2021

    • Author(s)
      Yoshiki Fukao, Ryo Kawahara, Shohei Nobuhara, and Ko Nishino
    • Organizer
      IEEE Conference on Computer Vision and Pattern Recognition
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Shape from Sky: Polarimetric Normal Recovery Under The Sky2021

    • Author(s)
      Tomoki Ichikawa, Matthew Purri, Ryo Kawahara, Shohei Nobuhara, Kristin Dana, and Ko Nishino
    • Organizer
      IEEE Conference on Computer Vision and Pattern Recognition
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Non-Rigid Shape from Water2021

    • Author(s)
      Meng-Yu Jennifer Kuo, Ryo Kawahara, Shohei Nobuhara, and Ko Nishino
    • Organizer
      International Conference on Computational Photography
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Appearance and Shape from Water Reflection2020

    • Author(s)
      Ryo Kawahara, Meng-Yu Kuo, Shohei Nobuhara, and Ko Nishino
    • Organizer
      IEEE Winter Conference on Applications of Computer Vision
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Novel Catadioptric Ray-Pixel Camera Model and its Application to 3D Reconstruction2019

    • Author(s)
      Ryo Kawahara and Shohei Nobuhara
    • Organizer
      情報処理学会コンピュータビジョンとイメージメディア研究会
    • Related Report
      2019 Research-status Report
  • [Patent(Industrial Property Rights)] 形状測定装置、形状測定方法、形状測定プログラム及び内視鏡システム2019

    • Inventor(s)
      西野恒,延原章平,川原僚,グウオモンユージェニファー,村井聖
    • Industrial Property Rights Holder
      西野恒,延原章平,川原僚,グウオモンユージェニファー,村井聖
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2019-188208
    • Filing Date
      2019
    • Related Report
      2019 Research-status Report

URL: 

Published: 2018-07-25   Modified: 2022-01-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi