• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Scale-reconstructible Structure from Motion

Research Project

Project/Area Number 18H03309
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 61050:Intelligent robotics-related
Research InstitutionThe University of Tokyo

Principal Investigator

Yamashita Atsushi  東京大学, 大学院工学系研究科(工学部), 准教授 (30334957)

Co-Investigator(Kenkyū-buntansha) 淺間 一  東京大学, 大学院工学系研究科(工学部), 教授 (50184156)
Project Period (FY) 2018-04-01 – 2021-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥17,550,000 (Direct Cost: ¥13,500,000、Indirect Cost: ¥4,050,000)
Fiscal Year 2020: ¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000)
Fiscal Year 2019: ¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2018: ¥9,620,000 (Direct Cost: ¥7,400,000、Indirect Cost: ¥2,220,000)
KeywordsStructure from Motion / スケール復元 / 3次元復元 / コンピュータビジョン / 光の屈折 / 3次元計測
Outline of Final Research Achievements

Structure from motion is a three-dimensional (3D) reconstruction method that uses one camera. However, the absolute scale of objects cannot be reconstructed by the conventional structure from motion method. In this research, we proposed a scale reconstructible structure from motion method by using refraction. In our measurement system, a refractive plate is fixed in front of a camera and images are captured through this plate.
In this study, to robustly apply this method to an actual measurement with real images, we introduced a novel bundle adjustment method based on the refraction effect. This optimization technique can reduce the 3D reconstruction errors caused by measurement noise in actual scenes. To evaluate the effectiveness of the proposed method, experiments using both simulations and real images were conducted. Simulation and experiment results show the effectiveness of the proposed method.

Academic Significance and Societal Importance of the Research Achievements

カメラの登場により,3次元空間を撮影することによって,撮影対象を2次元の画像として保存することが可能となった.本研究では,カメラの前に透明な平板を設置するのみで,3次元の撮影対象を色付きの3次元のデータとして保存することが可能である.カメラを用いた本質的な3次元計測原理を新規に開拓した点が,本研究の学術的・社会的意義である.

Report

(4 results)
  • 2020 Annual Research Report   Final Research Report ( PDF )
  • 2019 Annual Research Report
  • 2018 Annual Research Report
  • Research Products

    (6 results)

All 2021 2019 2018

All Journal Article (4 results) (of which Peer Reviewed: 4 results) Presentation (2 results) (of which Int'l Joint Research: 1 results)

  • [Journal Article] Scale-Reconstructible Structure from Motion Considering Amount of Refraction2021

    • Author(s)
      後田 啓太朗, 樋口 寛, 山下 淳, 淺間 一
    • Journal Title

      Journal of the Japan Society for Precision Engineering

      Volume: 87 Issue: 3 Pages: 301-306

    • DOI

      10.2493/jjspe.87.301

    • NAID

      130007995038

    • ISSN
      0912-0289, 1882-675X
    • Year and Date
      2021-03-05
    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Underwater Structure from Motion for Cameras Under Refractive Surfaces2019

    • Author(s)
      Xiaorui Qiao, Atsushi Yamashita and Hajime Asama
    • Journal Title

      Journal of Robotics and Mechatronics

      Volume: 31 Issue: 4 Pages: 603-611

    • DOI

      10.20965/jrm.2019.p0603

    • NAID

      130007691513

    • ISSN
      0915-3942, 1883-8049
    • Year and Date
      2019-08-20
    • Related Report
      2019 Annual Research Report 2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Structure from Motion of Underwater Scenes Considering Image Degradation and Refraction2019

    • Author(s)
      Xiaorui Qiao, Yonghoon Ji, Atsushi Yamashita and Hajime Asama
    • Journal Title

      IFAC-PapersOnLine

      Volume: Vol. 52, No. 22 Issue: 22 Pages: 78-82

    • DOI

      10.1016/j.ifacol.2019.11.051

    • Related Report
      2019 Annual Research Report 2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Refraction-Based Bundle Adjustment for Scale Reconstructible Structure from Motion2018

    • Author(s)
      Akira Shibata, Yukari Okumura, Hiromitsu Fujii, Atsushi Yamashita and Hajime Asama
    • Journal Title

      Journal of Robotics and Mechatronics

      Volume: 30 Issue: 4 Pages: 660-670

    • DOI

      10.20965/jrm.2018.p0660

    • NAID

      130007437195

    • ISSN
      0915-3942, 1883-8049
    • Year and Date
      2018-08-20
    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Presentation] 3D Reconstruction for Underwater Investigation at Fukushima Daiichi Nuclear Power Station Using Refractive Structure from Motion2019

    • Author(s)
      Xiaorui Qiao, Atsushi Yamashita and Hajime Asama
    • Organizer
      International Topical Workshop on Fukushima Decommissioning Research (FDR2019
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 屈折を利用したスケール復元が可能なStructure from Motionによる屈折量が小さい状況下におけるスケール復元の精度向上2019

    • Author(s)
      後田 啓太朗, 樋口 寛, 山下 淳, 淺間 一
    • Organizer
      ビジョン技術の実利用ワークショップ(ViEW2019)
    • Related Report
      2019 Annual Research Report

URL: 

Published: 2018-04-23   Modified: 2022-01-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi