3D reconstruction from single view image using sequential plane estimation and its application to intelligent camera realization

• Project/Area Number: 16K00224
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Multi-year Fund
• Section: 一般
• Research Field: Perceptual information processing
• Research Institution: Iwate University
• Principal Investigator: Kimura Akio 岩手大学, 理工学部, 准教授 (00281949)
• Project Period (FY): 2016-04-01 – 2019-03-31
• Project Status: Completed (Fiscal Year 2018)
• Budget Amount: ¥4,420,000 (Direct Cost: ¥3,400,000、Indirect Cost: ¥1,020,000); Fiscal Year 2018: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000); Fiscal Year 2017: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000); Fiscal Year 2016: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
• Keywords: コンピュータビジョン / 平面推定 / 射影幾何学 / 3次元復元 / 知的カメラ

Outline of Final Research Achievements

This research developed a sequential estimation method of neighbor plane to the reference plane such as the ground or floor in the single image without changing view point and re-calculating projection matrix. Also the research newly found out two geometrical clues needed to estimate a plane intersected to the reference plane obliquely. With this, various kind of 3D information such as a distance between two points that belong to each different plane or an intersection angle formed by two space lines can be estimated from only a single view image.

Academic Significance and Societal Importance of the Research Achievements

本研究で開発した隣接平面の順次推定法には，適用に関する若干の制約条件があるものの，これをクリアできた場合には非常に多くの3次元量を僅か1枚の単視点画像から復元・推定することができる．理論的には，撮り直しが不可能な画像（監視カメラ映像の1コマとか）や過去の資料にも適用可能であり，その波及効果は大きいものと考える．また，通常の3次元復元のように大量の異視点画像を準備する必要もないため，利用者はより手軽な形で技術を試すことができる．

Research Products

• [Journal Article] A performance improvement of Mask R-CNN using region proposal expansion (2019)
  • Author(s): Naoki Degawa, Xin Lu, and Akio Kimura
  • Journal Title: Proc. SPIE 11049, International Workshop on Advanced Image Technology (IWAIT) 2019 Volume: 1104929 Pages: 63-63
  • DOI: 10.1117/12.2521383
  • Peer Reviewed / Open Access
• [Journal Article] 3D measurements from a single uncalibrated image based on estimating space planes using geometrical clues in real scenes (2016)
  • Author(s): Akio KIMURA, Usuke UCHISAWA, and Ryo NARITA
  • Journal Title: The Journal of the Society for Art and Science Volume: Vol.15, No.1 Pages: 20-31
  • Peer Reviewed / Open Access
• [Presentation] A performance improvement of Mask R-CNN using region proposal expansion (2019)
  • Author(s): Naoki DEGAWA, Xin LU and Akio KIMURA
  • Organizer: 平成30年度芸術科学会東北支部大会，報告セッション
• [Presentation] 画像認識のための局所特徴量POGの提案 (2018)
  • Author(s): 汪晋，盧忻，木村彰男
  • Organizer: 平成30年度第3回情報処理学会東北支部研究会
• [Presentation] センサー情報を利用した携帯情報端末の姿勢推定とカメラキャリブレーションへの応用に関する一考察 (2018)
  • Author(s): 長嶺一志，木村彰男
  • Organizer: 平成30年度第3回情報処理学会東北支部研究会
• [Presentation] A SVM-based diagnosis of melanoma using only useful image features (2018)
  • Author(s): Suleiman MUSTAFA and Akio KIMURA
  • Organizer: International Workshop on Advanced Image Technology 2018
  • Int'l Joint Research
• [Presentation] A performance evaluation of keypoints detection methods SIFT and AKAZE for 3D reconstruction (2018)
  • Author(s): Kouta YAMADA and Akio KIMURA
  • Organizer: International Workshop on Advanced Image Technology 2018
  • Int'l Joint Research
• [Presentation] An improved method for extracting tangent information from a binary edge image (2017)
  • Author(s): Toshihiro IWABUCHI and Akio KIMURA
  • Organizer: International Workshop on Advanced Image Technology 2017
  • Place of Presentation: Penang-city, Malaysia
  • Year and Date: 2017-01-08
  • Int'l Joint Research
• [Presentation] A performance evaluation of variation-HOG descriptor for human face detection (2017)
  • Author(s): Daiki SHIROSAWA, Lu XIN, and Akio KIMURA
  • Organizer: International Workshop on Advanced Image Technology 2017
  • Place of Presentation: Penang-city, Malaysia
  • Year and Date: 2017-01-08
  • Int'l Joint Research
• [Presentation] 3D reconstruction using single-/multi-view image(s) (2017)
  • Author(s): Akio KIMURA
  • Organizer: 西北農林大学，モンゴル国立大学，岩手大学の3大学間学術研究シンポジウム
  • Invited
• [Remarks] 単視点画像から3次元的な幾何情報を推定する手法の開発
  • URL: http://www.mips.cis.iwate-u.ac.jp/