• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Vision-Based Online 3D Modeling with Visual Feedbacks

Research Project

Project/Area Number 25240025
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Research Field Perceptual information processing
Research InstitutionTokyo Institute of Technology

Principal Investigator

Okutomi Masatoshi  東京工業大学, 理工学研究科, 教授 (00262303)

Co-Investigator(Renkei-kenkyūsha) Shimizu Masao  日本大学, 理工学部・精密機械工学科, 教授 (70361798)
Torii Akihiko  東京工業大学, 大学院理工学研究科・機械制御システム専攻, 助教 (20585179)
Sugimoto Shigeki  東京工業大学, 大学院理工学研究科・機械制御システム専攻, 研究員 (40436712)
Project Period (FY) 2013-04-01 – 2016-03-31
Project Status Completed (Fiscal Year 2015)
Budget Amount *help
¥46,410,000 (Direct Cost: ¥35,700,000、Indirect Cost: ¥10,710,000)
Fiscal Year 2015: ¥15,730,000 (Direct Cost: ¥12,100,000、Indirect Cost: ¥3,630,000)
Fiscal Year 2014: ¥17,810,000 (Direct Cost: ¥13,700,000、Indirect Cost: ¥4,110,000)
Fiscal Year 2013: ¥12,870,000 (Direct Cost: ¥9,900,000、Indirect Cost: ¥2,970,000)
Keywords空間モデリング / Structure from Motion / 準実時間処理 / 空撮3次元計測 / オンライン処理 / 四面体カービング法 / ステレオビジョン / 情報フィードバック / 小型飛行体
Outline of Final Research Achievements

We have developed an incremental tetrahedra carving algorithm, where the tetrahedra-carving-based surface extraction algorithm was extended to the incremental fashion by efficiently detecting ray-tetrahedra intersections and the dynamic graph cut. Then we have built an online 3D modeling system using aerial images, where the user can immediately confirm the 3D model updated by the aerial images captured by the camera mounted on a drone operated by remote control. In addition, we have developed a method for refining the 3D model estimated by the online 3D modeling system, where we estimate not only 3D surface parameters but also illumination parameters and surface albedo. These achievements have been awarded the SSII Audience prize and Academic prize at SSII2013, and the SSII Audience prize at SSII2016.

Report

(4 results)
  • 2015 Annual Research Report   Final Research Report ( PDF )
  • 2014 Annual Research Report
  • 2013 Annual Research Report
  • Research Products

    (42 results)

All 2016 2015 2014 2013 Other

All Journal Article (9 results) (of which Peer Reviewed: 8 results,  Acknowledgement Compliant: 3 results,  Open Access: 2 results) Presentation (28 results) (of which Int'l Joint Research: 5 results,  Invited: 3 results) Book (1 results) Remarks (4 results)

  • [Journal Article] 車載ステレオカメラによる地表サーフェスマップ生成: 実環境を考慮したロバストな広範囲3Dサーフェス生成2016

    • Author(s)
      杉本茂樹, 本岡昂馬, 奥富正敏, 志磨健
    • Journal Title

      画像ラボ

      Volume: Vol. 27, No.2 Pages: 25-32

    • Related Report
      2015 Annual Research Report
  • [Journal Article] 全体最適性を保証した逐次的3次元サーフェス抽出法2015

    • Author(s)
      杉浦貴行, 鳥居秋彦, 奥富正
    • Journal Title

      電子情報通信学会論文誌D

      Volume: Vol. J98-D, No.4 Pages: 616-626

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] 車載ステレオカメラを用いたロバストな3D地表サーフェスマップ生成2015

    • Author(s)
      杉本茂樹, 本岡昂馬, 奥富正敏, 志磨健
    • Journal Title

      電子情報通信学会論文誌D

      Volume: Vol. J98-D, No.4 Pages: 627-638

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Robust Feature Matching for Distorted Projection by Spherical Cameras2015

    • Author(s)
      Hajime Taira, Yuki Inoue, Akihiko Torii and Masatoshi Okutomi
    • Journal Title

      IPSJ Transactions on Computer Vision and Applications

      Volume: 7 Issue: 0 Pages: 84-88

    • DOI

      10.2197/ipsjtcva.7.84

    • NAID

      130005091221

    • ISSN
      1882-6695
    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] 3D Reconstruction by SfM Using Spherical Panoramas and Its Application to Image Based Position-direction Estimation2015

    • Author(s)
      井上優希, 董亜飛, 田平創, 鳥居秋彦, 奥富正敏
    • Journal Title

      Journal of the Japan Society for Precision Engineering

      Volume: 81 Issue: 12 Pages: 1173-1179

    • DOI

      10.2493/jjspe.81.1173

    • NAID

      130005111869

    • ISSN
      0912-0289, 1882-675X
    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] ASP<i>n</i>P: An Accurate and Scalable Solution to the Perspective-<i>n</i>-Point Problem2013

    • Author(s)
      Yinqiang Zheng, Shigeki Sugimoto, Masatoshi Okutomi
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E96.D Issue: 7 Pages: 1525-1535

    • DOI

      10.1587/transinf.E96.D.1525

    • NAID

      130003370929

    • ISSN
      0916-8532, 1745-1361
    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Direct Ground Surface Reconstruction from Stereo Images2013

    • Author(s)
      Shigeki Sugimoto, Takaaki Kato, Kouma Motooka, Masatoshi Okutomi
    • Journal Title

      IPSJ Transactions on Computer Vision and Applications

      Volume: 5 Issue: 0 Pages: 60-64

    • DOI

      10.2197/ipsjtcva.5.60

    • NAID

      130003369479

    • ISSN
      1882-6695
    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] オンライン撮影に適した実用的なSfMシステム2013

    • Author(s)
      半澤悠樹, 鳥居秋彦, 奥富正敏
    • Journal Title

      電子情報通信学会論文誌D

      Volume: Vol.J96-D, No.8 Pages: 1753-1763

    • NAID

      110009634947

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] ステレオ画像を用いた複数平面領域と平面パラメータの同時推定2013

    • Author(s)
      藤原将展, 杉本茂樹, 奥富正敏
    • Journal Title

      電子情報通信学会論文誌D

      Volume: Vol.J96-D, No.8 Pages: 1874-1877

    • NAID

      110009634958

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Presentation] ドローンを用いた準実時間3D画像センシングシステム2016

    • Author(s)
      石黒耀, 井上優希, 杉本茂樹, 鳥居秋彦, 奥富正敏
    • Organizer
      画像センシングシンポジウム(SSII2016)
    • Place of Presentation
      パシフィコ横浜(神奈川県横浜市)
    • Year and Date
      2016-06-10
    • Related Report
      2015 Annual Research Report
  • [Presentation] Joint estimation of depth, reflectance and illumination for depth refinement2015

    • Author(s)
      Kichang Kim, Akihiko Torii, Masatoshi Okutomi
    • Organizer
      IEEE ICCV2015 Workshop: Inverse Rendering Workshop (IR 2015)
    • Place of Presentation
      CentroParque Convention Center (サンチアゴ, チリ)
    • Year and Date
      2015-12-12
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 3D Surface Reconstruction From Point-and-line Cloud2015

    • Author(s)
      Takayuki Sugiura, Akihiko Torii, Masatoshi Okutomi
    • Organizer
      International Conference on 3D Vision (3DV2015)
    • Place of Presentation
      Ecole normale superieure de Lyon(リオン,フランス)
    • Year and Date
      2015-10-19
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 360 Degree 3D Ground Surface Reconstruction Using a Single Rotating Camera2015

    • Author(s)
      Kouma Motooka, Shigeki Sugimoto, Masatoshi Okutomi, Takeshi Shima
    • Organizer
      Workshop on Planning, Perception and Navigation for Intelligent Vehicles (PPNIV2015)
    • Place of Presentation
      Conference Center Hamburg (ハンブルグ,ドイツ)
    • Year and Date
      2015-09-28
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Robust Feature Matching for Distorted Projection by Spherical Cameras2015

    • Author(s)
      Hajime Taira, Yuki Inoue, Akihiko Torii, Masatoshi Okutomi
    • Organizer
      第18回画像の認識・理解シンポジウム(MIRU2015)
    • Place of Presentation
      ホテル阪急エキスポパーク(大阪府吹田市)
    • Year and Date
      2015-07-27
    • Related Report
      2015 Annual Research Report
  • [Presentation] 全球パノラマ画像を用いたSfMによる3次元復元システム2015

    • Author(s)
      井上優希, 田平創, 杉浦貴行, 鳥居秋彦, 奥富正敏
    • Organizer
      第21回画像センシングシンポジウム(SSII2015)
    • Place of Presentation
      パシフィコ横浜(神奈川県横浜市)
    • Year and Date
      2015-06-11
    • Related Report
      2015 Annual Research Report
  • [Presentation] 回転するカメラを用いた高精度地表3Dサーフェス推定2015

    • Author(s)
      本岡昂馬, 杉本茂樹, Doan Phuc Phan, 奥富正敏, 志磨健
    • Organizer
      第21回画像センシングシンポジウム(SSII2015)
    • Place of Presentation
      パシフィコ横浜(神奈川県横浜市)
    • Year and Date
      2015-06-11
    • Related Report
      2015 Annual Research Report
  • [Presentation] View Extension for Teleoperated MAV2015

    • Author(s)
      Ren Foo Lim, Akihiko Torii, Masatoshi Okutomi
    • Organizer
      IAPR International Conference on Machine Vision Applications (MVA2015)
    • Place of Presentation
      日本科学未来会(東京都江東区)
    • Year and Date
      2015-05-21
    • Related Report
      2015 Annual Research Report
  • [Presentation] SfMによる三次元復元結果と地図データの位置合わせに関する研究2015

    • Author(s)
      新井大地, 鳥居秋彦, 奥富正敏
    • Organizer
      情報処理学会研究報告(コンピュータビジョンとイメージメディア(CVIM) )
    • Place of Presentation
      日本科学未来会(東京都江東区)
    • Year and Date
      2015-05-18
    • Related Report
      2015 Annual Research Report
  • [Presentation] インスタント3D復元による画像データベース構築と分割画像記述子を用いた自己位置・方位推定2014

    • Author(s)
      董亜飛, 井上優希, 鳥居秋彦, 奥富正敏
    • Organizer
      ビジョン技術の実利用ワークショップ(ViEW2014)
    • Place of Presentation
      パシフィコ横浜(神奈川県横浜市)
    • Year and Date
      2014-12-04
    • Related Report
      2014 Annual Research Report
  • [Presentation] 多視点画像からの3次元再構成2014

    • Author(s)
      奥富正敏
    • Organizer
      VCADシステム研究会 第38回定例研究会
    • Place of Presentation
      理化学研究所(埼玉県和光市)
    • Year and Date
      2014-10-17
    • Related Report
      2014 Annual Research Report
    • Invited
  • [Presentation] Robust Ground Surface Map Generation Using Vehicle-Mounted Stereo Camera2014

    • Author(s)
      Kouma Motooka, Shigeki Sugimoto, Masatoshi Okutomi, Takeshi Shima
    • Organizer
      IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2014)
    • Place of Presentation
      Palmer House a Hilton Hotel(イリノイ州, 米国)
    • Year and Date
      2014-09-16
    • Related Report
      2014 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A General and Simple Method for Camera Pose and Focal Length Determination2014

    • Author(s)
      Yinqiang Zheng, Shigeki Sugimoto, Imari Sato, Masatoshi Okutomi
    • Organizer
      IEEE Conference on Computer Vision and Pattern Recognition (CVPR2014)
    • Place of Presentation
      Greater Columbus Convention Center (オハイオ州,米国)
    • Year and Date
      2014-06-25
    • Related Report
      2014 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 車載ステレオカメラを用いたロバストな地表面サーフェスマップ生成2014

    • Author(s)
      本岡昂馬, 杉本茂樹, 奥富正敏, 志磨健
    • Organizer
      第20回画像センシングシンポジウム(SSII2014)
    • Place of Presentation
      パシフィコ横浜(神奈川県横浜市)
    • Year and Date
      2014-06-13
    • Related Report
      2014 Annual Research Report
  • [Presentation] インスタント3D復元による位置情報付き画像データベース構築とその利用2014

    • Author(s)
      鳥居秋彦, 井上優希, 董亜飛, 杉浦貴行, 奥富正敏
    • Organizer
      第20回画像センシングシンポジウム(SSII2014)
    • Place of Presentation
      パシフィコ横浜(神奈川県横浜市)
    • Year and Date
      2014-06-12
    • Related Report
      2014 Annual Research Report
  • [Presentation] 様々な広視野カメラを利用可能なオンラインSfMシステムの構築2014

    • Author(s)
      井上優希, 鳥居秋彦, 奥富正敏
    • Organizer
      情報処理学会研究報告(コンピュータビジョンとイメージメディア(CVIM) )
    • Place of Presentation
      近畿大学(大阪府東大阪市)
    • Year and Date
      2014-05-15
    • Related Report
      2014 Annual Research Report
  • [Presentation] インクリメンタル四面体カービング法による三次元サーフェス生成2013

    • Author(s)
      杉浦貴行, 鳥居秋彦, 奥富正敏
    • Organizer
      情報処理学会研究報告(コンピュータビジョンとイメージメディア(CVIM))
    • Place of Presentation
      東京農工大学(東京都)
    • Related Report
      2013 Annual Research Report
  • [Presentation] 時系列ステレオ画像を用いた直接法による広範囲な地表面サーフェスマップ生成2013

    • Author(s)
      本岡昂馬, 杉本茂樹, 奥富正敏
    • Organizer
      情報処理学会研究報告(コンピュータビジョンとイメージメディア(CVIM))
    • Place of Presentation
      東京農工大学(東京都)
    • Related Report
      2013 Annual Research Report
  • [Presentation] Instant Surface Reconstruction for Incremental SfM

    • Author(s)
      Kichang Kim, Takayuki Sugiura, Akihiko Torii, Shigeki Sugimoto, Masatoshi Okutomi
    • Organizer
      IAPR Conference on Machine Vision Applications (MVA2013)
    • Place of Presentation
      立命館大学(京都府)
    • Related Report
      2013 Annual Research Report
  • [Presentation] Large Scale Structure from Motion and Localization

    • Author(s)
      Akihiko Torii
    • Organizer
      IAPR Conference on Machine Vision Applications (MVA2013)
    • Place of Presentation
      立命館大学(京都府)
    • Related Report
      2013 Annual Research Report
    • Invited
  • [Presentation] A Practical Rank-Constrained Eight-Point Algorithm for Fundamental Matrix Estimation

    • Author(s)
      Yinqiang Zheng, Shigeki Sugimoto, Masatoshi Okutomi
    • Organizer
      IEEE Conference on Computer Vision and Pattern Recognition (CVPR2013)
    • Place of Presentation
      ポートランド(米国)
    • Related Report
      2013 Annual Research Report
  • [Presentation] 多視点画像からの3次元復元 ~基本原理から大規模復元まで~

    • Author(s)
      奥富正敏, 鳥居秋彦
    • Organizer
      第19回画像センシングシンポジウム(SSII2013)
    • Place of Presentation
      パシフィコ横浜(神奈川県)
    • Related Report
      2013 Annual Research Report
    • Invited
  • [Presentation] 逐次的SfMとサーフェス生成によるインスタント3D復元

    • Author(s)
      鳥居秋彦, 杉浦貴行, 阿達大地, 奥富正敏
    • Organizer
      第19回画像センシングシンポジウム(SSII2013)
    • Place of Presentation
      パシフィコ横浜(神奈川県)
    • Related Report
      2013 Annual Research Report
  • [Presentation] Direct Ground Surface Reconstruction from Stereo Images

    • Author(s)
      Shigeki Sugimoto, Takaaki Kato, Kouma Motooka, Masatoshi Okutomi
    • Organizer
      第16回画像の認識・理解シンポジウム(MIRU2013)
    • Place of Presentation
      国立情報学研究所(東京都)
    • Related Report
      2013 Annual Research Report
  • [Presentation] 逐次的四面体カービング法を用いた3Dモデリング

    • Author(s)
      鳥居秋彦, 杉浦貴行, 奥富正敏
    • Organizer
      情報処理学会研究報告(コンピュータビジョンとイメージメディア(CVIM))
    • Place of Presentation
      九州大学(福岡県)
    • Related Report
      2013 Annual Research Report
  • [Presentation] Revisiting the PnP Problem: A Fast, General and Optimal Solution

    • Author(s)
      Yinqiang Zheng, Yubin Kuang, Shigeki Sugimoto, Kalle Astrom, Masatoshi Okutomi
    • Organizer
      IEEE International Conference on Computer Vision (ICCV2013)
    • Place of Presentation
      シドニー(オーストラリア)
    • Related Report
      2013 Annual Research Report
  • [Presentation] Direct Generation of Regular-Grid Ground Surface Map From In-Vehicle Stereo Image Sequences

    • Author(s)
      Shigeki Sugimoto, Kouma Motooka, Masatoshi Okutomi
    • Organizer
      4th Workshop on Computer Vision in Vehicle Technology: From Earth to Mars (CCVT2013:E2M)
    • Place of Presentation
      シドニー(オーストラリア)
    • Related Report
      2013 Annual Research Report
  • [Presentation] 3D Surface Extraction using Incremental Tetrahedra Carving

    • Author(s)
      Takayuki Sugiura, Akihiko Torii, Masatoshi Okutomi
    • Organizer
      ICCV 2013 Workshop: Big Data in 3D Computer Vision (BigData3DCV)
    • Place of Presentation
      シドニー(オーストラリア)
    • Related Report
      2013 Annual Research Report
  • [Book] 三次元画像センシングの新展開2015

    • Author(s)
      鳥居秋彦, 奥富正敏 他51名, 岩堀祐之 監修
    • Publisher
      NTS
    • Related Report
      2015 Annual Research Report
  • [Remarks] 東京工業大学 工学院 システム制御系 奥富・田中研究室ホームページ

    • URL

      http://www.ok.ctrl.titech.ac.jp/index-j.shtml

    • Related Report
      2015 Annual Research Report
  • [Remarks] 東京工業大学 工学院システム制御系 奥富・田中研究室ホームページ

    • URL

      http://www.ok.ctrl.titech.ac.jp/index-j.shtml

    • Related Report
      2014 Annual Research Report
  • [Remarks] 東京工業大学大学院理工学研究科奥富・田中研究室ホームページ研究紹介

    • URL

      http://www.ok.ctrl.titech.ac.jp/res/res-j.shtml

    • Related Report
      2013 Annual Research Report
  • [Remarks] 研究室ホームページ2013年論文発表実績

    • URL

      http://www.ok.ctrl.titech.ac.jp/pub/pub2013-j.html

    • Related Report
      2013 Annual Research Report

URL: 

Published: 2013-05-15   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi