• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Aqua Vision: Underwater light-field capture with projector-camera system and its applications

Research Project

Project/Area Number 26240023
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Research Field Perceptual information processing
Research InstitutionKyoto University

Principal Investigator

Nobuhara Shohei  京都大学, 情報学研究科, 講師 (00423020)

Co-Investigator(Kenkyū-buntansha) 川嶋 宏彰  京都大学, 情報学研究科, 准教授 (40346101)
波部 斉  近畿大学, 理工学部, 准教授 (80346072)
松山 隆司  京都大学, 情報学研究科, 教授 (10109035)
Project Period (FY) 2014-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥42,900,000 (Direct Cost: ¥33,000,000、Indirect Cost: ¥9,900,000)
Fiscal Year 2018: ¥6,240,000 (Direct Cost: ¥4,800,000、Indirect Cost: ¥1,440,000)
Fiscal Year 2017: ¥8,320,000 (Direct Cost: ¥6,400,000、Indirect Cost: ¥1,920,000)
Fiscal Year 2016: ¥6,240,000 (Direct Cost: ¥4,800,000、Indirect Cost: ¥1,440,000)
Fiscal Year 2015: ¥6,240,000 (Direct Cost: ¥4,800,000、Indirect Cost: ¥1,440,000)
Fiscal Year 2014: ¥15,860,000 (Direct Cost: ¥12,200,000、Indirect Cost: ¥3,660,000)
Keywordsカメラキャリブレーション / 3次元形状・運動計測 / 水中環境 / 反射屈折光学系 / コンピュータビジョン / 光線空間 / 3次元形状・運動復元
Outline of Final Research Achievements

This project is aimed at developing a new image-based 3D shape and motion capture technique for underwater environment using multi-view projector-camera system, and its achievements include a new underwater camera model for modeling refractive process and its application for an efficient numerical forward projection, a new catadioptric system for micro-scale object capture, and underwater object detection and tracking algorithms. In particular the project developed a new teleidoscopic imaging system which integrates a spherical lens and a kaleidoscope in front of a perspective camera to realize a multi-view capture of micro-scale objects from a single viewpoint.

Academic Significance and Societal Importance of the Research Achievements

コンピュータビジョン分野では画像を入力とした3次元形状・運動計測が広く研究されてきたが,それらの多くは屈折のない通常環境における撮像を想定しており,学術的・産業的応用が多く存在するにもかかわらず,水中環境にそのまま適用することはできなかった.本研究では特に屈折のモデル化について検討を行い,水中から撮像面への順投影計算を簡潔に記述することができる新たなカメラモデルを考案して3次元形状計測を実現するとともに,これを微小物体環境へと適用できるように新たな反射屈折光学系とその投影モデルを考案した点に学術的意義が存在する.

Report

(7 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Annual Research Report
  • 2016 Annual Research Report
  • 2015 Annual Research Report
  • 2014 Annual Research Report
  • Products Report
  • Research Products

    (26 results)

All 2019 2018 2017 2016 2015 2014 Other

All Journal Article (2 results) (of which Peer Reviewed: 2 results,  Acknowledgement Compliant: 1 results,  Open Access: 1 results) Presentation (20 results) (of which Int'l Joint Research: 5 results) Remarks (2 results) Patent(Industrial Property Rights) (1 results) Funded Workshop (1 results)

  • [Journal Article] Dynamic 3D capture of swimming fish by underwater active stereo2016

    • Author(s)
      R. Kawahara, S. Nobuhara, and T. Matsuyama
    • Journal Title

      Methods in Oceanography

      Volume: 17 Pages: 118-137

    • DOI

      10.1016/j.mio.2016.08.002

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Underwater 3D Surface Capture Using Multi-view Projectors and Cameras with Flat Housings2014

    • Author(s)
      Ryo Kawahara, Shohei Nobuhara, and Takashi Matsuyama
    • Journal Title

      IPSJ Transactions on Computer Vision and Applications

      Volume: 6 Issue: 0 Pages: 43-47

    • DOI

      10.2197/ipsjtcva.6.43

    • NAID

      130004952373

    • ISSN
      1882-6695
    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] Camera Calibration Based on Mirror Reflections2018

    • Author(s)
      Kosuke Takahashi and Shohei Nobuhara
    • Organizer
      情報処理学会コンピュータビジョンとイメージメディア研究会
    • Related Report
      2018 Annual Research Report
  • [Presentation] One-Shot Underwater Active Stereo Through Refractive Parallel Flat Surfaces2017

    • Author(s)
      M.-Y. J. Kuo and S. Nobuhara
    • Organizer
      第2回PoTS映像学シンポジウム
    • Place of Presentation
      慶応大学(横浜市港北区)
    • Year and Date
      2017-03-13
    • Related Report
      2016 Annual Research Report
  • [Presentation] 複合鏡を用いた仮想多視点カメラシステムにおける単一参照点の観測に基づく線形外部キャリブレーション法2017

    • Author(s)
      高橋康輔, 宮田明裕, 延原章平, 松山隆司
    • Organizer
      情報処理学会コンピュータビジョンとイメージメディア研究会
    • Place of Presentation
      京都大学(京都市左京区)
    • Year and Date
      2017-01-19
    • Related Report
      2016 Annual Research Report
  • [Presentation] A Multi-Camera System for Underwater Real-Time 3D Fish Detection and Tracking2017

    • Author(s)
      Rodrigo Verschae, Hiroaki Kawashima, and Shohei Nobuhara
    • Organizer
      IEEE OCEANS
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Linear Extrinsic Calibration of Kaleidoscopic Imaging System From Single 3D Point2017

    • Author(s)
      Kosuke Takahashi, Akihiro Miyata, Shohei Nobuhara, and Takashi Matsuyama
    • Organizer
      IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Teleidoscopic-Imagingシステムによる微小物体の多視点撮影2017

    • Author(s)
      川原僚, 延原章平
    • Organizer
      情報処理学会コンピュータビジョンとイメージメディア研究会(CVIM)
    • Related Report
      2017 Annual Research Report
  • [Presentation] Teleidoscopic-Imagingシステムによる微小物体の多視点撮影2017

    • Author(s)
      川原僚, 延原章平
    • Organizer
      画像の認識・理解シンポジウム(MIRU)
    • Related Report
      2017 Annual Research Report
  • [Presentation] 屈折を考慮した水中非剛体Structure from Motion2017

    • Author(s)
      村井聖, 延原章平
    • Organizer
      情報処理学会コンピュータビジョンとイメージメディア研究会(CVIM)
    • Related Report
      2017 Annual Research Report
  • [Presentation] 平行平面屈折層を備えたプロジェクタ・カメラシステムの自己較正2017

    • Author(s)
      奥野琢也, 延原章平
    • Organizer
      情報処理学会コンピュータビジョンとイメージメディア研究会(CVIM)
    • Related Report
      2017 Annual Research Report
  • [Presentation] A Single-Shot Multi-Path Interference Resolution for Mirror-Based Full 3D Shape Measurement with a Correlation-Based ToF Camera2016

    • Author(s)
      S. Nobuhara, T. Kashino, T. Matsuyama, K. Takeuchi, and K. Fujii
    • Organizer
      International Conference on 3D Vision
    • Place of Presentation
      Stanford, California, USA
    • Year and Date
      2016-10-25
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Real-Time 3D Fish Detection and Tracking System2016

    • Author(s)
      R. Verschae, S. Nobuhara, H. Kawashima, and T. Matsuyama
    • Organizer
      画像の認識・理解シンポジウム
    • Place of Presentation
      アクトシティ浜松(静岡県浜松市)
    • Year and Date
      2016-08-01
    • Related Report
      2016 Annual Research Report
  • [Presentation] 平行柱面屈折層を備えたRay-Pixelカメラのキャリブレーション2016

    • Author(s)
      植野夏樹, 延原章平, 松山隆司
    • Organizer
      情報処理学会コンピュータビジョンとイメージメディア研究会
    • Place of Presentation
      立命館大学(大阪府茨木市)
    • Year and Date
      2016-05-12
    • Related Report
      2016 Annual Research Report
  • [Presentation] 屈折面における光線空間の幾何光学的・波動光学的変化を用いた透明物体の3次元形状復元2016

    • Author(s)
      石原裕之,延原章平,松山隆司
    • Organizer
      情報処理学会コンピュータビジョンとイメージメディア研究会
    • Place of Presentation
      金沢工業大学(石川県野々市市)
    • Year and Date
      2016-03-03
    • Related Report
      2015 Annual Research Report
  • [Presentation] A Linear Generalized Camera Calibration From Three Intersecting Reference Planes2015

    • Author(s)
      Mai Nishimura, Shohei Nobuhara, Takashi Matsuyama, Shinya Shimizu, Kensaku Fujii
    • Organizer
      The IEEE International Conference on Computer Vision (ICCV)
    • Place of Presentation
      Satiago, Chile
    • Year and Date
      2015-12-13
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Interference-free Epipole-centered Structured Light Pattern for Mirror-based Multi-view Active Stereo2015

    • Author(s)
      Tomu Tahara, Ryo Kawahara, Shohei Nobuhara, and Takashi Matsuyama
    • Organizer
      International Conference on 3D Vision (3DV2015)
    • Place of Presentation
      Lyon, France
    • Year and Date
      2015-10-19
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 鏡によるパターン光の多重照射を考慮した仮想多視点アクティブステレオ2015

    • Author(s)
      田原都夢,川原僚,延原章平,松山隆司
    • Organizer
      情報処理学会コンピュータビジョンとイメージメディア研究会
    • Place of Presentation
      産業技術総合研究所(東京都江東区)
    • Year and Date
      2015-05-18
    • Related Report
      2015 Annual Research Report
  • [Presentation] 複合鏡を用いた全周囲3次元形状計測のためのプロジェクタカメラシステム2015

    • Author(s)
      田原都夢,川原僚,延原章平,松山隆司
    • Organizer
      第77回情報処理学会全国大会
    • Place of Presentation
      京都大学吉田キャンパス,京都府京都市
    • Year and Date
      2015-03-17 – 2015-03-19
    • Related Report
      2014 Annual Research Report
  • [Presentation] Vision-based 3D Tracking System for Fish Interaction Analysis2015

    • Author(s)
      鐘陽紅,川嶋宏彰,松山隆司
    • Organizer
      第77回情報処理学会全国大会
    • Place of Presentation
      京都大学吉田キャンパス,京都府京都市
    • Year and Date
      2015-03-17 – 2015-03-19
    • Related Report
      2014 Annual Research Report
  • [Presentation] 多視点画像を用いた半透明水中物体の3次元形状・透過率分布推定2015

    • Author(s)
      矢野 智彦, 延原 章平, 松山 隆司
    • Organizer
      第196回情報処理学会コンピュータビジョンとイメージメディア研究会
    • Place of Presentation
      東北大学片平キャンパス,宮城県仙台市
    • Year and Date
      2015-03-07 – 2015-03-08
    • Related Report
      2014 Annual Research Report
  • [Presentation] Underwater 3D Surface Capture using Multi-view Projectors and Cameras with Flat Housings2014

    • Author(s)
      Ryo Kawahara, Shohei Nobuhara, and Takashi Matsuyama
    • Organizer
      第17回画像の認識理解シンポジウム
    • Place of Presentation
      岡山コンベンションセンター,岡山県岡山市
    • Year and Date
      2014-07-28 – 2014-07-31
    • Related Report
      2014 Annual Research Report
  • [Remarks] A Linear Generalized Camera Calibration

    • URL

      http://vision.kuee.kyoto-u.ac.jp/~nob/proj/iccv2015/

    • Related Report
      2015 Annual Research Report
  • [Remarks] 京都大学アカデミックデイ2014「水中生物の3次元自由視点映像」

    • URL

      http://research.kyoto-u.ac.jp/academic-day/2014/40/

    • Related Report
      2014 Annual Research Report
  • [Patent(Industrial Property Rights)] 形状測定装置、形状測定方法、形状測定プログラム及び内視鏡システム2019

    • Inventor(s)
      西野 恒, 延原 章平, 川原 僚, グウオ モン, ユージェニファー, 村井 聖
    • Industrial Property Rights Holder
      京都大学
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2019-188208
    • Filing Date
      2019
    • Related Report
      Products Report
  • [Funded Workshop] International Workshop on Aqua Vision 20162016

    • Place of Presentation
      京都大学(京都市左京区)
    • Year and Date
      2016-09-26
    • Related Report
      2016 Annual Research Report

URL: 

Published: 2014-04-04   Modified: 2021-07-06  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi