• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Real-Time Free-Viewpoint Video Synthesis Using a Movable Camera Array

Research Project

Project/Area Number 24700162
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeMulti-year Fund
Research Field Perception information processing/Intelligent robotics
Research InstitutionNagoya University (2013-2014)
The University of Electro-Communications (2012)

Principal Investigator

TAKAHASHI Keita  名古屋大学, 工学(系)研究科(研究院), 准教授 (30447437)

Project Period (FY) 2012-04-01 – 2015-03-31
Project Status Completed (Fiscal Year 2014)
Budget Amount *help
¥4,420,000 (Direct Cost: ¥3,400,000、Indirect Cost: ¥1,020,000)
Fiscal Year 2014: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2013: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2012: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Keywords画像情報処理 / 自由視点映像
Outline of Final Research Achievements

The goal of this research is to achieve a "free-viewpoint camera" that can be used to observe dynamic objects such as humans in real time. To extend the range for the viewpoint movement, we have developed a framework that integrates two approaches; a hardware-based approach where a camera device is physically translated or rotated using an electric platform, and a software-based approach, where multi-view images captured through a multi-view camera are interpolated to generate free-viewpoint images in real time. In this framework, we have estimated the position and orientation of the camera device from the captured images and used it to compensate the coordinate system. Futhermore, we have smoothly controlled the electric platform to move it to the optimal position and orientation. We have evaluated our method through experiments and confirmed that we can observe photo-realistic images without interruption during the movement of the platform.

Report

(4 results)
  • 2014 Annual Research Report   Final Research Report ( PDF )
  • 2013 Research-status Report
  • 2012 Research-status Report
  • Research Products

    (18 results)

All 2015 2014 2013 2012 Other

All Journal Article (4 results) (of which Peer Reviewed: 4 results,  Open Access: 1 results) Presentation (9 results) Remarks (5 results)

  • [Journal Article] Real-Time Free-Viewpoint Image Synthesis System Using Time Varying Projection2014

    • Author(s)
      Tatsuro Mori, Keita Takahashi, Toshiaki Fujii
    • Journal Title

      ITE Transactions on Media Technology and Applications

      Volume: 2 Pages: 370-377

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] 自由視点映像生成のための自然特徴点を用いた多眼カメラの自己位置推定法2013

    • Author(s)
      高橋 桂太, 金子 正秀
    • Journal Title

      電子情報通信学会和文論文誌

      Volume: J96-D Pages: 2010-2012

    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Journal Article] ダウンサンプリングされた光線空間データのレート歪み特性についての一考察2013

    • Author(s)
      高橋 桂太
    • Journal Title

      電子情報通信学会和文論文誌

      Volume: J96-D Pages: 1978-1980

    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Journal Article] 自由視点映像生成のための自然特徴点を用いた多眼カメラの自己位置推定法2013

    • Author(s)
      高橋 桂太, 金子 正秀
    • Journal Title

      電子情報通信学会和文論文誌D

      Volume: J96-D, No. 9

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Presentation] Free-viewpoint Video Synthesis from a Movable 2D Camera Array2015

    • Author(s)
      Shunsuke Yamada, Keita Takahashi, Kenji Sawada, Mehrdad Panahpour Tehrani, Toshiaki Fujii
    • Organizer
      The 1st International Conference on Advanced Imaging
    • Place of Presentation
      National Center of Science (Tokyo, Japan)
    • Year and Date
      2015-06-17 – 2015-06-19
    • Related Report
      2014 Annual Research Report
  • [Presentation] 可動型多眼カメラによる自由視点映像生成2015

    • Author(s)
      山田 隼輔, 高橋 桂太, 澤田 賢治, パナヒプル テヘラニ メヒルダド, 藤井 俊彰
    • Organizer
      画像センシングシンポジウム
    • Place of Presentation
      パシフィコ横浜(神奈川県横浜市)
    • Year and Date
      2015-06-10 – 2015-06-12
    • Related Report
      2014 Annual Research Report
  • [Presentation] Least MSE Regression for View Synthesis2014

    • Author(s)
      Keita Takahashi, Toshiaki Fujii
    • Organizer
      International Conference on 3D Vision
    • Place of Presentation
      The University of Tokyo (Tokyo, Japan)
    • Year and Date
      2014-12-08 – 2014-12-11
    • Related Report
      2014 Annual Research Report
  • [Presentation] 可動型多眼カメラによる自由視点映像生成における回転機構導入のための基礎検討2014

    • Author(s)
      山田 隼輔, 高橋 桂太, パナヒプル テヘラニ メヒルダド, 藤井 俊彰
    • Organizer
      映像メディア処理シンポジウム
    • Place of Presentation
      ラフォーレ修善寺(静岡県伊豆市)
    • Year and Date
      2014-11-12 – 2014-11-14
    • Related Report
      2014 Annual Research Report
  • [Presentation] 自由視点映像生成のための多眼カメラの位置制御手法の基礎検討2014

    • Author(s)
      ④山田 隼輔, 高橋 桂太, パナヒプル テヘラニ メヒルダド, 藤井 俊彰
    • Organizer
      電気・電子・情報関係学会東海支部連合大会
    • Place of Presentation
      中京大学名古屋キャンパス(愛知県名古屋市)
    • Year and Date
      2014-09-08 – 2014-09-09
    • Related Report
      2014 Annual Research Report
  • [Presentation] 可動型多眼カメラによる自由視点映像生成のための光線空間の解析2014

    • Author(s)
      山田 隼輔,高橋 桂太,パナヒプル テヘラニ メヒルダド,藤井 俊彰
    • Organizer
      画像の認識・理解シンポジウム
    • Place of Presentation
      岡山コンベンションセンター(岡山県岡山市)
    • Year and Date
      2014-07-28 – 2014-07-31
    • Related Report
      2014 Annual Research Report
  • [Presentation] Development of free-viewpoint image synthesis system using time varying projection and spacetime stereo2014

    • Author(s)
      Tatsuro Mori, Keita Takahashi, Toshiaki Fujii
    • Organizer
      IS&T/ Electronic Imaging 2014
    • Place of Presentation
      San Francisco, California, USA
    • Related Report
      2013 Research-status Report
  • [Presentation] アクティブ投影を用いた自由視点映像生成システムの基礎検討2013

    • Author(s)
      森 達郎, 高橋 桂太, 藤井 俊彰
    • Organizer
      映像メディア処理シンポジウム
    • Place of Presentation
      静岡県熱海市
    • Related Report
      2013 Research-status Report
  • [Presentation] 自由視点映像生成のための自然特徴点を用いた多眼カメラの自己位置推定法2012

    • Author(s)
      高橋 桂太, 金子 正秀
    • Organizer
      映像メディア処理シンポジウム (IMPS2012)
    • Place of Presentation
      静岡県熱海市
    • Related Report
      2012 Research-status Report
  • [Remarks] Pseudo Stabilization Using a Multi-View Camera

    • URL

      http://youtu.be/FE2QIzoAaTY

    • Related Report
      2014 Annual Research Report
  • [Remarks] Camera Array Project

    • URL

      http://www.fujii.nuee.nagoya-u.ac.jp/~takahasi/Research/CamArray/

    • Related Report
      2014 Annual Research Report
  • [Remarks] Pseudo Stabilization Using a Multi-View Camera

    • URL

      http://youtu.be/FE2QIzoAaTY

    • Related Report
      2013 Research-status Report
  • [Remarks] Camera Array Project

    • URL

      http://www.fujii.nuee.nagoya-u.ac.jp/~takahasi/Research/CamArray/

    • Related Report
      2013 Research-status Report
  • [Remarks] Pseudo Stabilization Using a Multi-View Camera

    • URL

      http://youtu.be/FE2QIzoAaTY

    • Related Report
      2012 Research-status Report

URL: 

Published: 2013-05-31   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi