High spec multi-camera system from heterogeneous camera array

• Project/Area Number: 16K06349
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Multi-year Fund
• Section: 一般
• Research Field: Communication/Network engineering
• Research Institution: Nagoya University
• Principal Investigator: TERATANI MEHRDAD 名古屋大学, 工学研究科, 特任准教授 (70554830)
• Project Period (FY): 2016-04-01 – 2019-03-31
• Project Status: Completed (Fiscal Year 2018)
• Budget Amount: ¥4,680,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥1,080,000); Fiscal Year 2018: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000); Fiscal Year 2017: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000); Fiscal Year 2016: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
• Keywords: heterogeneous cameras / conversion / polynomial fitting / high spec multi-camera / Simulation / heterogeneous / camera array / frame rate / Resolution / Frame rate / disparity / displacement / camera cooridinate / scale invarient / heterogeneous camera / scale invariant / polynomial expansion / projection / ３次元画像処理 / 自由視点映像

Outline of Final Research Achievements

The achievements of this project are itemized in the list below. (1) Developing a new capturing system using heterogeneous cameras. By this multi-camera system, we can simulate any possible combination of heterogeneous cameras for research purposes. (2) Development of several algorithms - polynomial fitting and displacement estimation, for conversion from multi-spce multi-camera to high spec multi-camera (3) Simulation and verification of the proposed algorithm. (4) Publish and present in Journal, conference and MPEG standardization.

Academic Significance and Societal Importance of the Research Achievements

By this research, several commercial users can share the content that they captured from an event in different angles, by their smart phone and in return they can be given a high-spec multi-view data from several angle and with the high quality in term of resolution and frame-rate.

Research Products

• [Journal Article] 3D Imaging System Using Multi-Focus Plenoptic Camera and Tensor Display (2018)
  • Author(s): Mehrdad Teratani (Panahpourtehrani), Shu Fujita, Wenzhe Ouyang, Keita Takahashi, Toshiaki Fujii
  • Journal Title: Proc. International Conference on 3D Immersion (IC3D2018) Volume: Brussels, Belgium Pages: 1-7
  • DOI: 10.1109/ic3d.2018.8657863
  • Peer Reviewed
• [Journal Article] Estimation of Dense Displacement by Scale Invariant Polynomial Expansion of Heterogeneous Multi-View Images (2017)
  • Author(s): Kazuki Shibata, Mehrdad Panahpour Teherani, Keita Takahashi, Toshiaki Fujii
  • Journal Title: IEICE Transactions on Information and Systems Volume: E100.D Issue: 9 Pages: 2048-2051
  • DOI: 10.1587/transinf.2016PCL0008
  • NAID: 130006038516
  • ISSN: 0916-8532, 1745-1361
  • Peer Reviewed / Open Access / Int'l Joint Research
• [Journal Article] Free-Viewpoint Image Synthesis Using Superpixel Segmentation (2017)
  • Author(s): Mehrdad Panahpour Tehrani, Tomoyuki Tezuka, Kazuyoshi Suzuki, Keita Takahashi, Toshiaki Fujii
  • Journal Title: APSIPA Transactions on Signal and Information Processing Volume: Volume 6 Issue: 1 Pages: 1-12
  • DOI: 10.1017/atsip.2017.5
  • Peer Reviewed / Open Access / Int'l Joint Research
• [Presentation] [MPEG-I Visual] Nagoya University Three New Test Sequences Captured by Light Field Video Camera (2019)
  • Author(s): Mehrdad Teratani, Shu Fujita, Kazuyoshi Suzuki, Toshiaki Fujii
  • Organizer: ISO/IEC JTC1/SC29/WG11, M47642, Geneva, Switzerland, March 2019
• [Presentation] [MPEG-I Visual] Update on Reference Lenslet content Convertor (RLC) (2019)
  • Author(s): Mehrdad Teratani, Wenzhe Ouyang, Shu Fujita, Keita Takahashi, Toshiaki Fujii, Kazuhiro Hara, Miwa Katayama, Masahiro Kawakita
  • Organizer: ISO/IEC JTC1/SC29/WG11, M47177, Geneva, Switzerland, March 2019
• [Presentation] [MPEG-I Visual] Update on the Nagoya University Conversion Tool - Raytrix Data to Multiview Video (2019)
  • Author(s): Mehrdad Teratani, Wenzhe Ouyang, Shu Fujita, Keita, Toshiaki Fujii
  • Organizer: ISO/IEC JTC1/SC29/WG11, M46429, Marrakesh, Morocco, January 2019
• [Presentation] [MPEG-I Visual] Conversion Tool - Raytrix Data to Multiview Video (2018)
  • Author(s): Mehrdad Teratani, Shu Fujita, Wenzhe Ouyang, Keita, Toshiaki Fujii
  • Organizer: ISO/IEC JTC1/SC29/WG11, M44731, Macao, SRA China, October 2018
• [Presentation] [MPEG-I Visual] Response to EE_conversion on Dense Light Field- Light Field Video to Multiview Video Conversion Tool (2018)
  • Author(s): Mehrdad Panahpourtehrani (Teratani), Sho Mikawa, Shu Fujita, Keita, Toshiaki Fujii
  • Organizer: ISO/IEC JTC1/SC29/WG11, M42693, San Diego, USA, April 2018
• [Presentation] From Capture to Display - Applications and Trends in 3D Image Processing (2018)
  • Author(s): Mehrdad Panahpour Tehrani
  • Organizer: IEEE Gwangju Section, Seminar
  • Invited
• [Presentation] [MPEG-I Visual] Development of a 3D Imaging System Using Light Field Camera and Tensor Display (2017)
  • Author(s): Mehrdad Panahpour Tehrani, Sho Mikawa, Yuto Kobayashi, Shu Fujita, Keita, Takahashi, Toshiaki Fujii
  • Organizer: ISO/IEC JTC1/SC29/WG11, M41244
  • Int'l Joint Research
• [Presentation] [MPEG-IVisual] Introduction to A New Test Sequence Captured by Light Field Video Camera (2017)
  • Author(s): Mehrdad Panahpour Tehrani, Shu Fujita, Toshiaki Fujii
  • Organizer: ISO/IEC JTC1/SC29/WG11, M41787
  • Int'l Joint Research
• [Presentation] 解像度が異なるカメラ間での密な対応点検出 (2016)
  • Author(s): Kazuki Shibata, Mehrdad Panahpour Tehrani, Keita Takahashi, Toshiaki Fujii
  • Organizer: 電気・電子・情報関係学会東海支部連合大会
  • Place of Presentation: 愛知県豊田市/豊田工業高専
  • Year and Date: 2016-11-20
• [Presentation] 異なる解像度のカメラ間での密な対応点検出 (2016)
  • Author(s): Kazuki Shibata, Mehrdad Panahpour Tehrani, Keita Takahashi, Toshiaki Fujii
  • Organizer: 画像符号化シンポジウム・映像メディア処理シンポジウム (PCSJ2016・IMPS2016)
  • Place of Presentation: 静岡県伊豆市/ラフォーレ修善寺
  • Year and Date: 2016-09-12