Reconstructive Capturing Light Field from Asymmetric Camera Array

2012 Fiscal Year Final Research Report

• Project/Area Number: 22700174
• Research Category: Grant-in-Aid for Young Scientists (B)
• Allocation Type: Single-year Grants
• Research Field: Perception information processing/Intelligent robotics
• Research Institution: Nagoya Institute of Technology
• Principal Investigator: FUKUSHIMA Norishige 名古屋工業大学, 工学研究科, 助教 (80550508)
• Project Period (FY): 2010 – 2012
• Keywords: 光線空間 / 自由視点画像 / 奥行き画像 / 超解像 / コンピュテーショナルフォトグラフィ / カメラアレイ

Research Abstract

In this research, we study asymmetric camera array for computational photography, which include free viewpoint image rendering. We developed 3 topics;
1) free viewpoint image rendering with super resolution from multi camera array
2) depth map refinement method for correct depth boundary and depth level interpolation
3) alpha matting for free viewpoint image generation.

Research Products

• [Journal Article] Depth Map Refinement Using Reliability Based Joint Trilateral Filter (2013)
  • Author(s): T. Matsuo, N. Kodera, N. Fukushima, and Y. Ishibashi
  • Journal Title: ECTI Transaction CIT Volume: (in press)
  • Peer Reviewed
• [Journal Article] 重み付きクロスバイラテラルフィルタによる奥行き推定精度の向上 (2012)
  • Author(s): 松尾琢也,福嶋慶繁,石橋豊
  • Journal Title: 映像情報メディア学会誌 Volume: vol.66, no.11 Pages: J434-J443
  • URL: https://www.jstage.jst.go.jp/article/itej/66/11/66_J434/_pdf
  • Peer Reviewed
• [Journal Article] 奥行き画像符号化のための重み付きジョイントバイラテラルアップサンプリングによる超解像 (2012)
  • Author(s): 松尾琢也,福嶋慶繁,石橋豊
  • Journal Title: 電子情報通信学会論文誌 Volume: vol.J95-D, no.9 Pages: 1694-1697
  • URL: http://nma.web.nitech.ac.jp/fukushima/paper/j95-d_9_1694.pdf
  • Peer Reviewed
• [Journal Article] カメラと鏡を用いた多点光線取得システム (2011)
  • Author(s): 深見遼,福嶋慶繁,圓道知博,メヒルダド パナヒプル テヘラニ,藤井俊彰,谷本正幸
  • Journal Title: 電子情報通信学会論文誌 Volume: Vol.J94-D, No.12 Pages: 1989-1991
  • URL: http://nma.web.nitech.ac.jp/fukushima/paper/j94-d_12_1989.pdf
  • Peer Reviewed
• [Journal Article] Depth Image Based Renderingのための奥行き画像へのポストフィルタリング (2011)
  • Author(s): 福嶋慶繁,石橋豊
  • Journal Title: 電子情報通信学会論文誌 Volume: Vol.J94-D, No.12 Pages: 1992-1995
  • URL: http://nma.web.nitech.ac.jp/fukushima/paper/j94-d_12_1992.pdf
  • Peer Reviewed
• [Journal Article] 移動カメラアレイを用いた時空間の自由視点画像生成 (2011)
  • Author(s): 横井孝紀,福嶋慶繁,圓道知博,メヒルダド パナヒプル テヘラニ,藤井俊彰,谷本正幸
  • Journal Title: 電子情報通信学会論文誌 Volume: Vol.J94-D, No.12 Pages: 1996-1999
  • URL: http://nma.web.nitech.ac.ip/fukushima/paper/j94-d_12_1996.pdf
  • Peer Reviewed
• [Journal Article] 前進視点における自由視点画像生成 (2011)
  • Author(s): 安藤建吾,福嶋慶繁,圓道知博,メヒルダド パナヒプル テヘラニ,藤井俊彰,谷本正幸
  • Journal Title: 電子情報通信学会論文誌 Volume: Vol.J94-D, No.12 Pages: 2000-2003
  • URL: http://nma.web.nitech.ac.ip/fukushima/paper/j94-d_12_2000.pdf
  • Peer Reviewed
• [Journal Article] 自由視点映像伝送におけるネットワーク遅延がユーザ体感品質に及ぼす影響,"映像情報メディア学会誌 (2011)
  • Author(s): 立松綾乃,劉勃海,福嶋慶繁,石橋豊
  • Journal Title: ヒューマンインフォメーション Volume: 特集号,vol.65,no.12 Pages: 1742-1749
  • URL: http://nma.web.nitech.ac.ip/fukushima/paper/ITE2011-12.pdf
  • Peer Reviewed
• [Journal Article] Client Driven System of Depth Image Based Rendering (2011)
  • Author(s): N. Fukushima and Y. Ishibashi
  • Journal Title: ECTI Transaction CIT Volume: vol.5, no.2 Pages: 15-23
  • URL: http://www.ecti-thailand.org/assets/papers/1208_pub_41.pdf
  • Peer Reviewed
• [Journal Article] A Semi-Automatic Depth Estimation Method for FTV (2010)
  • Author(s): M. O. Wildeboer, N. Fukushima, T. Yendo, M. P. Tehrani, T. Fujii, M. Tanimoto
  • Journal Title: The Journal of The Institute of Image Information and Television Engineers Volume: vol.64, no.11 Pages: 1678-1684
  • URL: http://nma.web.nitech.ac.jp/fukushima/paper/A%20Semi-Automatic%20Depth%20Estimation%20Method%20for%20FTV.pdf
  • Peer Reviewed
• [Journal Article] 立体映像通信における画像間でのフレーム遅延が立体視へ与える影響 (2010)
  • Author(s): 澤祐一郎,福嶋慶繁,石橋豊
  • Journal Title: 電子情報通信学会論文誌 Volume: vol.J93-D, no.9 Pages: 1672-1674
  • URL: http://nma.web.nitech.ac.jp/fukushima/paper/j93-d_9_1672.pdf
  • Peer Reviewed
• [Journal Article] 超解像処理による自由視点画像の画質改善 (2010)
  • Author(s): 福嶋慶繁,石橋豊
  • Journal Title: 電子情報通信学会論文誌 Volume: vol.J93-D, no.9 Pages: 1700-1703
  • URL: http://nma.web.nitech.ac.jp/fukushima/paper/j93-d_9_1672.pdf
  • Peer Reviewed
• [Presentation] Weighted Joint Bilateral Filter with Slope Depth Compensation Filter for Depth Map Refinement (2013)
  • Author(s): T. Matsuo, N. Fukushima, Y. Ishibashi
  • Organizer: Proc. International Conference on Computer Vision Theory and Applications (VISAPP 2013)
  • Year and Date: 20130200
• [Presentation] Depth map refinement with joint bilateral filter using LR-consist weight map (2013)
  • Author(s): T. Matsuo, N. Fukushima, and Y Ishibashi
  • Organizer: Proc. 2013 International Workshop on Advanced Image Technology (IWAIT)
  • Year and Date: 20130100
• [Presentation] Splitting foreground-background images for free viewpoint image synthesis (2013)
  • Author(s): N. Kodera, N. Fukushima, and Y. Ishibashi
  • Organizer: Proc. 2013 International Workshop on Advanced Image Technology (IWAIT)
  • Year and Date: 20130100
• [Presentation] Evaluation of various image codecs with post filter set for depth map coding (2013)
  • Author(s): N. Fukushima, T. Inoue, and Y. Ishibashi
  • Organizer: Proc. 2013 International Workshop on Advanced Image Technology (IWAIT)
  • Year and Date: 20130100
• [Presentation] Influence of network delay onviewpoint change in free-viewpoint video transmission (2012)
  • Author(s): J. Osada, N. Fukushima, and Y. Ishibashi
  • Organizer: Proc. The 18th Asia-Pacific Conference on Communications (APCC)
  • Year and Date: 20121000
• [Presentation] Reliability based cross trilateral filtering for depth map refinement (2012)
  • Author(s): T. Matsuo, N. Fukushima and Y. Ishibashi
  • Organizer: Proc. The 2012 International Workshop on Advanced Image Technology (IWAIT' 12)
  • Year and Date: 20120100
• [Presentation] Real-time compression for selective depth image based rendering by using view synthesis prediction (2012)
  • Author(s): S. Lin, N. Fukushima and Y. Ishibashi
  • Organizer: Proc. The 2012 International Workshop on Advanced Image Technology (IWAIT' 12)
  • Year and Date: 20120100
• [Presentation] Novel view synthesis for dynamic scene using moving multi-camera array (2011)
  • Author(s): T. Yokoi, N. Fukushima, T. Yendo, M. P. Tehrani, T. Fujii and M. Tanimoto
  • Organizer: Proc. SPIE Vol. 7863, Stereoscopic Displays and Applications XXI, 78630C
  • Year and Date: 20110100
• [Presentation] "Free-viewpoint Image Generation from a Video Captured by a Handheld Camera (2011)
  • Author(s): K. Takeuchi, N. Fukushima, T. Yendo, M. P. Tehrani, T. Fujii and M. Tanimoto
  • Organizer: Proc. SPIE Vol.7863, Stereoscopic Displays and Applications XXI, 78631N
  • Year and Date: 20110100
• [Presentation] "Free Viewpoint Image Rendering System in a Network Environment (2011)
  • Author(s): N. Fukushima and Y. Ishibashi
  • Organizer: Proc. International Workshop on Advanced Image Technology (IWAIT 2011)
  • Year and Date: 20110100
• [Presentation] Free-viewpoint Image Generation using Structure from Motion (2011)
  • Author(s): K. Takeuchi, N. Fukushima, T. Yendo, M. P. Tehrani, T. Fujii and M. Tanimoto
  • Organizer: Proc. International Workshop on Advanced Image Technology (IWAIT 2011)
  • Year and Date: 20110100
• [Presentation] Free-viewpoint Image Generation using Moving Object Detection (2011)
  • Author(s): K. Suzuki, N. Fukushima, T. Yendo, M. P. Tehrani, T. Fujii and M. Tanimoto
  • Organizer: Proc. International Workshop on Advanced Image Technology (IWAIT 2011)
  • Year and Date: 20110100
• [Presentation] Rectification of Camera Array using Bundle Adjustment (2011)
  • Author(s): D. Kim, N. Fukushima, T. Yendo, M. P. Tehrani, T. Fujii and M. Tanimoto
  • Organizer: Proc. International Workshop on Advanced Image Technology (IWAIT 2011)
  • Year and Date: 20110100
• [Presentation] Multi-view Ray acquisition using Camera and Mirror System (2011)
  • Author(s): R. Fukami, N. Fukushima, T.Yendo, M. P. Tehrani, T. Fujii and M. Tanimoto
  • Organizer: Proc. International Workshop on Advanced Image Technology (IWAIT 2011)
  • Year and Date: 20110100
• [Presentation] Resolution Improvementof Free-viewpoint Image Generation (2011)
  • Author(s): K. Ando, N. Fukushima, T. Yendo, M. P. Tehrani, T. Fujii and M. Tanimoto
  • Organizer: Proc. International Workshop on Advanced Image Technology (IWAIT 2011)
  • Year and Date: 20110100
• [Presentation] Free viewpoint Image Generation with Super Resolution (2010)
  • Author(s): N. Fukushima and Y. Ishibashi
  • Organizer: Proc. Picture Coding Symposium (PCS'10)
  • Year and Date: 20101200
• [Presentation] Influences of Frame Delay and Packet Loss between Left and Right Frames in Stereoscopic Video Communications (2010)
  • Author(s): S. Lin, Y Sawa, N. Fukushima and Y. Ishibashi
  • Organizer: Proc. Picture Coding Symposium (PCS'10)
  • Year and Date: 20101200
• [Presentation] Free-Viewpoint Image Generation Using Different Focal Length Camera Array (2010)
  • Author(s): K. Ando, N. Fukushima, T. Yendo, M. P. Tehrani, T. Fujii and M. Tanimoto
  • Organizer: Proc. Picture Coding Symposium (PCS'10)
  • Year and Date: 20101200
• [Presentation] Parallel Processing Method for Realtime FTV (2010)
  • Author(s): K. Suzuki, N. Fukushima, T. Yendo, M. P. Tehrani, T. Fujii, M. Tanimoto
  • Organizer: Proc. Picture Coding Symposium (PCS'10)
  • Year and Date: 20101200
• [Presentation] Influences of Delay Jitter on Stereoscopic Vision in Stereo Video Communications (2010)
  • Author(s): S. Lin, IN. tukushima and Y. Ishibashi
  • Organizer: Proc. Workshop on Picture Coding and Image Processing (WPCIP2010)
  • Year and Date: 20101200
• [Presentation] Multi-view Ray Acquisition Using Hybrid Camera and Mirror System (2010)
  • Author(s): R. Fukami, N. Fukushima, T. Yendo, M. P. Tehrani, T. Fujii and M. Tanimoto
  • Organizer: Proc. Workshop on Picture Coding and Image Processing (WPCIP2010)
  • Year and Date: 20101200
• [Presentation] Calibration of Camera Array Using Bundle Adjustment (2010)
  • Author(s): D. Kim, N. Fukushima, T. Yendo, M. P. Tehrani, T. Fujii and M. Tanimoto
  • Organizer: Proc. Workshop on Picture Coding and Image Processing(WPCIP2010)
  • Year and Date: 20101200
• [Presentation] A Semi-Automatic Multi-View Depth Estimation Method (2010)
  • Author(s): M. O. Wildeboer, N. Fukushima, T. Yendo, M. P. Tehrani, T. Fujii and M. Tanimoto
  • Organizer: Proc. Visual Communications and Image Processing 2010
  • Year and Date: 20100700
• [Presentation] Real-time free viewpoint image rendering by using fast multi-pass dynamic programming (2010)
  • Author(s): N. Fukushima, T. Fujii, Y Ishibashi, T. Yendo and M. Tanimoto
  • Organizer: Proc. 3DTV-CON' 10
  • Year and Date: 20100600
• [Book] コンピュータビジョン-アルゴリズムと応用- (2013)
  • Author(s): R. Szeliski著,玉木徹,福嶋慶繁,飯山将晃,鳥居秋彦,栗田多喜夫,波部斉,林昌希,野田雅文訳
  • Total Pages: 864(405-568)
  • Publisher: 共立出版
• [Remarks] 奥行き画像に対する処理をまとめたページ(総アクセス数68519)
  • URL: http://nma.web.nitech.ac.jp/fukushima/openni/openni.html
• [Remarks] 研究成果(学会発表x論文x)に関連するページ(総アクセス数769)
  • URL: http://nma.web.nitech.ac.ip/fukushima/research/weightedjointbilateralfilter.html
• [Remarks] 研究成果(学会発表x論文x)に関連するページ(総アクセス数305)
  • URL: http://nma.web.nitech.ac.jp/fukushima/research/jointBilateralUpsample.html
• [Remarks] 多視点映像データベースに関するページ(総アクセス数5274)
  • URL: http://nma.web.nitech.ac.jp/fukushima/multiview/multiview.html