• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Interactive Multiview Video Communication System

Research Project

Project/Area Number 23700136
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeMulti-year Fund
Research Field Media informatics/Database
Research InstitutionNational Institute of Informatics

Principal Investigator

CHEUNG GENE  国立情報学研究所, コンテンツ科学研究系, 准教授 (40577467)

Project Period (FY) 2011-04-28 – 2015-03-31
Project Status Completed (Fiscal Year 2014)
Budget Amount *help
¥4,680,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥1,080,000)
Fiscal Year 2013: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2012: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2011: ¥3,250,000 (Direct Cost: ¥2,500,000、Indirect Cost: ¥750,000)
Keywords画像処理 / グラフ信号処理 / 国際情報交換 / 画像復元 / 視線の矯正 / 顔の美化 / signal representation / signal denoising / signal interpolation / 国際情報交流 / multiview video coding / video streaming / 3D visual interaction
Outline of Final Research Achievements

Today's imaging technologies can now capture texture maps (e.g., color images) and depth maps (per-pixel distance between objects in the 3D scene and camera) from multiple viewpoints simultaneously. Given this rich set of input images, the objective is to develop key technologies that enable a range of interactive 3D imaging applications. In particular, we focus on three aspects of an end-to-end visual communication system: i) coding of 3D images, ii) transmission of 3D data over data networks, and iii) restoration of virtual views given transmitted 3D data. For coding of 3D data, we have developed is a multi-resolution edge-adaptive image codec based on graph Fourier transform (GFT). For transmission of 3D data, we have developed a strategy to exploit the data redundancy inherent in the representation of multiview texture-plus-depth format for loss recovery. For restoration of 3D images, we have studied the use of graph Laplacian regularizer as signal prior for regularization.

Report

(5 results)
  • 2014 Annual Research Report   Final Research Report ( PDF )
  • 2013 Research-status Report
  • 2012 Research-status Report
  • 2011 Research-status Report
  • Research Products

    (39 results)

All 2015 2014 2013 2012 2011 Other

All Journal Article (11 results) (of which Peer Reviewed: 11 results,  Acknowledgement Compliant: 2 results) Presentation (26 results) (of which Invited: 5 results) Remarks (2 results)

  • [Journal Article] Multiresolution Graph Fourier Transform for Compression of Piecewise Smooth Images2015

    • Author(s)
      Wei Hu, Gene Cheung, Antonio Ortega, Oscar Au
    • Journal Title

      IEEE Transactions on Image Processing

      Volume: vol.24, no.1, January Issue: 1 Pages: 419-433

    • DOI

      10.1109/tip.2014.2378055

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Multiple Description Coding and Recovery of Free Viewpoint Video for Wireless Network Streaming2015

    • Author(s)
      Zhi Liu, Gene Cheung, Jacob Chakareski, Yusheng Ji,
    • Journal Title

      IEEE Journal of Selected Topics in Signal Processin

      Volume: 9 Issue: 1 Pages: 151-164

    • DOI

      10.1109/jstsp.2014.2330332

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Anchor View Allocation for Collaborative Free Viewpoint Video Streaming2015

    • Author(s)
      Dongni Ren, Gary Chan, Gene Cheung, Vicky Zhao, Pascal Frossard
    • Journal Title

      IEEE Transactions on Multimedia

      Volume: vol.17, no.3, March Issue: 3 Pages: 307-322

    • DOI

      10.1109/tmm.2015.2389714

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Loss-Resilient Coding of Texture and Depth for Free-Viewpoint Video Conferencing2014

    • Author(s)
      Bruno Macchiavello, Camilo Dorea, Edson M. Hung, Gene Cheung, Wai-tian Tan
    • Journal Title

      IEEE Transactions on Multimedia

      Volume: vol.16, no.3, April Issue: 3 Pages: 711-725

    • DOI

      10.1109/tmm.2014.2299768

    • Related Report
      2014 Annual Research Report 2013 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Incentive Analysis for Cooperative Interactive Multiview Video Streaming2014

    • Author(s)
      Bo Hu, H. Vicky Zhao, Gene Cheung
    • Journal Title

      EURASIP Signal Processing: Image Communication

      Volume: vol.29, no.6, July Pages: 641-666

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Coding Structure and Replication Optimization for Interactive Multiview Video Streaming2014

    • Author(s)
      Dongni Ren, Gary Chan, Gene Cheung, Pascal Frossard
    • Journal Title

      IEEE Transactions on Multimedia

      Volume: vol.16, no.7, November Issue: 7 Pages: 1874-1887

    • DOI

      10.1109/tmm.2014.2332139

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Optimizing Distributed Source Coding for Interactive Multiview Video Streaming over Lossy Networks2013

    • Author(s)
      Z. LIU, G. CHEUNG, Y. JI
    • Journal Title

      IEEE Transaction on Circuits and Systems for Video Technology

      Volume: 23(accepted) Issue: 10 Pages: 1781-1794

    • DOI

      10.1109/tcsvt.2013.2269019

    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Journal Article] Low-Cost Eye Gaze Prediction in Interactive Networked Video Streaming2013

    • Author(s)
      Yunlong Feng, Gene Cheung, Wai-tian Tan, Pactrick Le Callet, Yunsheng Ji
    • Journal Title

      IEEE Transactions on Multimedia

      Volume: vol.15, no.8, December Issue: 8 Pages: 1865-1879

    • DOI

      10.1109/tmm.2013.2272918

    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Journal Article] Video Error Concealment Using a Computation-efficient Low Saliency Prior2013

    • Author(s)
      Hadi Hadizadeh, Ivan V. Bajic, Gene Cheung
    • Journal Title

      IEEE Transactions on Multimedia

      Volume: vol.15, no.8, December Issue: 8 Pages: 2099-2113

    • DOI

      10.1109/tmm.2013.2281024

    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Journal Article] 3D Motion Estimation for Visual Saliency Modeling2013

    • Author(s)
      Penfei Wan, Yunlong Feng, Gene Cheung, Ivan V. Bajic, Oscar C. Au
    • Journal Title

      IEEE Signal Processing Letters

      Volume: vol.20, no.10, October Issue: 10 Pages: 972-975

    • DOI

      10.1109/lsp.2013.2277595

    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Journal Article] Navigation Domain Partitioning for Interactive Multiview Imaging2013

    • Author(s)
      Thomas Maugey, Ismael Daribo, Gene Cheung, Pascal Frossard
    • Journal Title

      IEEE Transactions on Image Processing

      Volume: vo.22, no.9, September Issue: 9 Pages: 3459-3472

    • DOI

      10.1109/tip.2013.2270183

    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Presentation] Redefining Self-Similarity in Natural Images for Denoising Using Graph Signal Gradient2014

    • Author(s)
      Jiahao Pang, Gene Cheung, Wei Hu, Oscar C. Au
    • Organizer
      APSIPA ASC 2014
    • Place of Presentation
      Siem Reap, Combodia
    • Year and Date
      2014-12-09 – 2014-12-12
    • Related Report
      2014 Annual Research Report
  • [Presentation] Disocclusion Hole-Filling in DIBR-Synthesized Images using Multi-Scale Template Matching2014

    • Author(s)
      Smarti Reel, Patrick Wong, Gene Cheung, Laurence S. Dooley
    • Organizer
      IEEE Visual Communications and Image Processing
    • Place of Presentation
      Valleta, Malta
    • Year and Date
      2014-12-07 – 2014-12-10
    • Related Report
      2014 Annual Research Report
  • [Presentation] Graph-based Joint Denoising and Super-resolution of Generalized Piecewise Smooth Images2014

    • Author(s)
      Wei Hu, Gene Cheung, Xin Li, Oscar Au
    • Organizer
      IEEE International Conference on Image Processing
    • Place of Presentation
      Paris, France
    • Year and Date
      2014-10-27 – 2014-10-30
    • Related Report
      2014 Annual Research Report
  • [Presentation] Image Bit-depth Enhancement via Maximum-a-Posteriori Estimation of Graph AC Component2014

    • Author(s)
      Pengfei Wan, Gene Cheung, Dinei Florencio, Cha Zhang, Oscar Au
    • Organizer
      IEEE International Conference on Image Processing
    • Place of Presentation
      Paris, France
    • Year and Date
      2014-10-27 – 2014-10-30
    • Related Report
      2014 Annual Research Report
  • [Presentation] Joint Gaze-Correction and Beautification of DIBR-Synthesized Human Face via Dual Sparse Coding2014

    • Author(s)
      Xianming Liu, Gene Cheung, Deming Zhai, Debin Zhao, Hiroshi Sankoh, Sei Naito
    • Organizer
      IEEE International Conference on Image Processing
    • Place of Presentation
      Paris, France
    • Year and Date
      2014-10-27 – 2014-10-30
    • Related Report
      2014 Annual Research Report
  • [Presentation] Image Interpolation for DIBR View Synthesis Using Graph Fourier Transform2014

    • Author(s)
      Yu Mao, Gene Cheung, Yusheng Ji
    • Organizer
      3DTV-Conference 2014
    • Place of Presentation
      Budapest, Hungary
    • Year and Date
      2014-07-02 – 2014-07-04
    • Related Report
      2014 Annual Research Report
  • [Presentation] Low-Saliency Prior for Disocclusion Hole Filling in DIBR-Synthesized Images2014

    • Author(s)
      Bruno Macchiavello, Camilo Dorea, Edson M. Hung, Gene Cheung, Ivan Bajic
    • Organizer
      IEEE International Conference on Acoustics, Speech and Signal Processing
    • Place of Presentation
      Florence, Italy
    • Year and Date
      2014-05-04 – 2014-05-09
    • Related Report
      2014 Annual Research Report
  • [Presentation] Graph-based Interpolation for DIBR-synthesized Images with Nonlocal Means2013

    • Author(s)
      Yu Mao, Gene Cheung, Yusheng Ji
    • Organizer
      IEEE Global Conference on Signal and Information Processing (GlobalSIP) 2013
    • Place of Presentation
      Austin, TX, USA
    • Related Report
      2013 Research-status Report
    • Invited
  • [Presentation] Depth Map Denoising using Graph-based Transform and Group Sparsity2013

    • Author(s)
      Wei Hu, Xin Li, Gene Cheung, Oscar Au
    • Organizer
      IEEE International Workshop on Multimedia Signal Processing 2013
    • Place of Presentation
      Sardinia, Italy
    • Related Report
      2013 Research-status Report
  • [Presentation] Joint Texture-Depth Pixel Inpainting of Disocclusion Holes in Virtual View Synthesis2013

    • Author(s)
      Smarti Reel, Gene Cheung, Patrick Wong, Laurence S. Dooley
    • Organizer
      APSIPA ASC 2013
    • Place of Presentation
      Kaohsiung, Taiwan
    • Related Report
      2013 Research-status Report
  • [Presentation] Saliency-cognizant Robust View Synthesis in Free Viewpoint Video Streaming2013

    • Author(s)
      Bruno Macchiavello, Camilo Dorea, Edson M. Hung, Gene Cheung, Wai-tian Tan
    • Organizer
      IEEE International Conference on Image Processing 2013
    • Place of Presentation
      Melbourne, Australia
    • Related Report
      2013 Research-status Report
  • [Presentation] Rate-complexity Tradeoff for Client-side Free Viewpoint Image Rendering2013

    • Author(s)
      Yu Gao, Gene Cheung, Jie Liang
    • Organizer
      IEEE International Conference on Image Processing 2013
    • Place of Presentation
      Melbourne, Australia
    • Related Report
      2013 Research-status Report
  • [Presentation] Rate-distortion Optimized Merge Frame using Piecewise Constant Functions2013

    • Author(s)
      Wei Dai, Gene Cheung, Ngai-Man Cheung, Antonio Ortega, Oscar Au
    • Organizer
      IEEE International Conference on Image Processing 2013
    • Place of Presentation
      Melbourne, Australia
    • Related Report
      2013 Research-status Report
  • [Presentation] Optimizing Peer Grouping for Live Free Viewpoint Video Streaming2013

    • Author(s)
      Yuan Yuan, Bo Hu, Gene Cheung, Vicky Zhao
    • Organizer
      IEEE International Conference on Image Processing 2013
    • Place of Presentation
      Melbourne, Australia
    • Related Report
      2013 Research-status Report
  • [Presentation] Intra Predictive Transform Coding based on Predictive Graph Transform2013

    • Author(s)
      Yongzhe Wang, Antonio Ortega, Gene Cheung
    • Organizer
      IEEE International Conference on Image Processing 2013
    • Place of Presentation
      Melbourne, Australia
    • Related Report
      2013 Research-status Report
  • [Presentation] Expansion Hole Filling in Depth-Image-Based Rendering using Graph-based Interpolation2013

    • Author(s)
      Yu Mao, Gene Cheung, Antonio Ortega, Yusheng Ji
    • Organizer
      IEEE International Conference on Acoustics, Speech and Signal Processing
    • Place of Presentation
      Vancouver, Canada
    • Related Report
      2012 Research-status Report
    • Invited
  • [Presentation] Depth Map Compression using Multi-resolution Graph-based Transform for Depth-image-based Rendering2012

    • Author(s)
      Wei Hu, Gene Cheung, Xin Li, Oscar Au
    • Organizer
      IEEE International Conference on Image Processing
    • Place of Presentation
      Orlando, FL, USA
    • Related Report
      2012 Research-status Report
    • Invited
  • [Presentation] Quality-optimized Encoding of JPEG Images using Transform Domain Sparsification2012

    • Author(s)
      Junichi Ishida, Gene Cheung, Akira Kubota, Antonio Ortega
    • Organizer
      IEEE International Workshop on Multimedia Signal Processing
    • Place of Presentation
      Banff, Canada
    • Related Report
      2012 Research-status Report
    • Invited
  • [Presentation] Video Attention Deviation Estimation using Inter-Frame Visual Saliency Map Analysis2012

    • Author(s)
      Yunlong Feng, Gene Cheung, Patrick Le Callet, Yusheng Ji
    • Organizer
      IS&T/SPIE Visual Information Processing and Communication Conference
    • Place of Presentation
      Burlingame, CA
    • Related Report
      2011 Research-status Report
  • [Presentation] Transform Domain Sparsification of Depth Maps using Iterative Quadratic Programming2011

    • Author(s)
      Gene Cheung, Junichi Ishida, Akira Kubota, Antonio Ortega
    • Organizer
      IEEE International Conference on Image Processing
    • Place of Presentation
      Brussels, Belgium
    • Related Report
      2011 Research-status Report
  • [Presentation] Depth Map Coding using Graph Based Transform and Transform Domain Sparsification2011

    • Author(s)
      Gene Cheung, Woo-shik Kim, Antonio Ortega, Junichi Ishida, Akira Kubota
    • Organizer
      IEEE International Workshop on Multimedia Signal Processing
    • Place of Presentation
      Hangzhou, China
    • Related Report
      2011 Research-status Report
  • [Presentation] Sparse Representation of Depth Map using Penalty Function2011

    • Author(s)
      Junichi Ishida, Gene Cheung, Akira Kubota, Antonio Ortega
    • Organizer
      Picture Coding Symposium Japan
    • Place of Presentation
      Atami, Japan
    • Related Report
      2011 Research-status Report
  • [Presentation] Distributed Markov Decision Process in Cooperative Peer-to-peer Repair for WWAN Video Broadcast2011

    • Author(s)
      Zhi Liu, Gene Cheung, Yusheng Ji
    • Organizer
      IEEE Workshop on Streaming and Media Communications
    • Place of Presentation
      Barcelona, Spain
    • Related Report
      2011 Research-status Report
  • [Presentation] Hidden Markov Model for Eye Gaze Prediction in Networked Video Streaming2011

    • Author(s)
      Yunlong Feng, Gene Cheung, Wai-tian Tan, Yusheng Ji
    • Organizer
      IEEE International Conference on Multimedia and Expo
    • Place of Presentation
      Barcelona, Spain
    • Related Report
      2011 Research-status Report
  • [Presentation] Distributed Markov Decision Process in Cooperative Peer Recovery for WWAN Multiview Video Multicast2011

    • Author(s)
      Zhi Liu, Gene Cheung, Yusheng Ji
    • Organizer
      IEEE Visual Communication and Image Processing (VCIP) Conference
    • Place of Presentation
      Tainan City, Taiwan
    • Related Report
      2011 Research-status Report
  • [Presentation] Depth Map Super-resolution Using Synthesized View Matching for Depth-image-based Rendering

    • Author(s)
      Wei Hu, Gene Cheung, Xin Li, Oscar Au
    • Organizer
      3rd International Workshop on Hot Topics in 3D (in conjunction with ICME 2012)
    • Place of Presentation
      Melbourne, Australia
    • Related Report
      2012 Research-status Report
    • Invited
  • [Remarks] Gene Cheung's personal page

    • URL

      http://research.nii.ac.jp/~cheung/index.html

    • Related Report
      2014 Annual Research Report
  • [Remarks] Gene Cheung's personal page

    • URL

      http://research.nii.ac.jp/~cheung/index.html

    • Related Report
      2013 Research-status Report

URL: 

Published: 2011-08-05   Modified: 2021-04-07  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi