• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Real-Tune 3D Shape Reconstruction, Visualization, Editing, and Coding for 3D Video

Research Project

Project/Area Number 13308017
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent informatics
Research InstitutionKYOTO UNIVERSITY

Principal Investigator

MATSUYAMA Takashi  MATSUYAMA,Takashi, 情報学研究科, 教授 (10109035)

Co-Investigator(Kenkyū-buntansha) TOUKAI Syougo  Fukui University, Faculty of Engineering, Associate Professor, 工学部, 助教授 (50283627)
SUGIMOTO Akihiro  National Institute of Genetics, Human-Machine Symbiosis Research, Associate Professor, 知能システム系, 助教授 (30314256)
WADA Toshikazu  Wakayama University, Faculty of Systems Engineering, Professor, システム工学部, 教授 (00231035)
HABE Hitoshi  KYOTO UNIVERSITY, Graduate School of Engineering, Research Associate, 工学研究科, 助手 (80346072)
KAWASHIMA Hiroaki  KYOTO UNIVERSITY, Graduate School of Informatics, Research Associate, 情報学研究科, 助手 (40346101)
Project Period (FY) 2001 – 2003
Project Status Completed (Fiscal Year 2003)
Budget Amount *help
¥49,530,000 (Direct Cost: ¥38,100,000、Indirect Cost: ¥11,430,000)
Fiscal Year 2003: ¥8,060,000 (Direct Cost: ¥6,200,000、Indirect Cost: ¥1,860,000)
Fiscal Year 2002: ¥16,640,000 (Direct Cost: ¥12,800,000、Indirect Cost: ¥3,840,000)
Fiscal Year 2001: ¥24,830,000 (Direct Cost: ¥19,100,000、Indirect Cost: ¥5,730,000)
Keywords3D Video / Multi-Viewpoint Video / Real-Time 3D Shape Reconstruction / Deformable Mesh Model / Lighting Environment Sensing / Texture Mapping / Free Viewpoint Video / PC Cluster / 3次元ビデオ映像 / 3次元形状復元 / MPEG
Research Abstract

We have obtained the following technical attainments to realize 3D video generation, visualization, editing, and coding.
1. PC cluster system (PC : 30, active camera : 25) to capture synchronized multi-view video of human action
2. Precise calibration method for quasi fixed-viewpoint pan-tilt-zoom camera
3. 3 base plane visual cone intersection algorithm and its parallel pipeline processing method for real-time dynamic 3D shape reconstruction using PC cluster ; with this system, we can reconstruct over 10 volumes per second of human action at 2cm X 2cm X 2cm spatial resolution.
4. cooperative camera work planning for zoom-up active video capturing of human body parts ; with this method, we will be able to increase the accuracy of 3D shape and surface texture significantly.
5. 3D deformable mesh model for reconstructing accurate 3D human shape and motion ; with this method, we can reconstruct even concave portions of 3D human body.
6. Viewpoint dependent high fidelity texture mapping algorithm for 3D video visualization ; with,this method, we can visualize 3D video of almost standard video quality.
7. Lighting environment sensing (i.e. estimation of multiple light sources) using multiple Lambertian spheres
8. Lighting environment sensing using skeleton cube
9. Interactive 3D video editing system using 3D video and omni-directional panoramic video
10. Coding method of omni-directional video based on unfolded regular polyhedron
11. Coding method of 3D video based on planar mapping of 3D surface shape
As for two coding methods listed above, we proposed them to MPEG for international standardization.

Report

(4 results)
  • 2003 Annual Research Report   Final Research Report Summary
  • 2002 Annual Research Report
  • 2001 Annual Research Report
  • Research Products

    (33 results)

All Other

All Publications (33 results)

  • [Publications] ウ小軍, 和田俊和, 東海彰吾, 松山隆司: "平面間透視投影を用いた並列視体積交差法"情報処理学会CVIM研究会論文誌. Vol.42,No.SIG6(CVIM2). 33-43 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] 東海彰吾, 弓場竜, ウ小軍, 松山隆司: "アクティブカメラを用いた動的広域シーンの映像提示法"電子情報通信学会論文誌. Vol.J84・D・II No.8. 1910-1920 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] 高井 勇志, 松山 隆司: "3次元ビデオ映像の高精細表示アルゴリズムと編集システム"映像情報メディア学会論文誌. Vol.58,No.4. 593-602 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] 延原章平, 和田俊和, 松山隆司: "弾性メッシュモデルを用いた多視点画像からの高精度形状復元"情報処理学会CVIM研究会論文誌. Vol.43,No.SIG-11(CVIM5). 53-63 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] 松山隆司, 高井勇志, ウ 小軍, 延原章平: "3次元ビデオ映像の撮影・編集・表示"日本バーチャルリアリティ学会論文誌. Vol.7,No.4. 521-532 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] T.Matsuyama, X.Wu, T.Takai, T.Wada: "Real-Time Dynamic 3D Object Shape Reconstruction and High-Fidelity Texture Mapping for 3D Video"IEEE Trans. on Circuits and Systems for Video Technology. Vol.14,No.3. 357-369 (2004)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] T.Matsuyama, X.Wu, T.Takai, S.Nobuhara: "Real-Time 3D Shape Reconstruction, Dynamic 3D Mesh Deformation, and High Fidelity Visualization for 3D Video"International Journal on Computer Vision and Image Understanding. (IN PRESS).

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] T.Matsuyama, T.Takai: "Generation, Visualization, and Editing of 3D Video"Proc. of symposium on 3D Data Processing Visualization and Transmission. 234-245 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] T.Matsuyama, X.Wu, T.Takai, S.Nobuhara: "Real-Time Generation and High Fidelity Visualization of 3D Video"Proc. of MIRAGE2003. 1-10 (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] X.Wu, T.Matsuyama: "Real-Time Active 3D Shape Reconstruction for 3D Video"Proc.of 3rd International Symposium on Image and Signal Processing and Analysis. 186-191 (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] S.Nobuhara, T.Matsuyama: "Dynamic 3D Shape from Multi-Viewpoint Images Using Deformable Mesh Model"Proc.of 3rd International Symposium on Image and Signal Processing and Analysis. 192-197 (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] X.Wu, T.Wada, S.Toukai, T.Matsuyama: "Parallel Volume Intersection Based on Plane-to-Plane Projection"IPSJ Transactions on CVIM. 42, No.SIG-6 (CVIM 2). 33-43 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] S.Toukai, R.Yumiba, X.Wu, T.Matsuyama: "An Active Camera System for the Wide Area Scene Visualization"The IEICE Transactions (Japanese Edition). J84-D-II, No.8. 1910-1920 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] T.Takai, T.Matsuyama: "High Fidelity Visualization Algorithm and 3D Editing System for 3D Video"The journal of the institute of image information and television engineers. 58, No.4. 593-602 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] S.Nobuhara, T.Wada, T.Matsuyama: "3D Shape From Multi-viewpoint Images Using Deformable Mesh Model"IPSJ Transactions on CVIM. 43, No.SIG-11 (CVIM 5). 53-63 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] T.Matsuyama, T.Takai, X.Wu, S.Nobuhara: "Generation, Editing, and Visualization of 3D Video"The journal of the virtual reality society of Japan. 7, N0.4. 521-532 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] T.Matsuyama, X.Wu, T.Takai, T.Wada: "Real-Time Dynamic 3D Object Shape Reconstruction and High-Fidelity Texture Mapping for 3D Video"IEEE Trans.. 14, No3. 357-369 (2004)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] T.Matsuyama, X.Wu, T.Takai, S.Nobuhara: "Real-Time 3D Shape Reconstruction, Dynamic 3D Mesh Deformation, and High Fidelity Visualization for 3D Video"International Journal on Compute Vision and Image Understanding. (in press).

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] T.Matsuyama, T.Takai: "Generation, Visualization, and Editing of 3D Video"Proc.of symposium on 3D Data Processing Visualization and Transmission. 234-245 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] T.Matsuyama, X.Wu, T.Takai, S.Nobuhara: "Real-Time Generation and High Fidelity Visualization of 3D Video"Proc.of MIRAGE2003. (INVITED PAPER). 1-10 (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] X.Wu, T.Matsuyama: "Real-Time Active 3D Shape Reconstruction for 3D Video"Proc.of 3rd International Symposium on Image and Signal Processing and Analysis. 186-191 (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] S.Nobuhara, T.Matsuyama: "Dynamic 3D Shape from Multi-Viewpoint Images Using Deformable Mesh Model"Proc.of 3rd International Symposium on Image and Signal Processing and Analysis. 192-197 (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] T.Matsuyama, X.Wu, T.Takai, T.Wada: "Real-Time Dynamic 3D Object Shape Reconstruction and High-Fidelity Texture Mapping for 3D Video"IEEE Trans. Vol.CSVT(IN PRESS). (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] X.Wu, T.Matsuyama: "Real-Time Active 3D Shape Reconstruction for 3D Video"Proc. of 3rd International Symposium on Image and Signal Processing and Analysis. 186-191 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] S.Nobuhara, T.Matsuyama: "Dynamic 3D Shape from Multi-Viewpoint Images Using Deformable Mesh Model"Proc. of 3rd International Symposium on Image and Signal Processing and Analysis. 192-197 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 高井 勇志, 松山 隆司: "3次元ビデオ映像の高精細表示アルゴリズムと編集システム"映像情報メディア学会論文誌. Vo.58,No.4. 593-602 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 延原章平, 和田俊和, 松山隆司: "弾性メッシュモデルを用いた多視点画像からの高精度3次元形状復元"情報処理学会CVIM研究会論文誌. Vol.43,No.SIG-11(CVIM5). 53-63 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 松山隆司, 高井勇志, ウ 小軍, 延原章平: "3次元ビデオ映像の撮影・編集・表示"日本バーチャルリアリティ学会論文誌. Vol.7,NO.4. 521-532 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 松山隆司: "3次元ビデオ映像世界の開拓"ヘカトンケイル. 31号. 1-2 (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] T.Matsuyama, T.Takai: "Generation, Visualization, and Editing of 3D Video"Proc. of Symposium on 3D Data Processing Visualization and Transmission. 234-245 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] T.Matsuyama, X.Wu, T.Takai, S.Nobuhara: "Real-Time Generation and High Fidelity Visualization of 3D Video"Proc. of MIRAGE2003 (INVITED PAPER). 1-10 (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] 松山隆司: "3次元ビデオ映像の生成・編集・表示"画像ラボ. Vol.13 No.1. 16-19 (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] 高井勇志: "3次元ビデオ映像の高精細表示アルゴリズムと編集システム"映像情報メディア学会論文誌. (掲載予定). (2002)

    • Related Report
      2001 Annual Research Report

URL: 

Published: 2001-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi