• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Compression of time-varying 3D meshes based on patch-based matching

Research Project

Project/Area Number 22650016
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeSingle-year Grants
Research Field Media informatics/Database
Research InstitutionThe University of Tokyo

Principal Investigator

YAMASAKI Toshihiko  東京大学, 大学院・情報理工学系研究科, 准教授 (70376599)

Co-Investigator(Renkei-kenkyūsha) AIZAWA Kiyoharu  東京大学, 大学院・情報学環, 教授 (20192453)
Project Period (FY) 2010 – 2012
Project Status Completed (Fiscal Year 2012)
Budget Amount *help
¥3,120,000 (Direct Cost: ¥2,700,000、Indirect Cost: ¥420,000)
Fiscal Year 2012: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2011: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2010: ¥1,300,000 (Direct Cost: ¥1,300,000)
Keywords3次元映像 / 圧縮 / パッチマッチング
Research Abstract

We have developed intra-frame and inter-frame coding algorithms for 3D mesh sequences generated bymultiple cameras, which we call Time-Varying Meshes (TVMs). For this purpose, mesh segmentationinto patches with patch alignment using principal component analysis (PCA) is proposed. The patchesare used as minimum units to eliminate spatial and temporal correlation of the TVMs. For intra-framecoding of geometry data, spectral compression using the Kirchhoff matrix was employed and that ofcolor texture was conducted using vector quantization (VQ). The inter-frame coding of geometry dataand color texture was achieved by the combination of patch-based matching and simple scalar quantization.Asaresult,theTVMdatawereefficientlycompressedto1/8and1/12byintra-frameand inter-framecoding,respectively.

Report

(4 results)
  • 2012 Annual Research Report   Final Research Report ( PDF )
  • 2011 Annual Research Report
  • 2010 Annual Research Report
  • Research Products

    (60 results)

All 2013 2012 2011 2010 Other

All Journal Article (27 results) (of which Peer Reviewed: 21 results) Presentation (26 results) Book (2 results) Remarks (3 results) Patent(Industrial Property Rights) (2 results) (of which Overseas: 1 results)

  • [Journal Article] Rel ative-Distance-BasedSoft Votingfor HumanAttribute Analysis using Top-View2013

    • Author(s)
      T. Yamasaki and T. Chen
    • Journal Title

      Images,"ITETransactionsonMediaTechnologyandpplications,

      Volume: vol. 1, no. 2 Pages: 138-147

    • Related Report
      2012 Final Research Report
  • [Journal Article] Human attribute analysis using atop-view camera based on two-stageclassification2013

    • Author(s)
      T. Yamasaki, T. Matsunami, and T.Chen
    • Journal Title

      IEICE Transactions onInformation and Systems

      Volume: Vol. E96-D,No.4 Pages: 993-996

    • Related Report
      2012 Final Research Report
  • [Journal Article] Human attribute analysis using a top-view camera based on two-stage classification2013

    • Author(s)
      T. Yamasaki, T. Matsunami, and T. Chen
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: Vol. E96-D Pages: 993-996

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Relative-Distance-Based Soft Voting for Human Attribute Analysis using Top-View Images2013

    • Author(s)
      T. Yamasaki and T. Chen
    • Journal Title

      ITE Transactions on Media Technology and Applications

      Volume: Vol. 1 Pages: 138-147

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] SIFT-based non-blind watermarking robust to non-linear geometrical distortions,” IEICE Transactions on Information and Systems2013

    • Author(s)
      T. Yamasaki and K. Aizawa
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: Vol.E96-D

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Classification of Cerebral Lymphomas and Glioblastomas Featuring Luminance Distribution Analysis2013

    • Author(s)
      T. Yamasaki, T. Chen, T. Hirai, and R. Murakami
    • Journal Title

      Computational and Mathematical Methods in Medicine

      Volume: NA

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Differentiating Cerebral Lymphomas and GBMs Featuring Luminance Distribution Analysis2013

    • Author(s)
      T. Yamasaki, T. Chen, M. Yagi, Hirai, and R. Murakami
    • Journal Title

      SPIE medical imaging

      Volume: NA

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Beyond Spatial Pyramid Matching: Spatial Soft Voting for Image Classification2012

    • Author(s)
      T. Yamasaki and T. Chen
    • Journal Title

      ACCV2012 Workshop on Intelligent Mobile Vision

      Volume: NA

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Classification of Cerebral Lymphoma and Glioblastoma by the Combination of ADC Thresholding and Luminance Distribution Learning2012

    • Author(s)
      T. Yamasaki, T. Chen, T. Hirai, and R. Murakami
    • Journal Title

      Proceedings of International Workshop on Pattern Recognition for Healthcare Analytics

      Volume: NA

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Confidence-Assisted Classification Result Refinement for Object Recognition Featuring TopN-Exemplar-SVM2012

    • Author(s)
      T. Yamasaki and T. Chen
    • Journal Title

      Proceedings of International Conference on Pattern Recognition (ICPR), USB Proceedings

      Volume: NA

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Spatial Statistics for Spatial Pyramid Matching Based Image Recognition2012

    • Author(s)
      T. Yamasaki and T. Chen
    • Journal Title

      Proceedings of APSIPA Annual Summit and Conference

      Volume: NA

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Comparative Study of Interactive Seed Generation for Growcut-Based Fast 3D MRI Segmentation2012

    • Author(s)
      T. Yamasaki, T. Chen, M. Yagi, T. Hirai, and Murakami
    • Journal Title

      Proceedings of APSIPA Annual Summit and Conference

      Volume: NA

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Face Recognition Challenge: Object Recognition Approaches for Human/Avatar Classification2012

    • Author(s)
      T. Yamasaki and T. Chen
    • Journal Title

      Proceedings of 11th International Conference on Machine Learning and Applications

      Volume: NA

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] GrowCut-Based Fast Tumor Segmentation for 3D Magnetic Resonance Images2012

    • Author(s)
      T.Yamasaki, T.Chen, M.Yagi, Hirai, Murakami
    • Journal Title

      Proceedings of SPIE Medical Imaging

      Volume: (CD-ROM)

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Relative-Distance-Based Soft Voting for Feature Representation and Its Application to Human Attribute Analysis2012

    • Author(s)
      T.Yamasaki
    • Journal Title

      Proceedings of 2012 IEEE International Conference on Acoustics, Speech, and Signal Processing

      Pages: 1421-1424

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Depth Video Camera Based Temporal Alpha Matting For Natural 3d Scene Generation2011

    • Author(s)
      J.-H.Cho; T.Yamasaki; K.Aizawa; K.H.Lee
    • Journal Title

      Proceedings of 3DTV-Conference 2011

      Volume: (CD-ROM)

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Human Attribute Analysis using a Top-View Camera Based on Multi-Stage Classification2011

    • Author(s)
      T.Yamasaki, T.Matsunami
    • Journal Title

      Proceedings of 5th ACM/IEEE International Conference on Distributed Smart Cameras

      Volume: (CD-ROM)

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Marker-less Human Pose Estimation and Surface Reconstruction Using a Segmented Model2011

    • Author(s)
      W.Luo, T.Yamasaki, K.Aizawa
    • Journal Title

      Proceedings of IEEE International Conference on Image Processing 2011

      Pages: 901-904

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Pedestrian Attribute Analysis Using a Top-View Camera in a Public Space2011

    • Author(s)
      T.Yamasaki, T.Matsunami
    • Journal Title

      Proceedings of 18th International Conference on MultiMedia Modeling

      Pages: 541-550

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] GrowCut-Based Fast Tumor Segmentation for 3D Magnetic Resonance Images2011

    • Author(s)
      T.Yamasaki
    • Journal Title

      Advanced Electronics and Information System for Quality Life and Society

      Pages: 541-550

    • Related Report
      2011 Annual Research Report
  • [Journal Article] シルエット抽出とモデル生成の相互フィードバックによる Time-Varying Mesh の高精度化 (Time-Varying Mesh Generation Based on Iterative Feedback betweenSilhouette Extraction and Geometry Modeling)2010

    • Author(s)
      山田健太郎, 山崎俊彦, 相澤清晴
    • Journal Title

      電子情報通信学会論文誌

      Volume: vol.J93-D, no.8 Pages: 1533-1543

    • Related Report
      2012 Final Research Report
  • [Journal Article] シルエット抽出とモデル生成の相互フィードバックによるTime-Varying Meshの高精度化2010

    • Author(s)
      山田健太郎, 山崎俊彦, 相澤清晴
    • Journal Title

      電子情報通信学会論文誌D

      Volume: vol.J93-D, no,8 Pages: 1533-1543

    • NAID

      110007681690

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Generation and Processing of Live-Action 3D Mesh Sequences2010

    • Author(s)
      T Yamasaki
    • Journal Title

      Microsoft Research Asia Japan Taiwan Academic Forum

      Pages: 25-30

    • Related Report
      2010 Annual Research Report
  • [Journal Article] Approaches to Compression of 3-D Video2010

    • Author(s)
      S.-R.Han, T.Yamasaki, K.Aizawa
    • Journal Title

      Proc. Visual Communications and Image Processing

      Volume: SPIE Vol.7744(掲載確定)

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Patch-Based Compression for Time-Varying Meshes2010

    • Author(s)
      T.Yamasaki, K.Aizawa
    • Journal Title

      2010 IEEE 17th International Conference on Image Processing

      Pages: 2945-2928

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Patch-based Compression for Time-Varying Meshes2010

    • Author(s)
      T.Yamasaki, K.Aizawa
    • Journal Title

      GCOE Symposium

      Volume: (掲載確定)

    • Related Report
      2010 Annual Research Report
  • [Journal Article] Bit allocation of vertices and colors for patch-based coding in time-varying meshes2010

    • Author(s)
      T.Yamasaki, K.Aizawa
    • Journal Title

      Proceedings of 28th Picture Coding Syxnposium

      Pages: 162-165

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Presentation] Differentiating Cerebral Lymphomas and GBMs Featuring Luminance Distribution Analysis2013

    • Author(s)
      T. Yamasaki, T. Chen, T. Hirai, and R. Murakami
    • Organizer
      SPIE medical imaging
    • Place of Presentation
      Florida, USA
    • Related Report
      2012 Annual Research Report
  • [Presentation] Beyond Spatial Pyramid Matching: Spatial Soft Voting for Image Classification2012

    • Author(s)
      T. Yamasaki and T. Chen
    • Organizer
      ACCV2012 Workshop on Intelligent Mobile Vision
    • Place of Presentation
      Daejeon, Korea
    • Related Report
      2012 Annual Research Report
  • [Presentation] Classification of Cerebral Lymphoma and Glioblastoma by the Combination of ADC Thresholding and Luminance Distribution Learning2012

    • Author(s)
      T. Yamasaki, T. Chen, T. Hirai, and R. Murakami
    • Organizer
      International Workshop on Pattern Recognition for Healthcare Analytics
    • Place of Presentation
      Tsukuba, Japan
    • Related Report
      2012 Annual Research Report
  • [Presentation] Confidence-Assisted Classification Result Refinement for Object Recognition Featuring TopN-Exemplar-SVM2012

    • Author(s)
      T. Yamasaki and T. Chen
    • Organizer
      International Conference on Pattern Recognition
    • Place of Presentation
      Tsukuba, Japan
    • Related Report
      2012 Annual Research Report
  • [Presentation] Spatial Statistics for Spatial Pyramid Matching Based Image Recognition2012

    • Author(s)
      T. Yamasaki and T. Chen
    • Organizer
      APSIPA Annual Summit and Conference
    • Place of Presentation
      Hollywood, USA
    • Related Report
      2012 Annual Research Report
  • [Presentation] Comparative Study of Interactive Seed Generation for Growcut-Based Fast 3D MRI Segmentation2012

    • Author(s)
      T. Yamasaki, T. Chen, M. Yagi, T. Hirai, and R. Murakami
    • Organizer
      APSIPA Annual Summit and Conference
    • Place of Presentation
      Hollywood, USA
    • Related Report
      2012 Annual Research Report
  • [Presentation] Face Recognition Challenge: Object Recognition Approaches for Human/Avatar Classification2012

    • Author(s)
      T. Yamasaki and T. Chen
    • Organizer
      11th International Conference on Machine Learning and Applications
    • Place of Presentation
      Florida, USA
    • Related Report
      2012 Annual Research Report
  • [Presentation] Feature Representation Featuring Spatial Statistics and Confidence-Assisted Classification for Better Object Recognition2012

    • Author(s)
      T. Yamasaki and T. Chen
    • Organizer
      2nd Multimedia and Vision Meeting in the Greater New York Area
    • Place of Presentation
      NY, USA
    • Related Report
      2012 Annual Research Report
  • [Presentation] Pedestrian Attribute Analysis Using a Top-View Camera in a Public Space2012

    • Author(s)
      T.Yamasaki, T.Matsunami
    • Organizer
      18th International Conference on MultiMedia Modeling
    • Place of Presentation
      Klagenfurt, Austria
    • Related Report
      2011 Annual Research Report
  • [Presentation] GrowCut-Based Fast Tumor Segmentation for 3D Magnetic Resonance Images2012

    • Author(s)
      T.Yamasaki
    • Organizer
      Advanced Electronics and Information System for Quality Life and Society
    • Place of Presentation
      Tokyo, Japan
    • Related Report
      2011 Annual Research Report
  • [Presentation] GrowCut-Based Fast Tumor Segmentation for 3D Magnetic Resonance Images2012

    • Author(s)
      T.Yamasaki, T.Chen, M.Yagi, Hirai, Murakami
    • Organizer
      SPIE Medical Imaging
    • Place of Presentation
      San Diego, USA
    • Related Report
      2011 Annual Research Report
  • [Presentation] Relative-Distance-Based Soft Voting for Feature Representation and Its Application to Human Attribute Analysis2012

    • Author(s)
      T.Yamasaki
    • Organizer
      2012 IEEE International Conference on Acoustics, Speech, and Signal Processing
    • Place of Presentation
      Kyoto, Japan
    • Related Report
      2011 Annual Research Report
  • [Presentation] Marker-less Human Pose Estimationand Surface Reconstruction Using aSegmented Model2011

    • Author(s)
      W. Luo, T. Yamasaki, and K. Aizawa,
    • Organizer
      Proceedings of IEEEInternational Conference on Image Processing
    • Place of Presentation
      Brussels,Belgium
    • Related Report
      2012 Final Research Report
  • [Presentation] Depth Video Camera Based Temporal Alpha Matting For Natural 3d Scene Generation2011

    • Author(s)
      J.-H.Cho; T.Yamasaki; K.Aizawa; K.H.Lee
    • Organizer
      3DTV-Conference 2011
    • Place of Presentation
      Antalya, Turkey
    • Related Report
      2011 Annual Research Report
  • [Presentation] Human Attribute Analysis using a Top-View Camera Based on Multi-Stage Classification2011

    • Author(s)
      T.Yamasaki, T.Matsunami
    • Organizer
      5th ACM/IEEE International Conference on Distributed Smart Cameras
    • Place of Presentation
      Ghent, Belgium
    • Related Report
      2011 Annual Research Report
  • [Presentation] Marker-less Human Pose Estimation and Surface Reconstruction Using a Segmented Model2011

    • Author(s)
      W.Luo, T.Yamasaki, K.Aizawa
    • Organizer
      IEEE International Conference on Image Processing 2011
    • Place of Presentation
      Brussels, Belgium
    • Related Report
      2011 Annual Research Report
  • [Presentation] 動き情報を用いた多視点画像から3D形状復元手法2011

    • Author(s)
      ビウェイ・山崎俊彦・相澤清晴
    • Organizer
      電子情報通信学会総合大会
    • Place of Presentation
      東京
    • Related Report
      2010 Annual Research Report
  • [Presentation] Marker-less Pose Estimation for Fast Human Motion Clips2011

    • Author(s)
      W.Lua, T.Yamasaki, K.Aizawa
    • Organizer
      電子情報通信学会総合大会
    • Place of Presentation
      東京
    • Related Report
      2010 Annual Research Report
  • [Presentation] 実写3次元映像の生成と処理2010

    • Author(s)
      山崎俊彦
    • Organizer
      機械学会ロボメカ部門地区特別講演会
    • Place of Presentation
      東北大学
    • Year and Date
      2010-09-17
    • Related Report
      2010 Annual Research Report
  • [Presentation] 携帯端末のための3次元コンテンツ処理2010

    • Author(s)
      山崎俊彦
    • Organizer
      画像電子学会Advanced Image Seminar 2010
    • Place of Presentation
      日本科学未来館
    • Year and Date
      2010-04-21
    • Related Report
      2010 Annual Research Report
  • [Presentation] 3D pose estimation in high dimensionalsearch spaces with local memorization2010

    • Author(s)
      W. Luo, T. Yamasaki, and K. Aizawa,
    • Organizer
      Proceedings of 28th Picture CodingSymposium (PCS2010)
    • Place of Presentation
      Nagoya,Aichi
    • Related Report
      2012 Final Research Report
  • [Presentation] Bit allocationofverticesandcolorsforpatch-basedcoding in time-varyingmeshes2010

    • Author(s)
      T. Yamasaki and K. Aizawa
    • Organizer
      Proceedingsof28th PictureCodingSymposium (PCS2010)
    • Place of Presentation
      Nagoya, Aichi
    • Related Report
      2012 Final Research Report
  • [Presentation] Automatic Preview Video GenerationFor Mesh Sequences2010

    • Author(s)
      S.R. Han, T. Yamasaki and K. Aizawa,
    • Organizer
      2010 IEEE 17thInternational Conference on Image Processing(ICIP2010)
    • Place of Presentation
      HongKong,China
    • Related Report
      2012 Final Research Report
  • [Presentation] Patch-Based Compression for Time-Varying Meshes2010

    • Author(s)
      T. Yamasaki and K. Aizawa,
    • Organizer
      2010 IEEE 17thInternational Conference on Image Processing(ICIP2010)
    • Place of Presentation
      HongKong,China
    • Related Report
      2012 Final Research Report
  • [Presentation] Deformation-Based CompressionofTime-VaryingMeshesfor Displayingon Mobile Terminals2010

    • Author(s)
      S. Nakagawa, T. Yamasaki, and K.Aizawa
    • Organizer
      3DTVConference2010(3DTV-Con2010),USBProceedings
    • Place of Presentation
      Tampere,Finland
    • Related Report
      2012 Final Research Report
  • [Presentation] 写実的レンダリングに向けたTime-Varying Meshの表面属性推定2010

    • Author(s)
      畢微, 山崎俊彦, 相澤清晴
    • Organizer
      第9回情報科学技術フォーラム
    • Place of Presentation
      九州大学
    • Related Report
      2010 Annual Research Report
  • [Book] Modelingand Simulationin Engineering,InTech,editor:CatalinAlexandru, Chapter72012

    • Author(s)
      T. Yamasaki and K. Aizawa
    • Publisher
      RefinementofVisualHullsforHumanPerformanceCapture,"
    • Related Report
      2012 Final Research Report
  • [Book] Modeling and Simulation in Engineering(第7章を執筆)2012

    • Author(s)
      T.Yamasaki, K.Aizawa
    • Total Pages
      298
    • Publisher
      InTech
    • Related Report
      2011 Annual Research Report
  • [Remarks]

    • URL

      http://www.hal.t.u-tokyo.ac.jp/ja/index.html

    • Related Report
      2012 Final Research Report
  • [Remarks]

    • URL

      http://www.hal.t.u-tokyo.ac.jp/ja/index.html

    • Related Report
      2011 Annual Research Report
  • [Remarks]

    • URL

      http://www.hal.t.u-tokyo.ac.jp/ja/index.html

    • Related Report
      2010 Annual Research Report
  • [Patent(Industrial Property Rights)] 3 次元動画像の圧縮に用いる基本単位2012

    • Inventor(s)
      山崎俊彦、相澤清晴
    • Industrial Property Rights Holder
      山崎俊彦、相澤清晴
    • Patent Publication Number
      2012-068881
    • Acquisition Date
      2012-04-05
    • Related Report
      2012 Final Research Report
    • Overseas
  • [Patent(Industrial Property Rights)] 特許2010

    • Inventor(s)
      山崎俊彦、相澤清晴
    • Industrial Property Rights Holder
      山崎俊彦、相澤清晴
    • Industrial Property Number
      2010-122837
    • Filing Date
      2010-09-22
    • Related Report
      2010 Annual Research Report

URL: 

Published: 2010-08-23   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi