• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Learning Real-time Skin Deformation Models for 3D Virtual Characters

Research Project

Project/Area Number 18K11607
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 62040:Entertainment and game informatics-related
Research InstitutionTokyo Metropolitan University

Principal Investigator

Mukai Tomohiko  東京都立大学, システムデザイン研究科, 准教授 (10432296)

Project Period (FY) 2018-04-01 – 2021-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2020: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2019: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2018: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
Keywordsコンピュータグラフィックス / キャラクタアニメーション / スキニング / キャラクタ形状変形 / リギング / 補助骨 / アニメーション / 機械学習
Outline of Final Research Achievements

We have developed a system that automatically constructs a lightweight mathematical model that mimics the skin deformation obtained using a heavy-weight deformation model (e.g., a virtual muscle or a complex model manually constructed by a designer). Our method enables to synthesize skin deformation with higher quality than conventional techniques based on helper bone technique, by the proposed technique for extending the geometric transformation degrees of freedom of helper bones, a nonparametric control mechanism for the helper bones, and a technique for estimating the optimal example data of skin deformations.

Academic Significance and Societal Importance of the Research Achievements

開発した一連の技術群は、オフライン向け映像コンテンツや蓄積されたデータ資産から実時間アプリケーション向けにデータを自動変換するシステムの実現を可能とする基盤技術である。これは、実時間CGアプリケーションにおけるキャラクタの存在感・実在感の向上につながるものであり、ひいてはVRやAR、次世代デジタルゲームのコンテンツ品質向上など、デジタル人体やデジタルクリーチャーを扱う様々な分野に寄与するものと考えている。

Report

(4 results)
  • 2020 Annual Research Report   Final Research Report ( PDF )
  • 2019 Research-status Report
  • 2018 Research-status Report
  • Research Products

    (11 results)

All 2020 2019 2018 Other

All Journal Article (1 results) (of which Peer Reviewed: 1 results) Presentation (8 results) (of which Int'l Joint Research: 1 results,  Invited: 1 results) Remarks (2 results)

  • [Journal Article] Sampling-based Rig Conversion into Non-rigid Helper Bones2018

    • Author(s)
      Tomohiko Mukai
    • Journal Title

      Proceedings of the ACM on Computer Graphics and Interactive Techniques

      Volume: 1 Issue: 1 Pages: 1-17

    • DOI

      10.1145/3203190

    • Related Report
      2018 Research-status Report
    • Peer Reviewed
  • [Presentation] Locality-Aware Skinning Decomposition Using Model-Dependent Mesh Clustering2020

    • Author(s)
      Fumiya Naria, Tomohiko Mukai
    • Organizer
      Computer Graphics International 2020
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 3次元SRT変換の例示ベース連動制御2020

    • Author(s)
      向井 智彦
    • Organizer
      Visual Computing 2020
    • Related Report
      2020 Annual Research Report
  • [Presentation] スケルトンジョイントの個別制御による顔形状バリエーション合成2020

    • Author(s)
      厳 亦斌, 向井 智彦
    • Organizer
      Visual Computing 2020
    • Related Report
      2020 Annual Research Report
  • [Presentation] 仮想人間との対話のための眼球運動の分析および合成2020

    • Author(s)
      胡 博文, 向井 智彦, 安藤 大地
    • Organizer
      Visual Computing 2020 ポスター
    • Related Report
      2020 Annual Research Report
  • [Presentation] フェイシャルアニメーションの非線形制御法の研究2019

    • Author(s)
      厳 亦斌, 向井 智彦, 安藤 大地
    • Organizer
      Visual Computing 2019 ポスター
    • Related Report
      2019 Research-status Report
  • [Presentation] Sampling-based Rig Conversion into Non-rigid Helper Bones2019

    • Author(s)
      向井智彦
    • Organizer
      Visual Computing 2019
    • Related Report
      2019 Research-status Report
    • Invited
  • [Presentation] 例示データに基づくスキニングウェイトと自由形状変形の最適化2019

    • Author(s)
      有泉静耶、向井智彦、熱田清明
    • Organizer
      情報処理学会第81回全国大会
    • Related Report
      2018 Research-status Report
  • [Presentation] フェイシャルアニメーションのための例示データからの制御点配置推定法の検討2019

    • Author(s)
      山名承太郎、向井智彦、向井信彦
    • Organizer
      映像表現・芸術科学フォーラム2019
    • Related Report
      2018 Research-status Report
  • [Remarks] Example-based Helper Bone Rigging

    • URL

      https://mukai-lab.org/projects/helper-bone-rigging/

    • Related Report
      2020 Annual Research Report 2019 Research-status Report
  • [Remarks] Sampling-based Rig Conversion

    • URL

      https://mukai-lab.org/publications/i3d2018/

    • Related Report
      2018 Research-status Report

URL: 

Published: 2018-04-23   Modified: 2022-01-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi