• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Natural and fun character action based on relevance / non-relevance with speech

Research Project

Project/Area Number 18K11602
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 62040:Entertainment and game informatics-related
Research InstitutionNiigata University (2020-2021)
Yamaguchi College of Arts (2018-2019)

Principal Investigator

Yamamoto Masanobu  新潟大学, 自然科学系, フェロー (00242397)

Project Period (FY) 2018-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥2,730,000 (Direct Cost: ¥2,100,000、Indirect Cost: ¥630,000)
Fiscal Year 2020: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2019: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2018: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Keywordsキャラクタアニメーション / 発話と動作 / モーションキャプチャ / 3Dアニメーション / コンピュータアニメーション / 動作生成 / アニメキャラクタ
Outline of Final Research Achievements

We considered the strength of the connection between action and reaction and the strength of the connection between speeches and movements towards a new production method of animation. First, if the action and reaction are strongly connected, the movements must be strongly related to the speeches. On the other hand, if the connection between action and reaction weak due to the content of the dialogue, actions unrelated to the speeches are better. The familiar movement tends to be favored among unrelated movements. In addition, people who perform actions unrelated to speech contents are often psychologically strong to the other person. Based on these ideas, we created an animation that switches between action related to speech and action unrelated to speech in the scenario. In order to enhance the motion database, we developed and evaluated a motion capture with pan / zoom function.

Academic Significance and Societal Importance of the Research Achievements

これまで、アニメキャラクタの動作は台詞と連動させて作られてきた。発話と動作との関連性を学習すれば、台詞から動作の自動生成が可能である。しかし、その動作は多くの動作が平均化された動作であり面白味に欠けていた。一方、演劇では、台詞と無関係で意味のない動きを俳優にさせることにより、発話の不自然さは消え、演技に面白さが生じている。本研究では、この演劇の新たな潮流をいち早くアニメの制作に取り入れたものである。この制作法には動作データベースの充実が欠かせない。カメラのパン・ズーム機能を伴ったモーションキャプチャを開発し、舞台や体育館などのような広い範囲で動き回る身体の動作測定に成功した。

Report

(5 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Research-status Report
  • 2019 Research-status Report
  • 2018 Research-status Report
  • Research Products

    (10 results)

All 2022 2021 2020 2019 2018 Other

All Journal Article (2 results) (of which Peer Reviewed: 2 results,  Open Access: 2 results) Presentation (5 results) (of which Int'l Joint Research: 2 results,  Invited: 1 results) Book (2 results) Remarks (1 results)

  • [Journal Article] Pan-zoom Motion Capture in Wide Scenes using Panoramic Background2022

    • Author(s)
      Masanobu Yamamoto
    • Journal Title

      Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022)

      Volume: 1 Pages: 163-171

    • DOI

      10.5220/0010815600003124

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Capturing Floor Exercise from Multiple Panning-Zooming Cameras2018

    • Author(s)
      Kobayashi, Daisuke. and Yamamoto, Masanobu
    • Journal Title

      Eurographics/ ACM SIGGRAPH Symposium on Computer Animation - Posters

      Volume: 1 Pages: 1-2

    • DOI

      10.2312/SCA.20181183

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access
  • [Presentation] 台詞に関連する動作と関連しない動作との切り替えによるリアルなアニメの制作法2021

    • Author(s)
      山本正信
    • Organizer
      映像情報メディア学会2021年冬季大会
    • Related Report
      2021 Annual Research Report
  • [Presentation] アニメ制作における台詞に相応しい動作の選択2021

    • Author(s)
      山本正信
    • Organizer
      2021年電子情報通信学会総合大会
    • Related Report
      2020 Research-status Report
  • [Presentation] アニメ制作における台詞と動作の関連性2020

    • Author(s)
      山本正信、鈴木涼平
    • Organizer
      2020年電子情報通信学会総合大会
    • Related Report
      2019 Research-status Report
  • [Presentation] Motion Capture System Towards Big Data Collection of Craftmanship2019

    • Author(s)
      Masanobu Yamamoto, Yuki Miura, Tetsushi Ohsawa
    • Organizer
      2019 IEEE 5th International Conference on Big Data Intelligence and Computing
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Video-based Motion Capture and Computer Animation2019

    • Author(s)
      Yamamoto, Masanobu
    • Organizer
      2019 International Conference for Leading and Young Computer Scientists
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research / Invited
  • [Book] 3D Model-Based Video Motion Capture System. In: Thomas S. Clary (eds) Horizon in Computer Science Research Vol.202021

    • Author(s)
      Masanobu Yamamoto
    • Total Pages
      26
    • Publisher
      Nova science publishers
    • ISBN
      9781536191073
    • Related Report
      2020 Research-status Report
  • [Book] Ego-Motion and EPI Analysis. In: Ikeuchi K. (eds) Computer Vision.2020

    • Author(s)
      Masanobu Yamamoto
    • Total Pages
      9
    • Publisher
      Springer, Cham
    • ISBN
      9783030032432
    • Related Report
      2019 Research-status Report
  • [Remarks] 本学教授が国際会議で受賞

    • URL

      http://www.yamaguchi-jca.ac.jp/artreport/archives/2019/03/post_86.html

    • Related Report
      2018 Research-status Report

URL: 

Published: 2018-04-23   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi