• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of an automatic generation method for optimal animation using sound sources as input

Research Project

Project/Area Number 18K18173
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 62040:Entertainment and game informatics-related
Research InstitutionToyo University

Principal Investigator

Ishikawa Tomokazu  東洋大学, 情報連携学部, 准教授 (30635545)

Project Period (FY) 2018-04-01 – 2021-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2020: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2019: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Fiscal Year 2018: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Keywordsコンピュータグラフィックス / 最適化 / シミュレーション / アニメーション / クロスモーダル / CG / 効果音 / アニメーション制作 / 物理現象 / パラメータ推定
Outline of Final Research Achievements

The purpose of this study was to output CG animations suitable for sound sources.
We implemented a tool to digitally reproduce the work that is currently done in analog when creating a specific animation, and conducted an experiment to confirm the necessary parameters by having the user actually use our tool. In another scene, we confirmed whether it was possible to create a middle segment as specified by a key frame by optimizing the initial parameters.
A questionnaire survey was conducted to find out whether it is possible to associate the features obtained from the video with the features of the music obtained from the background music and these impression words, and to find out the combination of video and background music that people find optimal. Using this data, we proposed a system to search for suitable background music for video.

Academic Significance and Societal Importance of the Research Achievements

デジタルアニメーションではアーティストのユーザビリティの観点からもいくつかのパラメータによって再現することが求められている。本研究では限定的なシーンではあるが,そのパラメータを特定することと,その最適化によってアニメーションを作成することが有効であることを確認した。
また,本研究ではアンケート調査により人が音から受ける印象を感性語によって動画・音楽特徴量と関連付けることで,CG分野の制作工程に寄与するだけでなく,VRの分野においてもクロスモーダルの観点から人が耳から受ける刺激と映像のマッチングについて貢献できると考えている。

Report

(4 results)
  • 2020 Annual Research Report   Final Research Report ( PDF )
  • 2019 Research-status Report
  • 2018 Research-status Report
  • Research Products

    (15 results)

All 2021 2019 2018

All Journal Article (1 results) (of which Peer Reviewed: 1 results,  Open Access: 1 results) Presentation (14 results) (of which Int'l Joint Research: 6 results)

  • [Journal Article] Rust Simulation Based on Chemical Reaction Processes2018

    • Author(s)
      Tomokazu ISHIKAWA, Yusuke KAMEDA , Masanori KAKIMOTO, Ichiro MATSUDA, Susumu ITOH
    • Journal Title

      IIEEJ Transactions on Image Electronics and Visual Computing

      Volume: 6(2) Pages: 82-88

    • NAID

      130007752814

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access
  • [Presentation] HoloLens2を用いた料理時における情報提示方法の検討2021

    • Author(s)
      手塚建貴, 石川知一
    • Organizer
      映像表現・芸術科学フォーラム2021
    • Related Report
      2020 Annual Research Report
  • [Presentation] 超解像処理を用いたレンダリング高速化についての一検討2021

    • Author(s)
      倉田大樹, 石川知一
    • Organizer
      映像表現・芸術科学フォーラム2021
    • Related Report
      2020 Annual Research Report
  • [Presentation] 動画を入力としたBGM検索システムについての研究2021

    • Author(s)
      杉本一就, 石川知一
    • Organizer
      映像表現・芸術科学フォーラム2021
    • Related Report
      2020 Annual Research Report
  • [Presentation] VR技術を用いたTRPGのゲーム性についての研究2021

    • Author(s)
      石井 建, 石川知一
    • Organizer
      映像表現・芸術科学フォーラム2021
    • Related Report
      2020 Annual Research Report
  • [Presentation] お絵描きプロジェクションマッピングについての研究2021

    • Author(s)
      一重元希, 石川知一
    • Organizer
      映像表現・芸術科学フォーラム2021
    • Related Report
      2020 Annual Research Report
  • [Presentation] Procedural animation of aurora and its optimization for keyframe animation2019

    • Author(s)
      Tomokazu Ishikawa, Ryota Nakazato, Ichiro Matsuda
    • Organizer
      2019 International Symposium on Computer Graphics, Multimedia and Image Processing
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Method to Create Fluttering Hair Animations That Can Reproduce Animator's Techniques2019

    • Author(s)
      Naoaki Kataoka, Tomokazu Ishikawa, Ichiro Matsuda
    • Organizer
      SIGGRAPH Asia 2019 Posters
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Discrimination of drawing collapse for animated characters by SVM2019

    • Author(s)
      Jun Sakurai, Tomokazu Ishikawa, Yusuke Kameda, Ichiro Matsuda, Susumu Itoh
    • Organizer
      Proc. SPIE, The 22nd International Workshop on Advanced Image Technology (IWAIT 2019)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Procedural animation of waving cartoon hair by emulating animator's techniques2019

    • Author(s)
      Naoaki Kataoka, Tomokazu Ishikawa, Yusuke Kameda, Ichiro Matsuda, Susumu Itoh
    • Organizer
      Proc. SPIE, The 22nd International Workshop on Advanced Image Technology (IWAIT 2019)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Energy-Brushes: Interactive Tools for Illustrating Stylized Elemental Dynamicsの実装2018

    • Author(s)
      石川知一
    • Organizer
      情報処理学会 コンピュータグラフィックスとビジュアル情報学研究会(IPSJ CGVI)研究会
    • Related Report
      2018 Research-status Report
  • [Presentation] アニメータ技法に基づく髪のなびきのデジタル再現2018

    • Author(s)
      片岡直映,石川知一,亀田裕介,松田一朗,伊東晋
    • Organizer
      Visual Computing 2018
    • Related Report
      2018 Research-status Report
  • [Presentation] SVMによるアニメキャラクタの顔に対する作画崩壊の判別2018

    • Author(s)
      櫻井惇,石川知一,亀田裕介,松田一朗,伊東晋
    • Organizer
      Visual Computing 2018
    • Related Report
      2018 Research-status Report
  • [Presentation] Digital Reproduction of Hair Waving Based on Animator Technique2018

    • Author(s)
      Naoaki Kataoka, Tomokazu Ishikawa, Yusuke Kameda, Ichiro Matsuda, Susumu Itoh
    • Organizer
      SIGGRAPH Asia 2018 Posters
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Lossless Image Coding Method Based on Probability Model Optimization2018

    • Author(s)
      Ichiro Matsuda, Tomokazu Ishikawa, Yusuke Kameda, Susumu Itoh
    • Organizer
      Proceedings of the 26th European Signal Processing Conference (EUSIPCO-2018)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2018-04-23   Modified: 2022-01-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi