• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Elucidation of the adaptive mechanism of intricate human motion imitated by deep reinforcement learning

Research Project

Project/Area Number 22K20519
Research Category

Grant-in-Aid for Research Activity Start-up

Allocation TypeMulti-year Fund
Review Section 0403:Biomedical engineering and related fields
Research InstitutionNational Institute of Advanced Industrial Science and Technology

Principal Investigator

Shen Keli  国立研究開発法人産業技術総合研究所, 情報・人間工学領域, 産総研特別研究員 (80965179)

Project Period (FY) 2022-08-31 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥2,340,000 (Direct Cost: ¥1,800,000、Indirect Cost: ¥540,000)
Fiscal Year 2023: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2022: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
KeywordsDance adpative skills / Motor coordination / Sports biomechanics / Beat detection / Complexity analysis / Deep RL / Computational modeling / Beat-aligned synergies / TD-PCA / Motion complexity / Motor synergy / Motor injury prevention / Latent behavior / Adaptive motor skills / Dance motion Imitation / DRL / Motor Synergy
Outline of Research at the Start

In this project, advanced model-free DRL methods will be applied to reproduce natural street dance motions in AIST Dance DB, combining some efficient tricks for robustness improvement, and the adaptive dance motor skills will be analyzed.

Outline of Final Research Achievements

We developed a TD-PCA approach to extract beat-aligned motor synergies from street dance datasets, leveraging the first synergy to improve kinematic beat detection and enable accurate beat alignment with music. The enhancement was verified through cross-validation. We simulated deep reinforcement learning models reproducing dance skills, analyzing them kinematically/kinetically, demonstrating our methods' effectiveness for studying AI- generated dance movements.

Academic Significance and Societal Importance of the Research Achievements

我々の計算フレームワークは、複雑なダンスモーションを分析し、ダンスジャンルの運動メカニズムを理解し、動きのダイナミクスと音楽の関係についての洞察を提供し、ダンス研究、パフォーマンス分析、トレーニング、怪我の予防に応用できる。

Report

(3 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Research-status Report
  • Research Products

    (4 results)

All 2023 2022

All Presentation (4 results) (of which Int'l Joint Research: 3 results)

  • [Presentation] Break Dance Motion Analysis Through Motor Synergy2023

    • Author(s)
      Keli Shen, Jun-ichiro Hirayama
    • Organizer
      ISB-JSB 2023, Fukuoka, Japan
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Kinematic Motor Synergy Analysis to Understand Lock Dance Choreographies2023

    • Author(s)
      Keli Shen, Jun-ichiro Hirayama
    • Organizer
      45th Annual International Conference of the IEEE Engineering in Medicine & Biology Conference (EMBC), Sydney, Australia
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Kinematic Analysis of Pop Dance Choreographies Through Modular Motor Synergy2023

    • Author(s)
      Keli Shen, Jun-ichiro Hirayama
    • Organizer
      41st Conference of the International Society of Biomechanics in Sports (ISBS), Milwaukee, USA
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Understanding Complex Dance Motions Through Kinematic Motor Synergy2022

    • Author(s)
      Keli Shen, Jun-ichiro Hirayama
    • Organizer
      40th Annual Conference on Robotics Society of Japan, Tokyo, Japan
    • Related Report
      2022 Research-status Report

URL: 

Published: 2022-09-01   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi