• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Deep reinforcement learning for generation of bipedal locomotion based on anatomical neuromusculoskeletal models and its anthropological applications.

Research Project

Project/Area Number 20H03331
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 45050:Physical anthropology-related
Research InstitutionThe University of Tokyo

Principal Investigator

Ogihara Naomichi  東京大学, 大学院理学系研究科(理学部), 教授 (70324605)

Co-Investigator(Kenkyū-buntansha) 伊藤 幸太  大阪大学, 大学院人間科学研究科, 助教 (20816540)
叶賀 卓  国立研究開発法人産業技術総合研究所, 情報・人間工学領域, 主任研究員 (40803903)
村井 昭彦  国立研究開発法人産業技術総合研究所, 情報・人間工学領域, 研究チーム長 (90637274)
Project Period (FY) 2020-04-01 – 2023-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥17,550,000 (Direct Cost: ¥13,500,000、Indirect Cost: ¥4,050,000)
Fiscal Year 2022: ¥4,810,000 (Direct Cost: ¥3,700,000、Indirect Cost: ¥1,110,000)
Fiscal Year 2021: ¥5,980,000 (Direct Cost: ¥4,600,000、Indirect Cost: ¥1,380,000)
Fiscal Year 2020: ¥6,760,000 (Direct Cost: ¥5,200,000、Indirect Cost: ¥1,560,000)
Keywords歩行シミュレーション / 深層強化学習 / 歩行生成 / 順動力学 / 足部モデル
Outline of Research at the Start

ヒトの精密3次元神経筋骨格モデルを構築し、深層強化学習を活用してヒトの実3次元歩行運動を相応の精度で再現できる二足歩行運動の動力学的シミュレーションを構築することを目的とする。そして計算機内に再現する歩行の神経筋骨格系全体の振る舞いを解析することを通して、ヒトの二足歩行運動の神経情報処理と、ヒトの身体構造に内在する歩行生成知能を構成論的に読み解くとともに、その人類学への応用、具体的には直立二足歩行の起源の解明、および加齢や疾患に伴う歩行障害の予測や介入法の確立、への応用可能性を示すことを目指す。

Outline of Final Research Achievements

In this study, we constructed a dynamic simulation of bipedal locomotion capable of reproducing human actual 3D walking movements by utilizing a human 3D neuromusculoskeletal model and deep reinforcement learning. The musculoskeletal model employed in this research consisted of a deep neural network that outputs 22 muscle activations from 97 sensory inputs. We attempted deep reinforcement learning for bipedal locomotion based on the Deep Deterministic Policy Gradient method. As a result, although issues remain, it became possible to generate bipedal locomotion.
Additionally, we successfully constructed an anatomically precise 3D finite element model of the human foot. By utilizing kinematic data during human bipedal locomotion, we reproduced skeletal dynamics of the foot during walking within a computational environment.

Academic Significance and Societal Importance of the Research Achievements

本研究の学術的・社会的意義は、ヒトの歩行生成メカニズムにかかわる様々な仮説を検証するプラットフォームの基礎を構築した点にある。具体的には、二足歩行の進化の道筋に構成論的に迫るための、「仮想進化シミュレーション」、高齢者における転倒リスクの増大メカニズムを検討する「仮想歩行障害シミュレーション」など歩行シミュレーションの実用化への道筋をつけた。

Report

(4 results)
  • 2023 Final Research Report ( PDF )
  • 2022 Annual Research Report
  • 2021 Annual Research Report
  • 2020 Annual Research Report
  • Research Products

    (26 results)

All 2024 2023 2022 2021

All Journal Article (8 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 8 results,  Open Access: 8 results) Presentation (16 results) (of which Int'l Joint Research: 5 results,  Invited: 5 results) Book (2 results)

  • [Journal Article] Direct visualization and measurement of the plantar aponeurosis behavior in foot arch deformation via the windlass mechanism2024

    • Author(s)
      Matsumoto Yuka、Ogihara Naomichi
    • Journal Title

      Clinical Anatomy

      Volume: 4 Issue: 2 Pages: 24171-24171

    • DOI

      10.1002/ca.24171

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Regulation of whole-body angular momentum during human walking2023

    • Author(s)
      Negishi Takuo、Ogihara Naomichi
    • Journal Title

      Scientific Reports

      Volume: 13 Issue: 1 Pages: 8000-8000

    • DOI

      10.1038/s41598-023-34910-5

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Functional significance of vertical free moment for generation of human bipedal walking2023

    • Author(s)
      Negishi Takuo、Ogihara Naomichi
    • Journal Title

      Scientific Reports

      Volume: 13 Issue: 1 Pages: 6894-6894

    • DOI

      10.1038/s41598-023-34153-4

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Quantification of the in vivo stiffness and natural length of the human plantar aponeurosis during quiet standing using ultrasound elastography2022

    • Author(s)
      Shuhei Nozaki, Ryuta Kinugasa, Katsutoshi Yaeshima, Takeshi Hashimoto, Masahiro Jinzaki & Naomichi Ogihara
    • Journal Title

      Scientific Reports

      Volume: 12 Issue: 1 Pages: 15707-15707

    • DOI

      10.1038/s41598-022-20211-w

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Novel multi-segment foot model incorporating plantar aponeurosis for detailed kinematic and kinetic analyses of the foot with application to gait studies2022

    • Author(s)
      Matsumoto, Y., Ogihara, N., Hanawa, H., Kokubun, T., Kanemura, N
    • Journal Title

      Frontiers in Bioengineering and Biotechnology

      Volume: 10 Pages: 894731-894731

    • DOI

      10.3389/fbioe.2022.894731

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Three-Dimensional Innate Mobility of the Human Foot on Coronally-Wedged Surfaces Using a Biplane X-Ray Fluoroscopy2022

    • Author(s)
      Negishi Takuo、Nozaki Shuhei、Ito Kohta、Seki Hiroyuki、Hosoda Koh、Nagura Takeo、Imanishi Nobuaki、Jinzaki Masahiro、Ogihara Naomichi
    • Journal Title

      Frontiers in Bioengineering and Biotechnology

      Volume: 10 Pages: 1-13

    • DOI

      10.3389/fbioe.2022.800572

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Comparative Functional Morphology of Human and Chimpanzee Feet Based on Three-Dimensional Finite Element Analysis2022

    • Author(s)
      Ito K, Nakamura T, Suzuki R, Negishi T, Oishi M, Nagura T, Jinzaki M, Ogihara N.
    • Journal Title

      Front Bioeng Biotechnol

      Volume: 9 Pages: 760486-760486

    • DOI

      10.3389/fbioe.2021.760486

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Comparative radiographic analysis of three-dimensional innate mobility of the foot bones under axial loading of humans and African great apes2021

    • Author(s)
      Negishi T, Ito K, Hosoda K, Nagura T, Ota T, Imanishi N, Jinzaki M, Oishi M, Ogihara N.
    • Journal Title

      R Soc Open Sci.

      Volume: 8 Issue: 11 Pages: 211344-211344

    • DOI

      10.1098/rsos.211344

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] Dynamic finite element simulation of 3D foot during stance phase of human walking2023

    • Author(s)
      Ito, K., Nagura, Y., Jinzaki,M., Ogihara, N.
    • Organizer
      12th Asian-Pacific Conference on Biomechanics
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Evaluation of the estimated length of the plantar aponeurosis using a multi-segment foot model2023

    • Author(s)
      Matsumoto, Y., Kanemura, N., Ogihara, N.
    • Organizer
      29th Congress of International Society of Biomechanics
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Differences in the kinematics and kinetics of the plantar aponeurosis between walking and running2023

    • Author(s)
      Matsumoto, Y., Kanemura, N., Ogihara, N.
    • Organizer
      8th Congress of International Foot and Ankle Biomechanics Society (i-FAB)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] マルチセグメントフットモデルに基づく運動中の足底腱膜伸縮量の推定とその評価2023

    • Author(s)
      松本 優佳、金村尚彦、荻原直道
    • Organizer
      第77回日本人類学会大会
    • Related Report
      2022 Annual Research Report
  • [Presentation] ヒト足部筋骨格構造の機械工学と整形外科学2023

    • Author(s)
      荻原直道
    • Organizer
      日本機械学会年次大会 公開ワークショップ「整形外科学と機械工学の連携推進にむけて」
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] ヒトの直立二足歩行の力学・制御・進化2023

    • Author(s)
      荻原直道
    • Organizer
      第19回姿勢と歩行研究会
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] Biomechanics, Motor Control, and Evolution of Human Bipedal Locomotion2022

    • Author(s)
      Ogihara, N.
    • Organizer
      Commemorative Symposium for the 37th International Prize for Biology "Human Origins and the Future of the Earth"
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Experimental and computational studies of bipedal locomotion in the Japanese macaque towards understanding the evolution of human bipedal locomotion2022

    • Author(s)
      Ogihara, N.
    • Organizer
      33rd International Symposium on Micro-NanoMechatronics and Human Science
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] デジタル人類学が解き明かすヒトの進化2022

    • Author(s)
      荻原直道
    • Organizer
      日本モンキーセンター・モンキーキャンパス
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] 二足歩行中に作用するVertical Free Momentが下肢関節の回旋運動に与える影響2022

    • Author(s)
      荻原直道、根岸拓生
    • Organizer
      第49回日本臨床バイオメカニクス学会
    • Related Report
      2022 Annual Research Report
  • [Presentation] 二足歩行中の足裏に床面から作用するvertical free moment の機能的意義2022

    • Author(s)
      根岸拓生、荻原直道
    • Organizer
      第76回日本人類学会大会・第38回日本霊長類学会大会連合大会
    • Related Report
      2022 Annual Research Report
  • [Presentation] 足裏に作用するvertical free momentがヒト二足歩行に与える影響2022

    • Author(s)
      根岸拓生、荻原直道
    • Organizer
      第40回日本ロボット学会学術講演会
    • Related Report
      2022 Annual Research Report
  • [Presentation] 内外側傾斜面がヒト足部の3次元骨格挙動に与える影響2021

    • Author(s)
      根岸拓生、野崎修平、伊藤幸太、関広幸、細田耕、名倉武雄、今西宣晶、陣崎雅弘、荻原直道
    • Organizer
      第75回日本人類学会大会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 幾何学的形態測定学を用いた大型類人猿における踵骨の3次元形態解析2021

    • Author(s)
      野崎修平、天野英輝、大石元治、荻原直道
    • Organizer
      第75回日本人類学会大会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 深層強化学習によるヒト3次元筋骨格モデルの静止立位制御2021

    • Author(s)
      土居明莉、山﨑皓之、叶賀卓、村井昭彦、荻原直道
    • Organizer
      第75回日本人類学会大会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 3次元有限要素モデルを用いた二足歩行中のヒト足部の生体力学的解析2021

    • Author(s)
      伊藤幸太、中村友哉、鈴木諒、根岸拓生、名倉武雄、陣崎雅弘、荻原直道
    • Organizer
      第75回日本人類学会大会
    • Related Report
      2021 Annual Research Report
  • [Book] 歩く:進化でわかる人間行動の事典 (小田亮、橋彌和秀、大坪庸介、平石界編)2021

    • Author(s)
      荻原直道
    • Total Pages
      320
    • Publisher
      朝倉書店
    • Related Report
      2021 Annual Research Report
  • [Book] ヒトはなぜ直立二足歩行を獲得したのか―身体構造と運動機能の進化:人間の本質にせまる科学 (井原泰雄、梅﨑昌裕、米田穣編)2021

    • Author(s)
      荻原直道
    • Total Pages
      296
    • Publisher
      東京大学出版会
    • Related Report
      2021 Annual Research Report

URL: 

Published: 2020-04-28   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi