• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Manifestation of various adaptive motions by learning independent of environmental or oscillator models

Research Project

Project/Area Number 18H01399
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 20020:Robotics and intelligent system-related
Research InstitutionTohoku University

Principal Investigator

Hayashibe Mitsuhiro  東北大学, 工学研究科, 教授 (40338934)

Co-Investigator(Kenkyū-buntansha) 大脇 大  東北大学, 工学研究科, 准教授 (40551908)
Project Period (FY) 2018-04-01 – 2021-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥16,380,000 (Direct Cost: ¥12,600,000、Indirect Cost: ¥3,780,000)
Fiscal Year 2020: ¥2,600,000 (Direct Cost: ¥2,000,000、Indirect Cost: ¥600,000)
Fiscal Year 2019: ¥4,550,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥1,050,000)
Fiscal Year 2018: ¥9,230,000 (Direct Cost: ¥7,100,000、Indirect Cost: ¥2,130,000)
Keywords深層学習 / 運動学習 / 運動シナジー / バランス制御 / 筋電位 / 環境適応 / 歩行 / 姿勢制御 / 運動計測 / 運動適応 / 歩行制御
Outline of Final Research Achievements

To elucidate the mechanism in environmental model-independent adaptive learning, the mechanism of motion pattern generation was investigated in detail using model-free deep reinforcement learning. Although mathematical optimization calculations require a mathematical model of the environment and the body a priori, none have been treated so far as motor learning in an unknown physical environment. We investigated for potential computational guidelines in multi-joint gait. We examined the level of emergence of motor synergy in walking movements that changed as learning progressed and found that the synergy emergence was highly correlated with the performance per energy. It implies that motor synergy is employed as a necessary condition for improving performance per energy.

Academic Significance and Societal Importance of the Research Achievements

深層強化学習による運動学習タスクにおいて運動シナジーの発現プロセスが起きており、それがエネルギー当たりのパフォーマンスと高い相関を示したことは、何故人間や生物が運動シナジーを活用しているのかという問いの答えにつながるため科学的な意義が高いと考えられる。工学的な応用としては現在の深層学習は膨大な計算コストを要するが、効率的な運動学習における潜在的な方策として運動シナジーを用いることができたら大幅な計算の効率化につなげることができるため、本研究は新しい深層強化運動学習アルゴリズムに向けて示唆に富む情報となることが期待される。

Report

(4 results)
  • 2021 Final Research Report ( PDF )
  • 2020 Annual Research Report
  • 2019 Annual Research Report
  • 2018 Annual Research Report
  • Research Products

    (50 results)

All 2021 2020 2019 2018 Other

All Int'l Joint Research (1 results) Journal Article (14 results) (of which Int'l Joint Research: 8 results,  Peer Reviewed: 14 results,  Open Access: 6 results) Presentation (33 results) (of which Int'l Joint Research: 10 results) Remarks (2 results)

  • [Int'l Joint Research] CNRS(フランス国立科学研究所)/LIRMM(フランス)

    • Related Report
      2020 Annual Research Report
  • [Journal Article] Reproducing Human Arm Strategy and Its Contribution to Balance Recovery Through Model Predictive Control2021

    • Author(s)
      Shen Keli、Chemori Ahmed、Hayashibe Mitsuhiro
    • Journal Title

      Frontiers in Neurorobotics

      Volume: 15 Pages: 679570-679570

    • DOI

      10.3389/fnbot.2021.679570

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Balance Stability Augmentation for Wheel-Legged Biped Robot Through Arm Acceleration Control2021

    • Author(s)
      Raza Fahad、Zhu Wei、Hayashibe Mitsuhiro
    • Journal Title

      IEEE Access

      Volume: 9 Pages: 54022-54031

    • DOI

      10.1109/access.2021.3071055

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] An extended statically equivalent serial chain -Identification of whole body center of mass with dynamic motion2021

    • Author(s)
      Gonzalez A.、Fraisse P.、Hayashibe M.
    • Journal Title

      Gait & Posture

      Volume: 84 Pages: 45-51

    • DOI

      10.1016/j.gaitpost.2020.11.021

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Muscle Fatigue Induced Hand Tremor Clustering in Dynamic Laparoscopic Manipulation2020

    • Author(s)
      Chandra Sourav、Hayashibe Mitsuhiro、Thondiyath Asokan
    • Journal Title

      IEEE Transactions on Systems, Man, and Cybernetics: Systems

      Volume: 50 Issue: 12 Pages: 5420-5431

    • DOI

      10.1109/tsmc.2018.2882957

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Quantitative Gait Assessment with Feature-Rich Diversity Using Two IMU Sensors2020

    • Author(s)
      Yonatan Hutabarat, Dai Owaki, Mitsuhiro Hayashibe
    • Journal Title

      IEEE Transactions on Medical Robotics and Bionics

      Volume: 2 Issue: 4 Pages: 639-648

    • DOI

      10.1109/tmrb.2020.3021132

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Human-like Balance Recovery Based on Numerical Model Predictive Control Strategy2020

    • Author(s)
      Shen Keli、Chemori Ahmed、Hayashibe Mitsuhiro
    • Journal Title

      IEEE Access

      Volume: 8 Pages: 92050-92060

    • DOI

      10.1109/access.2020.2995104

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Reinforcement Q-Learning Control With Reward Shaping Function for Swing Phase Control in a Semi-active Prosthetic Knee2020

    • Author(s)
      Hutabarat Yonatan、Ekkachai Kittipong、Hayashibe Mitsuhiro、Kongprawechnon Waree
    • Journal Title

      Frontiers in Neurorobotics

      Volume: 14 Pages: 565702-565702

    • DOI

      10.3389/fnbot.2020.565702

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Motor Synergy Development in High-Performing Deep Reinforcement Learning Algorithms2020

    • Author(s)
      Chai Jiazheng、Hayashibe Mitsuhiro
    • Journal Title

      IEEE Robotics and Automation Letters

      Volume: 5 Issue: 2 Pages: 1271-1278

    • DOI

      10.1109/lra.2020.2968067

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Discovering Interpretable Dynamics by Sparsity Promotion on Energy and the Lagrangian2020

    • Author(s)
      Chu Hoang K.、Hayashibe Mitsuhiro
    • Journal Title

      IEEE Robotics and Automation Letters

      Volume: 5 Issue: 2 Pages: 2154-2160

    • DOI

      10.1109/lra.2020.2970626

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Identification of Time-Varying and Time-Scalable Synergies From Continuous Electromyographic Patterns2019

    • Author(s)
      Ramos Felipe Moreira、d'Avella Andrea、Hayashibe Mitsuhiro
    • Journal Title

      IEEE Robotics and Automation Letters

      Volume: 4 Issue: 3 Pages: 3053-3058

    • DOI

      10.1109/lra.2019.2924854

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Augmenting Motor Imagery Learning for Brain-Computer Interfacing Using Electrical Stimulation as Feedback2019

    • Author(s)
      Bhattacharyya Saugat、Clerc Maureen、Hayashibe Mitsuhiro
    • Journal Title

      IEEE Transactions on Medical Robotics and Bionics

      Volume: 1 Issue: 4 Pages: 247-255

    • DOI

      10.1109/tmrb.2019.2949854

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Restoring prolonged standing via functional electrical stimulation after spinal cord injury: A systematic review of control strategies2019

    • Author(s)
      Ibitoye Morufu Olusola、Hamzaid Nur Azah、Hayashibe Mitsuhiro、Hasnan Nazirah、Davis Glen M.
    • Journal Title

      Biomedical Signal Processing and Control

      Volume: 49 Pages: 34-47

    • DOI

      10.1016/j.bspc.2018.11.006

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Generation of Human-Like Movement from Symbolized Information2018

    • Author(s)
      Okajima Shotaro、Tournier Maxime、Alnajjar Fady S.、Hayashibe Mitsuhiro、Hasegawa Yasuhisa、Shimoda Shingo
    • Journal Title

      Frontiers in Neurorobotics

      Volume: 12

    • DOI

      10.3389/fnbot.2018.00043

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Synergetic Learning Control Paradigm for Redundant Robot to Enhance Error-Energy Index2018

    • Author(s)
      Hayashibe Mitsuhiro、Shimoda Shingo
    • Journal Title

      IEEE Transactions on Cognitive and Developmental Systems

      Volume: 10 Issue: 3 Pages: 573-584

    • DOI

      10.1109/tcds.2017.2697904

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] 時系列解析手法を用いた結合振動子系の同期ダイナミクス予測の評価2021

    • Author(s)
      高柳峻也, 沓澤京, 大脇大, 林部充宏
    • Organizer
      第22回計測自動制御学会SI部門講演会
    • Related Report
      2020 Annual Research Report
  • [Presentation] 深層強化学習を用いた準受動歩行および走行の実現2021

    • Author(s)
      古関駿介, 沓澤京, 大脇大, 林部充宏
    • Organizer
      計測自動制御学会 東北支部 第334回研究集会
    • Related Report
      2020 Annual Research Report
  • [Presentation] スパイキングニューラルネットワークに基づく深層強化学習による脚ロボットの歩行生成と評価2021

    • Author(s)
      納谷克海, 沓澤京, 大脇大, 林部充宏
    • Organizer
      計測自動制御学会 東北支部 第332回研究集会
    • Related Report
      2020 Annual Research Report
  • [Presentation] ゲーム環境下における重心情報を用いた運動機能の多角的評価2021

    • Author(s)
      小嶋萌子, 沓澤京, 大脇大, 林部充宏
    • Organizer
      第22回計測自動制御学会SI部門講演会
    • Related Report
      2020 Annual Research Report
  • [Presentation] パイキングニューラルネットワークに基づく深層強化学習による脚ロボットの歩行生成と耐故障性評価2021

    • Author(s)
      納谷克海, 沓澤京, 大脇大, 林部充宏
    • Organizer
      第22回計測自動制御学会SI部門講演会
    • Related Report
      2020 Annual Research Report
  • [Presentation] センサの移動を許容する複数深度カメラの人体骨格モデルの運動情報統合2021

    • Author(s)
      古畑和樹, 沓澤京, 大脇大, 林部充宏
    • Organizer
      第22回計測自動制御学会SI部門講演会
    • Related Report
      2020 Annual Research Report
  • [Presentation] Towards Robust Wheel-Legged Biped Robot System: Combining Feedforward and Feedback Control2021

    • Author(s)
      F. Raza, M. Hayashibe
    • Organizer
      IEEE/SICE International Symposium on System Integration(SII2021)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Seamless Temporal Gait Evaluation during Walking and Running Using Two IMU Sensors2021

    • Author(s)
      Y. Hutabarat, D. Owaki, M. Hayashibe
    • Organizer
      43rd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Simultaneous Quantification of Personalized Balance, Motion Class and Quality for Whole-body Exercise through Synergy Probe2021

    • Author(s)
      Felipe M. Ramos, M. Kojima, M. Hayashibe
    • Organizer
      43rd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Simultaneous On-line Motion Discrimination and Evaluation of Whole-body Exercise by Synergy Probes for Home Rehabilitation2020

    • Author(s)
      Felipe M. Ramos, M. Hayashibe
    • Organizer
      IEEE Int. Conf. on Robotics and Automation(ICRA2020)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Modeling and Control of a Hybrid Wheeled Legged Robot: Disturbance Analysis2020

    • Author(s)
      F. Raza, D. Owaki, M. Hayashibe
    • Organizer
      IEEE/ASME International Conference on Advanced Intelligent Mechatronics
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Personalized Balance and Fall Risk Visualization with Kinect Two2020

    • Author(s)
      M. Hayashibe, A. Gonzalez, M. Tournier
    • Organizer
      42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Development of a Rimless Wheeled Robot That Enables Adaptive and Energy-efficient Locomotion2020

    • Author(s)
      J. Han, J. Chai, D. Owaki, M. Hayashibe
    • Organizer
      ロボティクス・メカトロニクス講演会(ROBOMECH2020)
    • Related Report
      2020 Annual Research Report
  • [Presentation] EMG-based Estimation of Knee Torque and Angle using Recurrent Neural Network2020

    • Author(s)
      M. Truong, S. Sakamoto, D. Owaki, M. Hayashibe
    • Organizer
      ロボティクス・メカトロニクス講演会(ROBOMECH2020)
    • Related Report
      2020 Annual Research Report
  • [Presentation] Forearm Motion Estimation with Residual Shoulder Motion using Kinematic Synergies and Recurrent Neural Network2020

    • Author(s)
      M.H. Ahmed, S. Shimoda, H. Hirata, M. Hayashibe
    • Organizer
      ロボティクス・メカトロニクス講演会(ROBOMECH2020)
    • Related Report
      2020 Annual Research Report
  • [Presentation] Effectiveness Evaluation of Arm Usage for Human Quiet Standing Balance Recovery through Nonlinear Model Predictive Control2020

    • Author(s)
      K. Shen, A. Chemori, M. Hayashibe
    • Organizer
      International Conference on Control and Robots
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 再帰型ニューラルネットワークを用いた筋電位および慣性センサによる床反力推定2020

    • Author(s)
      坂本 誠一,大脇 大,林部 充宏
    • Organizer
      日本機械学会東北支部 第55期総会・講演会
    • Related Report
      2020 Annual Research Report
  • [Presentation] 重心角運動量に基づく不安定性推定による身体バランス機能の自動評価2020

    • Author(s)
      小嶋萌子, 大脇 大, 林部 充宏
    • Organizer
      ロボティクス・メカトロニクス講演会(ROBOMECH2020)
    • Related Report
      2020 Annual Research Report
  • [Presentation] 骨盤運動を有する準受動歩行の安定化に関する一考察2020

    • Author(s)
      門山 尚貴,大脇 大,林部 充宏
    • Organizer
      第38回日本ロボット学会学術講演会
    • Related Report
      2020 Annual Research Report
  • [Presentation] サイクリング運動の速度・負荷変化に対する筋シナジー適応解析2020

    • Author(s)
      猪股 映史,Felipe M. Ramos,沓澤 京、大脇 大,林部 充宏
    • Organizer
      第38回日本ロボット学会学術講演会
    • Related Report
      2020 Annual Research Report
  • [Presentation] 反復学習制御によるFiber-Reinforced Soft Actuatorの個体差補償2020

    • Author(s)
      杉山拓,沓澤 京、大脇 大,林部 充宏
    • Organizer
      第38回日本ロボット学会学術講演会
    • Related Report
      2020 Annual Research Report
  • [Presentation] 深層強化学習を用いたばね付き準受動歩行モデルにおける歩容生成2020

    • Author(s)
      清水寛子,沓澤 京、大脇 大,林部 充宏
    • Organizer
      第21回計測自動制御学会SI部門講演会
    • Related Report
      2020 Annual Research Report
  • [Presentation] Online Prediction of the Synchronization Dynamics generated by Coupled Oscillator System2019

    • Author(s)
      S. Takayanagi, D. Owaki, M. Hayashibe
    • Organizer
      Proc. of 9th Int. Symposium on Adaptive Motion of Animals and Mechanics
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Energy Efficiency Analysis of the Tegotae Approach for Bio-inspired Hopping2019

    • Author(s)
      R. Zamboni, D. Owaki, M. Hayashibe
    • Organizer
      9th Int. Symposium on Adaptive Motion of Animals and Mechanics
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 再帰型ニューラルネットワークを用いた手指運動の判別と評価2019

    • Author(s)
      山川 友希,大脇 大,林部 充宏
    • Organizer
      計測自動制御学会 東北支部 第322回研究集会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 実世界における結合振動子系同期ダイナミクスのオンライン予測2019

    • Author(s)
      高柳 峻也,大脇 大,林部 充宏
    • Organizer
      ロボティクス・メカトロニクス講演会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 再帰型ニューラルネットワークを用いた筋電位による床反力推定2019

    • Author(s)
      坂本 誠一,大脇 大,林部 充宏
    • Organizer
      ロボティクス・メカトロニクス講演会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 再帰型ニューラルネットワークを用いた手指動作の自動判別と評価2019

    • Author(s)
      山川 友希,大脇 大,林部 充宏
    • Organizer
      第37回日本ロボット学会学術講演会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 腰運動へのエネルギ―補填を介した準受動歩行の検討2019

    • Author(s)
      門山 尚貴,大脇 大,林部 充宏
    • Organizer
      第37回日本ロボット学会学術講演会
    • Related Report
      2019 Annual Research Report
  • [Presentation] フィードバック誤差学習から着想を得た力制御手法におけるエネルギ効率の評価2019

    • Author(s)
      浜田 淳司,Jiazheng Chai,大脇 大,林部 充宏
    • Organizer
      第37回日本ロボット学会学術講演会
    • Related Report
      2019 Annual Research Report
  • [Presentation] サイクリング速度による筋シナジー遷移解析2019

    • Author(s)
      猪股 映史,Felipe M. Ramos,大脇 大,林部 充宏
    • Organizer
      計測自動制御学会 東北支部 第327回研究集会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 結合振動子系を模したメトロノーム群の同期ダイナミクス予測2019

    • Author(s)
      高柳 峻也,大脇 大,林部 充宏
    • Organizer
      計測自動制御学会 東北支部 第321回研究集会
    • Related Report
      2018 Annual Research Report
  • [Presentation] Immersive Virtual Reality Feedback in a Brain Computer Interface for Upper Limb Rehabilitation2018

    • Author(s)
      D. Achanccaray, K. Pacheco, E. Carranza, M. Hayashibe
    • Organizer
      The 2018 IEEE International Conference on Systems, Man, and Cybernetics
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Remarks] Neuro-Robotics Lab

    • URL

      http://neuro.mech.tohoku.ac.jp/

    • Related Report
      2020 Annual Research Report
  • [Remarks] Neuro-Robotics Lab, Tohoku University

    • URL

      http://neuro.mech.tohoku.ac.jp/

    • Related Report
      2019 Annual Research Report 2018 Annual Research Report

URL: 

Published: 2018-04-23   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi