• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Model-based Reinforcement Learning of Assistive Strategies for Physically-assistive Robots

Research Project

Project/Area Number 16H05876
Research Category

Grant-in-Aid for Young Scientists (A)

Allocation TypeSingle-year Grants
Research Field Intelligent robotics
Research InstitutionNara Institute of Science and Technology

Principal Investigator

MATSUBARA Takamitsu  奈良先端科学技術大学院大学, 研究推進機構, 特任准教授 (20508056)

Project Period (FY) 2016-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥18,590,000 (Direct Cost: ¥14,300,000、Indirect Cost: ¥4,290,000)
Fiscal Year 2018: ¥2,860,000 (Direct Cost: ¥2,200,000、Indirect Cost: ¥660,000)
Fiscal Year 2017: ¥5,330,000 (Direct Cost: ¥4,100,000、Indirect Cost: ¥1,230,000)
Fiscal Year 2016: ¥10,400,000 (Direct Cost: ¥8,000,000、Indirect Cost: ¥2,400,000)
Keywords支援ロボット / 強化学習 / ガウス過程 / ベイズ最適化 / エナジーハーベスター / 人支援ロボット / 物理接触 / モデルベース強化学習 / 機械学習 / 確率最適制御 / 物理支援ロボット / 支援戦略学習 / ガウス過程回帰 / 重複混合ガウス過程回帰 / 知能ロボティックス
Outline of Final Research Achievements

In this research, we aimed to develop model-based reinforcement learning of assistive strategies for physically-assistive robots with data obtained through physical human-robot interactions. With the key concept of "Learning a practical (sub)optimal strategy from a small amount of data", we developed sample-efficient and model-based reinforcement learning algorithms based on Gaussian processes. Then, we developed a safe-assistive device for a knee joint and conducted learning experiments of assistive strategies for physically-assistive robots with human subjects. The experimental results demonstrated the effectiveness of the proposed approach.

Academic Significance and Societal Importance of the Research Achievements

本研究では、人支援ロボットの支援戦略学習問題に対して、新しい思想に基づく技術開発を目指した結果、独創性と実用性を兼ね備えた強化学習アルゴリズムの開発に成功した。さらに、評価実験を実施するにあたり開発した膝関節支援デバイス自体も、モータの反トルクによる安全性の高い支援や、CVTの減速比調節によるユーザや状況への適応可能性など、高い学術的価値を持つ。本研究で得られた成果は、様々な人物理支援ロボットの支援戦略を被支援者にテイラーメイドに構築できる可能性を示唆しており、超高齢社会に有益な新しい産業・サービスの創出にも繋がるものと期待される。

Report

(4 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Annual Research Report
  • 2016 Annual Research Report
  • Research Products

    (9 results)

All 2018 2017

All Journal Article (1 results) (of which Peer Reviewed: 1 results,  Acknowledgement Compliant: 1 results) Presentation (8 results) (of which Int'l Joint Research: 5 results)

  • [Journal Article] Active Tactile Exploration with Uncertainty and Travel Cost for Fast Shape Estimation of Unknown Object2017

    • Author(s)
      Takamitsu Matsubara and Kotaro Shibata
    • Journal Title

      Robotics and Autonomous System

      Volume: 91 Pages: 314-326

    • DOI

      10.1016/j.robot.2017.01.014

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Presentation] Biomechanical Energy Harvester with Continuously Variable Transmission: Prototyping and Preliminary Evaluation2018

    • Author(s)
      Yutaro Ikawa, Taisuke Kobayashi, Takamitsu Matsubara
    • Organizer
      2018 IEEE/ASME International Conference on Advanced Intelligent Mechatronics
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Policy Transfer from Simulations to Real World by Transfer Component Analysis2018

    • Author(s)
      Takamitsu Matsubara, Yu Norinaga, Yuto Ozawa, Yunduan Cui
    • Organizer
      14th IEEE International Conference on Automation Science and Engineering (CASE2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Transferring Control Policies from Simulations to Real World by Transfer Component Analysis2018

    • Author(s)
      Takamitsu Matsubara, Yu. Norinaga, Yuto Ozawa, Yunduan Cui
    • Organizer
      SICE Annual Conference
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Variational Learning Approach for Sparse Gaussian Process Policy Search2018

    • Author(s)
      Hikaru Sasaki, Yuto Ozawa, Takamitsu Matsubara
    • Organizer
      SICE Annual Conference
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Biomechanical Energy Harvester with Continuously Variable Transmission: Prototyping and Preliminary Evaluation2018

    • Author(s)
      Yutaro Ikawa, Taisuke Kobayashi, Takamitsu Matsubara
    • Organizer
      2018 IEEE International Conference on Advanced Intelligent Mechatronics
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 多様な動作に適用可能な装具型エナジーハーベスタの試作2017

    • Author(s)
      井川 優太郎, 小林 泰介, 松原 崇充
    • Organizer
      第18回計測自動制御学会システムインテグレーション部門講演会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 見かけ上の誤差に頑健なシミュレーションから実環境への方策転移学習2017

    • Author(s)
      則永 悠, 小澤 裕斗, 松原 崇充
    • Organizer
      第18回計測自動制御学会システムインテグレーション部門講演会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 重複混合ガウス過程を用いた多峰性方策探索2017

    • Author(s)
      小澤裕斗, 松原崇充
    • Organizer
      平成29年度SICE関西支部・ISCIE 若手研究発表会
    • Related Report
      2017 Annual Research Report

URL: 

Published: 2016-04-21   Modified: 2020-03-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi