• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A new solution method for nonlinear stochastic optimal control based on stochastic analysis and statistical mechanics and its application to learning control

Research Project

Project/Area Number 24760338
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeMulti-year Fund
Research Field Control engineering
Research InstitutionHiroshima University

Principal Investigator

SATOH Satoshi  広島大学, 工学(系)研究科(研究院), 助教 (60533643)

Project Period (FY) 2012-04-01 – 2015-03-31
Project Status Completed (Fiscal Year 2014)
Budget Amount *help
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2014: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2013: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2012: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Keywords非線形制御 / 確率制御 / 最適制御
Outline of Final Research Achievements

We have developed a new iterative solution method for nonlinear stochastic optimal control problems based on stochastic analysis and statistical mechanics. We have also clarified conditions for convergence of a sequence of iterative solutions. This method enables us to obtain an optimal feedback control input for a nonlinear stochastic optimal control problem for which a sufficient solution has not been provided so far.
Then, we have proposed a stochastic approximate solution to a deterministic optimal control problem. In this method, a sub-optimal feedback control input is obtained by iteration of laboratory experiments as the covariance of an artificially added noise tends to zero. Finally, we have performed experimental verification of the proposed methods with a robot manipulator.

Report

(4 results)
  • 2014 Annual Research Report   Final Research Report ( PDF )
  • 2013 Research-status Report
  • 2012 Research-status Report
  • Research Products

    (47 results)

All 2015 2014 2013 2012 Other

All Journal Article (12 results) (of which Peer Reviewed: 12 results,  Acknowledgement Compliant: 1 results) Presentation (29 results) (of which Invited: 1 results) Remarks (6 results)

  • [Journal Article] Bounded stability of nonlinear stochastic systems2015

    • Author(s)
      S. Satoh and M. Saeki
    • Journal Title

      SICE Journal of Control, Measurement, and System Integration

      Volume: 8 Issue: 2 Pages: 181-187

    • DOI

      10.9746/jcmsi.8.181

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] 視覚運動オブザーバの確率的推定性能解析2014

    • Author(s)
      山内淳矢・佐藤訓志・畑中健志・藤田政之
    • Journal Title

      システム制御情報学会論文誌

      Volume: 27 Pages: 443-451

    • NAID

      130005130285

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Bounded stabilization of stochastic port-Hamiltonian systems2014

    • Author(s)
      S. Satoh and M. Saeki
    • Journal Title

      International Journal of Control new!

      Volume: 未定 Issue: 8 Pages: 1573-1582

    • DOI

      10.1080/00207179.2014.880127

    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Journal Article] 過渡応答データを用いたフィルタバンクによるゲイン推定と Extension 定理2013

    • Author(s)
      佐伯正美・和田信敬・佐藤訓志
    • Journal Title

      計測自動制御学会論文集

      Volume: 49 Pages: 425-431

    • NAID

      10031166603

    • Related Report
      2013 Research-status Report 2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] Speeding up of calculation for mu-synthesis of low order H-infinity controllers2013

    • Author(s)
      T. Iwamoto, M. Saeki, S. Satoh and N. Wada
    • Journal Title

      SICE Journal of Control, Measurement, and System Integration

      Volume: 6 Pages: 202-207

    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Journal Article] Passivity based control of stochastic port-Hamiltonian systems2013

    • Author(s)
      S. Satoh and K. Fujimoto
    • Journal Title

      IEEE Transactions on Automatic Control

      Volume: 58 Issue: 5 Pages: 1139-1153

    • DOI

      10.1109/tac.2012.2229791

    • NAID

      10021990949

    • Related Report
      2013 Research-status Report 2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] Gait generation via unified learning optimal control of Hamiltonian systems2013

    • Author(s)
      S. Satoh, K. Fujimoto and S. Hyon
    • Journal Title

      Robotica

      Volume: 31 Issue: 5 Pages: 717-732

    • DOI

      10.1017/s0263574712000756

    • Related Report
      2013 Research-status Report 2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] 学習最適制御に基づく軌道学習と身体パラメータ調整による最適歩容生成2013

    • Author(s)
      佐藤訓志・藤本健治・佐伯正美
    • Journal Title

      計測自動制御学会論文集

      Volume: 49 Pages: 846-854

    • NAID

      10031200044

    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Journal Article] モデルマッチングによるデータ駆動制御器設計のための参照モデルの選定2013

    • Author(s)
      佐伯正美・山成真輝・和田信敬・佐藤訓志
    • Journal Title

      システム制御情報学会論文誌

      Volume: 27 Pages: 73-79

    • NAID

      130004565043

    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Journal Article] Speeding up of calculation for mu-synthesis of low order H-infinity controllers2013

    • Author(s)
      T. Iwamoto, M. Saeki, S. Satoh, and N. Wada
    • Journal Title

      SICE Journal of Control, Measurement, and System Integration

      Volume: 未定

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] 左連続動的システムにおける周期軌道の指数安定性について 一般化ポアンカレ写像に基づくアプローチ2012

    • Author(s)
      佐藤訓志・佐伯正美
    • Journal Title

      計測自動制御学会論文集

      Volume: 48 Pages: 657-663

    • NAID

      10031117745

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] Bounded stabilization of a class of stochastic port-Hamiltonian systems2012

    • Author(s)
      S. Satoh and M. Saeki
    • Journal Title

      Proceedings of Mathematical Theory of Networks and Systems

      Volume: なし

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Presentation] Stochastic performance analysis of visual motion observer and experimental verifications2015

    • Author(s)
      J. Yamauchi, S. Nakano, S. Satoh, T. Hatanaka and M. Fujita
    • Organizer
      Asian Control Conference
    • Place of Presentation
      Sabah, Malaysia
    • Year and Date
      2015-05-31 – 2015-06-03
    • Related Report
      2014 Annual Research Report
  • [Presentation] A parameter space design method using simulation2015

    • Author(s)
      M. Saeki, Y. Kurosaka, N. Wada and S. Satoh
    • Organizer
      Asian Control Conference
    • Place of Presentation
      Sabah, Malaysia
    • Year and Date
      2015-05-31 – 2015-06-03
    • Related Report
      2014 Annual Research Report
  • [Presentation] 経路積分解析を用いた非線形確率最適制御問題の解法2015

    • Author(s)
      佐藤訓志
    • Organizer
      計測自動制御学会 制御部門マルチシンポジウム
    • Place of Presentation
      東京
    • Year and Date
      2015-03-04 – 2015-03-07
    • Related Report
      2014 Annual Research Report
    • Invited
  • [Presentation] A unified approach to nonlinear stochastic control based on path integral analysis2015

    • Author(s)
      S. Satoh and M. Saeki
    • Organizer
      SICE International Symposium on Control Systems
    • Place of Presentation
      Tokyo, Japan
    • Year and Date
      2015-03-04 – 2015-03-07
    • Related Report
      2014 Annual Research Report
  • [Presentation] Data-driven online unfalsified control by using analytic center2014

    • Author(s)
      M. Saeki, K. Kondo, N. Wada and S. Satoh
    • Organizer
      IEEE Conference on Decision and Control
    • Place of Presentation
      Los Angeles, USA
    • Year and Date
      2014-12-15 – 2014-12-17
    • Related Report
      2014 Annual Research Report
  • [Presentation] ポアンカレ写像に基づく受動走行ロボットの安定性解析と学習による軌道最適化2014

    • Author(s)
      佐藤訓志・松下亮・佐伯正美
    • Organizer
      計測自動制御学会システムインテグレーション部門講演会
    • Place of Presentation
      東京
    • Year and Date
      2014-12-15 – 2014-12-17
    • Related Report
      2014 Annual Research Report
  • [Presentation] 小型直流モータの非線形性を考慮したモデル化2014

    • Author(s)
      吉田一貴・佐藤訓志・佐伯正美
    • Organizer
      計測自動制御学会中国支部学術講演会
    • Place of Presentation
      広島
    • Year and Date
      2014-11-29
    • Related Report
      2014 Annual Research Report
  • [Presentation] 経路積分法に基づく不整地における二足歩行ロボットの最適軌道生成2014

    • Author(s)
      上池斗雲・佐藤訓志・佐伯正美
    • Organizer
      計測自動制御学会中国支部学術講演会
    • Place of Presentation
      広島
    • Year and Date
      2014-11-29
    • Related Report
      2014 Annual Research Report
  • [Presentation] 最大感度制約を用いた非線形補償器のデータ駆動設計2014

    • Author(s)
      佐藤健一郎・佐伯正美・和田信敬・佐藤訓志
    • Organizer
      計測自動制御学会中国支部学術講演会
    • Place of Presentation
      広島
    • Year and Date
      2014-11-29
    • Related Report
      2014 Annual Research Report
  • [Presentation] 不感帯要素を含むシステムに対する大域的安定条件2014

    • Author(s)
      楠田裕希・佐伯正美・和田信敬・佐藤訓志
    • Organizer
      計測自動制御学会中国支部学術講演会
    • Place of Presentation
      広島
    • Year and Date
      2014-11-29
    • Related Report
      2014 Annual Research Report
  • [Presentation] パラメータ空間設計法によるSPANフィルタの設計2014

    • Author(s)
      黒坂友亮・佐伯正美・和田信敬・佐藤訓志
    • Organizer
      自動制御連合講演会
    • Place of Presentation
      群馬
    • Year and Date
      2014-11-10 – 2014-11-12
    • Related Report
      2014 Annual Research Report
  • [Presentation] 確率ポート・ハミルトン系に対するSISS補償器の一設計法2014

    • Author(s)
      佐藤訓志・佐伯正美
    • Organizer
      自動制御連合講演会
    • Place of Presentation
      群馬
    • Year and Date
      2014-11-10 – 2014-11-12
    • Related Report
      2014 Annual Research Report
  • [Presentation] 経路積分解析を用いた非線形確率最適制御について2014

    • Author(s)
      佐藤訓志・佐伯正美
    • Organizer
      自動制御連合講演会
    • Place of Presentation
      群馬
    • Year and Date
      2014-11-10 – 2014-11-12
    • Related Report
      2014 Annual Research Report
  • [Presentation] 重心-ZMP倒立振子モデルの重心安定化におけるモデル予測制御の適用2014

    • Author(s)
      荒木洋平・佐藤訓志・和田信敬・佐伯正美
    • Organizer
      日本ロボット学会学術講演会
    • Place of Presentation
      福岡
    • Year and Date
      2014-09-04 – 2014-09-06
    • Related Report
      2014 Annual Research Report
  • [Presentation] 経路積分解析に基づく非線形確率最適制御の一解法2014

    • Author(s)
      佐藤訓志・佐伯正美
    • Organizer
      日本ロボット学会学術講演会
    • Place of Presentation
      福岡
    • Year and Date
      2014-09-04 – 2014-09-06
    • Related Report
      2014 Annual Research Report
  • [Presentation] マルコフ時刻を伴う確率最適制御の経路積分法に基づく解法2014

    • Author(s)
      佐藤訓志・佐伯正美
    • Organizer
      システム制御情報学会研究発表講演会
    • Place of Presentation
      京都
    • Year and Date
      2014-05-21 – 2015-05-23
    • Related Report
      2014 Annual Research Report
  • [Presentation] A study of stochastic input-to-state stability of a class of stochastic port-Hamiltonian systems2014

    • Author(s)
      S. Satoh and M. Saeki
    • Organizer
      Mathematical Theory of Networks and Systems
    • Place of Presentation
      The Netherlands
    • Related Report
      2013 Research-status Report
  • [Presentation] 確率一般化正準変換に基づく確率ポート・ハミルトン系の外乱抑制2014

    • Author(s)
      佐藤訓志・佐伯正美
    • Organizer
      第1回計測自動制御学会 制御部門マルチシンポジウム
    • Place of Presentation
      東京
    • Related Report
      2013 Research-status Report
  • [Presentation] 解析的中心を用いたデータ駆動オンライン非反証制御2014

    • Author(s)
      佐伯正美・近藤耕・和田信敬・佐藤訓志
    • Organizer
      第1回計測自動制御学会 制御部門マルチシンポジウム
    • Place of Presentation
      東京
    • Related Report
      2013 Research-status Report
  • [Presentation] 確率外乱を受ける対象運動に対する視覚オブザーバの推定性能解析2014

    • Author(s)
      山内淳矢・佐藤訓志・畑中健志・藤田政之
    • Organizer
      第1回計測自動制御学会 制御部門マルチシンポジウム
    • Place of Presentation
      東京
    • Related Report
      2013 Research-status Report
  • [Presentation] 経路積分確率最適制御に基づく不整地歩行のための軌道生成について2013

    • Author(s)
      佐藤訓志・佐伯正美
    • Organizer
      第14回計測自動制御学会システムインテグレーション部門講演会
    • Place of Presentation
      兵庫
    • Related Report
      2013 Research-status Report
  • [Presentation] 確率力学系に対する確率有界安定化2013

    • Author(s)
      南部僚太・佐藤訓志・佐伯正美
    • Organizer
      第22回計測自動制御学会中国支部学術講演会
    • Place of Presentation
      山口
    • Related Report
      2013 Research-status Report
  • [Presentation] データ駆動ループ整形法による非線形フィードバックゲインの調整2013

    • Author(s)
      佐藤健一郎・佐伯正美・和田信敬・佐藤訓志
    • Organizer
      第22回計測自動制御学会中国支部学術講演会
    • Place of Presentation
      山口
    • Related Report
      2013 Research-status Report
  • [Presentation] 倒立振子の確率有界安定化について2013

    • Author(s)
      南部僚太・佐藤訓志・佐伯正美
    • Organizer
      第57回システム制御情報学会研究発表講演会
    • Place of Presentation
      兵庫
    • Related Report
      2013 Research-status Report
  • [Presentation] ボリュームレンダリングによる制御器のパラメータ空間設計 -GPUによる高速計算-2013

    • Author(s)
      黒坂友亮・佐伯正美・和田信敬・佐藤訓志
    • Organizer
      第57回システム制御情報学会研究発表講演会
    • Place of Presentation
      兵庫
    • Related Report
      2013 Research-status Report
  • [Presentation] 反復型経路積分最適制御法の力学系への応用2013

    • Author(s)
      佐藤訓志・Hilbert J. Kappen・佐伯正美
    • Organizer
      第13回計測自動制御学会制御部門大会
    • Place of Presentation
      福岡
    • Related Report
      2012 Research-status Report
  • [Presentation] 学習制御とフィードバックチューニングの統合による1脚ロボットの最適歩容生成2012

    • Author(s)
      松下亮・佐藤訓志・佐伯正美
    • Organizer
      第21回計測自動制御学会中国支部学術講演会
    • Place of Presentation
      広島
    • Related Report
      2012 Research-status Report
  • [Presentation] パラメータ空間における一次遅れむだ時間系に対する状態予測制御器の設計2012

    • Author(s)
      林幸彦・佐伯正美・和田信敬・佐藤訓志
    • Organizer
      第21回計測自動制御学会中国支部学術講演会
    • Place of Presentation
      広島
    • Related Report
      2012 Research-status Report
  • [Presentation] Iterative Path Integral Method for Nonlinear Stochastic Optimal Control2012

    • Author(s)
      S. Satoh
    • Organizer
      Workshop on statistical physics of inference and control theory
    • Place of Presentation
      Spain
    • Related Report
      2012 Research-status Report
  • [Remarks] 佐藤 訓志

    • URL

      http://home.hiroshima-u.ac.jp/satoh/index_ja.html

    • Related Report
      2014 Annual Research Report
  • [Remarks] Satoshi Satoh

    • URL

      http://home.hiroshima-u.ac.jp/satoh/index.html

    • Related Report
      2014 Annual Research Report
  • [Remarks] 佐藤 訓志

    • URL

      http://home.hiroshima-u.ac.jp/satoh/index_ja.html

    • Related Report
      2013 Research-status Report
  • [Remarks] Satoshi Satoh

    • URL

      http://home.hiroshima-u.ac.jp/satoh/index.html

    • Related Report
      2013 Research-status Report
  • [Remarks] 佐藤 訓志

    • URL

      http://home.hiroshima-u.ac.jp/satoh/index_ja.html

    • Related Report
      2012 Research-status Report
  • [Remarks] Satoshi SATOH

    • URL

      http://home.hiroshima-u.ac.jp/satoh/index.html

    • Related Report
      2012 Research-status Report

URL: 

Published: 2013-05-31   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi