• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of Self-emergent Autonomous Adaptation System

Research Project

Project/Area Number 09450106
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent mechanics/Mechanical systems
Research InstitutionKobe University

Principal Investigator

UEDA Kanji  Kobe University, Faculty of engineering, Professor, 工学部, 教授 (50031133)

Co-Investigator(Kenkyū-buntansha) OHKURA Kazuhiro  Kobe University, Faculty of engineering, Research Associate, 工学部, 助手 (40252788)
MANABE Keishi  Kobe University, Faculty of engineering, Research Associate, 工学部, 助手 (90209677)
ヤリ ワーリオ  ノキアジャパン, ノキアリサーチセンタ, 研究室長
VAARIO Yari  Nokia Research Center, Japan, Senior Research Manager
SVININ Mikha  神戸大学, 工学部, 助教授 (90274125)
Project Period (FY) 1997 – 1998
Project Status Completed (Fiscal Year 1998)
Budget Amount *help
¥4,800,000 (Direct Cost: ¥4,800,000)
Fiscal Year 1998: ¥1,300,000 (Direct Cost: ¥1,300,000)
Fiscal Year 1997: ¥3,500,000 (Direct Cost: ¥3,500,000)
KeywordsReinforcement learning / Autonomous adaptation system / Autonomous locomotive robot / Specialization of functions / Self organization / 知的ロボット / 自律ロボット / 適応システム / 自己創出 / 人工生命 / 進化システム
Research Abstract

In this research, to develop self-emergent autonomous adaptation systems, we develop two autonomous robot systems as follows :
(1) To obtain a gait of a robot systems with four legs, we developed controllers of the robot systems with four controllers assigned to each legs as an asynchronous autonomous agent, and applied CSCG (Continuous Space Classifier Generator) to each agent. To evaluate the controllers, we applied the robot systems to the task that the robot systems should be moved to a light source, and confirmed that the robot systems can be obtain a gait through trial and error.
(2) To develop a control system for two AGVs connected by a link, we developed the control systems with two autonomous agents of each AGV and try to obtain control rules for each AGV by using reinforcement learning. In general, since it is difficult to apply the dynamic problems just like the problem in this research, we combined the predictor by using SLA (Stochastic Learning Automata) with the reinforcement learning. To evaluate the controller, we apply the controller to the task that the two AGVs move along the wall in a room, and confirm the cooperative behavior of the two AGVs by using the controllers proposed in this paper.

Report

(3 results)
  • 1998 Annual Research Report   Final Research Report Summary
  • 1997 Annual Research Report
  • Research Products

    (54 results)

All Other

All Publications (54 results)

  • [Publications] Kanji Ueda: "Modeling of Biological Manufacturing Systems for Dynamic Reconfiguration" Annals of the CIRP. 46・1. 343-346 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Yoichiro Nakamura: "Architecture for A Autonomous Robots Using Globally-Coupled Chaotic System" Proceedings of 29th CIRP International Seminar on Manufacturing Systems. 81-86 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Yoichiro Nakamura: "Instance-based Reinforcement Learning for Robot Path Finding in Continuous Space" Proceedings of IEEE International Conference on Systems,Man,and Cybernetics. 1229-1234 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 中村陽一郎: "大域結合カオス系に基づく強化学習による自律ロボットの行動獲得(第1報,信頼度割り当ておよび汎化方式に関する考察)" 日本機械学会論文集(C編). 63・615. 273-380 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Jari Vaario: "Toward intelligent control of multi-agent systems" Proceedings of International Conference on Intelligent Autonomous Systems(IAS-5). 187-198 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 中村陽一郎: "大域結合カオス系に基づく強化学習による自律ロボットの行動獲得(第2報,動的環境におけるナビゲーション行動の学習)" 日本機械学会論文集(C編). 63・615. 281-287 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 上田完次: "生物指向型生産システム-環境への適応を目指して-" 日本機械学会誌. 101・959. 771-774 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 上田完次: "創発システムとしての生産" 精密工学会誌. 64・10. 1431-1434 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 中村陽一郎: "Instance-based classifier generatorによる自律移動ロボットの行動獲得" 日本ロボット学会論文誌. 16・3. (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Jari Vaario: "Toward intelligent control of multi-agent systems" Proceedings of International Conference on Intelligent Autonomous Systems(IAS-5). (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Jari Vaario: "Lineless production for highly flexible and adaptive manufacturing" Proceedings of ICME98. 391-398 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Mikhail Svinin: "Reinforcement learning of periodical gaits in locomotion robots" SPIE Int. Symposium on Intelligent Systems and Advanced Manufacturing. 17-22 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Mikhail Svinin: "Learning control of autonomous robots using an instance-based classifier generator in the con-tinuous state space" Artificial Life and Robotics. 3. (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Mikhail Svinin: "An approach to self-organized control of locomotion robots" Proceedings of 1st Int.Symposium on Climbing and Walking Robots. 329-334 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Mikhail Svinin: "Decentralized reinforcement learning and emergence of motion patterns" SPIE Int.Symposium on Intelligent Systems and Advanced Manufacturing. 3523. 223-234 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Mikhail Svinin: "On the emergence of motion patterns in locomotion systems" Proceedings of the 4st Int.Symposium on Artificial Life and Robotics,AROB'99. 158-161 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Kazuaki Yamada: "Reinforcement learning control of autonomous locomotion robots" Proceedings of the Japan-USA Sysmposium on Flexible Automation. 1097-1100 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Kazuhiro Ohkura: "A learning multi-agent approach to dynamic scheduling for autonomous distributed manufac-turing systems" 15th International Conference on COMPUTER-AIDED PRODUCTION ENGINEERING(CAPE'99). (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Kazuhiro Ohkura: "Robust evolution strategies" Proceedngs of The Second Asia-Pacific Conference on Simulated Evolution and Learning(SEAL'98). (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Kenichiro Kawakami: "Reinforcement learning approach to cooperative carrying problem" International Symposiuim on Artificial Life and Robotics(AROB'99). 154-157 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] K.Ueda, J.Vaario and K.Ohkura: "Modeling of Biological Manufacturing Systems for Dynamic Reconfiguration" Annals of the CIRP. Vol.46, No.1. 343-346 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Y.Nakamura, K.Ohkura and K.Ueda: "Control Architecture for A au-tonomous Robots Using Globally-Coupled Chaotic System" Proceedings of 29th CIRP International Seminar on Manufacturing Systems, Osaka. 81-86 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Y.Nakamura, S.Ohnishi, K.Ohkura and K.Ueda: "Instance-based Rein-forcement Learning for Robot Path Finding in Continuous Space" Proceedings of IEEE International Conference on Systems, Man, and Cybernetics. 1229-1234 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] J.Vaario and K.Ueda: "An Emergent Modeling Method for Dynamic Scheduling" Proceedings of the 2nd World Congress on Intel-ligent Manufacturing Processes and Systems. 187-198 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] J.Vaario: "Toward intelligent control of multi-agent systems" Proceedings of International Conference on Intel-ligent Autonomous Systems (IAS-5). (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] J.Vaario: "Lineless production for highly flexible and adaptive manufacturing" Proceedings of ICME'98. 391-398 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] M.Svinin, K.Kuroyama, Y.Nakamura, and K.Ueda: "Learning control of autonomous robots using an instance-based classifier generator in the continuous state space" Artificial Life and Robotics, Springer-Verlag. Vol.3. (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] M.Svinin, K.Yamada, and K.Ueda: "An approach to self-organized control of locomotion robots" 1st Int.Symposium on Climbing and Walking Robots, Brussels, Belgium. 329-334 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] M.Svinin, K.Yamada, K.Ohkura, and K.Ueda: "Decentralized reinforce-ment learning control and emergence of motion patterns" SPIE Int.Symposium on Intelligent Systems and Advanced Manufacturing, Vol.3523, Boston, USA. 223-234 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] M.Svinin, K.Yamada, and K.Ueda: "On the emergence of motion patterns in locomotion systems" Proceedings of the 4th Int.Symposium on Artificial Life and Robotics, AROB'99, Vol.1, Oita, Japan. 158-161 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] K.Yamada, M.Svinin, and K.Ueda: "Reinforcement learning control of autonomous locomotion robots" Proceedings of the Japan-USA Symposium on Flex-ible Automation, Otsu, Japan. 1097-1100 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] K.Ohkura, K.Sera, and K.Ueda: "A learning multi-agent approach to dynamic scheduling for autonomous distributed manufacturing systems" 15th International Con-ference on COMPUTER-AIDED PRODUCTION ENGINEERING (CAPE'99). (Printing). (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] K.Ohkura, Y.Matsumura, and K.Ueda: "Robust evolution strategies" Proc.of The Second Asia-Pacific Conference on Simulated Evolution and Learning (SEAL'98), Lec-ture Notes in Artificial Intelligence. (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] K.Kawakami, K.Ohkura, and K.Ueda: "Reinforcement learning approach to cooperative carrying problem" Proc.of The Fourth Int.Symp.on Artificial Life and Robotics (AROB 4th '99). Vol.1. 154-157 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 上田完次: "生物指向型生産システム-環境への適応を目指して-" 日本機械学会誌. 101・959. 771-774 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] 上田完次: "創発システムとしての生産" 精密工学会誌. 64・10. 1431-1434 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] 中村陽一郎: "Instance-based classifier generator による自律移動ロボットの行動獲得" 日本ロボット学会論文誌. 16・3. (1999)

    • Related Report
      1998 Annual Research Report
  • [Publications] Jari Vaario: "Toward intelligent control of multi-agent systems" Proceedings of International Congerence on Intelligent Autonomous Systems (IAS-5). (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] Jari Vaario: "Lineless production for highly flexible and adaptive manufacturing" Proceedings of ICME98. 391-398 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] Mikhail Svinin: "Reinforcement learning of periodical gaits in locomotion robots" SPIE Int.Symposium on Intelligent Systems and Advanced Manufacturing. 17-22 (1999)

    • Related Report
      1998 Annual Research Report
  • [Publications] Mikhail Svinin: "Learning control of autonomous robots using an instance-based classifier generator in the continuous state space" Artificial Life and Robotics. 3. (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] Mikhail Svnin: "An approach to self-organized control of locomotion robots" Proceedings of 1st Int.Symposium on Climbing and Walking Robots. 329-334 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] Mikhail Svinin: "Decentralized reinforcement learning control and emergence of motion patterns" SPIE Int.Symposium on Intelligent Systems and Advanced Manufacturing. 3523. 223-234 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] Mikhail Svinin: "On the emergence of motion patterns in locomotion systems" Proceedings of the 4th Int.Symposium on Artificial Life and Robotics,AROB'99. 158-161 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] Kazuaki Yamada: "Reinforcement learning control of autonomous locomotion robots" Proceedings of the Japan-USA Symposium on Flexible Automation. 1097-1100 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] Kazuhiro Ohkura: "A learning multi-agent approach to dynamic sheduling for autonomous distributed manufacturing systems" 15th International Conference on COMPUTER-AIDED PRODUCTION ENGINEERING (CAPE'99). (1999)

    • Related Report
      1998 Annual Research Report
  • [Publications] Kazuhiro Ohkura: "Robust evolution strategies" Proceedings of The Second Asia-Pacific Conference on Simulated Evolution and Learning (SEAL'98). (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] Kenichiro Kawakami: "Reinforcement learning approach to cooperative carrying problem" International Symposiuim on Artificial Life and Robotics (AROB'99). 154-157 (1999)

    • Related Report
      1998 Annual Research Report
  • [Publications] Yoichiro Nakamura: "Control Architecture for Autonomous Robots Using Globally-Coupled Chaotic System" Proceedings of 29th CIRP International Seminar on Manufacturing Systems. 81-86 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] 中村陽一郎: "大域結合カオス系に基づく強化学習による自律ロボットの行動獲得(第1報,信頼度割り当ておよび汎化方式に関する考察)" 日本機械学会論文集(C編). 63・615. 273-280 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] 中村陽一郎: "大域結合カオス系に基づく強化学習による自律ロボットの行動獲得(第2報,動的環境におけるナビゲーション行動の学習)" 日本機械学会論文集(C編). 63・615. 281-287 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] 中村陽一郎: "自律ロボットの行動獲得のための制御アーキテクチャ(大域結合カオス系を用いた強化学習)" 日本機械学会論文集(C編). 63・616. 207-214 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] K.Kuroyama: "Learning Contorol of Autonomous Robots Using Instance-Based Classifier Generator in the Continuous State Space" Proc.of the 3rd International Symposium on Artificial Life and Robotics. 89-92 (1998)

    • Related Report
      1997 Annual Research Report
  • [Publications] Masao Migita: "A study for construction of a ‘biologically' autonomous robot" Proc.of the 3rd International Symposium on Artificial Life and Robotics. 402-405 (1998)

    • Related Report
      1997 Annual Research Report

URL: 

Published: 1997-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi