• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

1998 Fiscal Year Final Research Report Summary

Development of Self-emergent Autonomous Adaptation System

Research Project

Project/Area Number 09450106
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent mechanics/Mechanical systems
Research InstitutionKobe University

Principal Investigator

UEDA Kanji  Kobe University, Faculty of engineering, Professor, 工学部, 教授 (50031133)

Co-Investigator(Kenkyū-buntansha) OHKURA Kazuhiro  Kobe University, Faculty of engineering, Research Associate, 工学部, 助手 (40252788)
MANABE Keishi  Kobe University, Faculty of engineering, Research Associate, 工学部, 助手 (90209677)
ヤリ ワーリオ  ノキアジャパン, ノキアリサーチセンタ, 研究室長
VAARIO Yari  Nokia Research Center, Japan, Senior Research Manager
Project Period (FY) 1997 – 1998
KeywordsReinforcement learning / Autonomous adaptation system / Autonomous locomotive robot / Specialization of functions / Self organization
Research Abstract

In this research, to develop self-emergent autonomous adaptation systems, we develop two autonomous robot systems as follows :
(1) To obtain a gait of a robot systems with four legs, we developed controllers of the robot systems with four controllers assigned to each legs as an asynchronous autonomous agent, and applied CSCG (Continuous Space Classifier Generator) to each agent. To evaluate the controllers, we applied the robot systems to the task that the robot systems should be moved to a light source, and confirmed that the robot systems can be obtain a gait through trial and error.
(2) To develop a control system for two AGVs connected by a link, we developed the control systems with two autonomous agents of each AGV and try to obtain control rules for each AGV by using reinforcement learning. In general, since it is difficult to apply the dynamic problems just like the problem in this research, we combined the predictor by using SLA (Stochastic Learning Automata) with the reinforcement learning. To evaluate the controller, we apply the controller to the task that the two AGVs move along the wall in a room, and confirm the cooperative behavior of the two AGVs by using the controllers proposed in this paper.

  • Research Products

    (34 results)

All Other

All Publications (34 results)

  • [Publications] Kanji Ueda: "Modeling of Biological Manufacturing Systems for Dynamic Reconfiguration" Annals of the CIRP. 46・1. 343-346 (1997)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Yoichiro Nakamura: "Architecture for A Autonomous Robots Using Globally-Coupled Chaotic System" Proceedings of 29th CIRP International Seminar on Manufacturing Systems. 81-86 (1997)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Yoichiro Nakamura: "Instance-based Reinforcement Learning for Robot Path Finding in Continuous Space" Proceedings of IEEE International Conference on Systems,Man,and Cybernetics. 1229-1234 (1997)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 中村陽一郎: "大域結合カオス系に基づく強化学習による自律ロボットの行動獲得(第1報,信頼度割り当ておよび汎化方式に関する考察)" 日本機械学会論文集(C編). 63・615. 273-380 (1997)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Jari Vaario: "Toward intelligent control of multi-agent systems" Proceedings of International Conference on Intelligent Autonomous Systems(IAS-5). 187-198 (1997)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 中村陽一郎: "大域結合カオス系に基づく強化学習による自律ロボットの行動獲得(第2報,動的環境におけるナビゲーション行動の学習)" 日本機械学会論文集(C編). 63・615. 281-287 (1997)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 上田完次: "生物指向型生産システム-環境への適応を目指して-" 日本機械学会誌. 101・959. 771-774 (1998)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 上田完次: "創発システムとしての生産" 精密工学会誌. 64・10. 1431-1434 (1998)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 中村陽一郎: "Instance-based classifier generatorによる自律移動ロボットの行動獲得" 日本ロボット学会論文誌. 16・3. (1999)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Jari Vaario: "Toward intelligent control of multi-agent systems" Proceedings of International Conference on Intelligent Autonomous Systems(IAS-5). (1998)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Jari Vaario: "Lineless production for highly flexible and adaptive manufacturing" Proceedings of ICME98. 391-398 (1998)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Mikhail Svinin: "Reinforcement learning of periodical gaits in locomotion robots" SPIE Int. Symposium on Intelligent Systems and Advanced Manufacturing. 17-22 (1999)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Mikhail Svinin: "Learning control of autonomous robots using an instance-based classifier generator in the con-tinuous state space" Artificial Life and Robotics. 3. (1998)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Mikhail Svinin: "An approach to self-organized control of locomotion robots" Proceedings of 1st Int.Symposium on Climbing and Walking Robots. 329-334 (1998)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Mikhail Svinin: "Decentralized reinforcement learning and emergence of motion patterns" SPIE Int.Symposium on Intelligent Systems and Advanced Manufacturing. 3523. 223-234 (1998)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Mikhail Svinin: "On the emergence of motion patterns in locomotion systems" Proceedings of the 4st Int.Symposium on Artificial Life and Robotics,AROB'99. 158-161 (1998)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Kazuaki Yamada: "Reinforcement learning control of autonomous locomotion robots" Proceedings of the Japan-USA Sysmposium on Flexible Automation. 1097-1100 (1998)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Kazuhiro Ohkura: "A learning multi-agent approach to dynamic scheduling for autonomous distributed manufac-turing systems" 15th International Conference on COMPUTER-AIDED PRODUCTION ENGINEERING(CAPE'99). (1999)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Kazuhiro Ohkura: "Robust evolution strategies" Proceedngs of The Second Asia-Pacific Conference on Simulated Evolution and Learning(SEAL'98). (1998)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Kenichiro Kawakami: "Reinforcement learning approach to cooperative carrying problem" International Symposiuim on Artificial Life and Robotics(AROB'99). 154-157 (1999)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] K.Ueda, J.Vaario and K.Ohkura: "Modeling of Biological Manufacturing Systems for Dynamic Reconfiguration" Annals of the CIRP. Vol.46, No.1. 343-346 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Y.Nakamura, K.Ohkura and K.Ueda: "Control Architecture for A au-tonomous Robots Using Globally-Coupled Chaotic System" Proceedings of 29th CIRP International Seminar on Manufacturing Systems, Osaka. 81-86 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Y.Nakamura, S.Ohnishi, K.Ohkura and K.Ueda: "Instance-based Rein-forcement Learning for Robot Path Finding in Continuous Space" Proceedings of IEEE International Conference on Systems, Man, and Cybernetics. 1229-1234 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] J.Vaario and K.Ueda: "An Emergent Modeling Method for Dynamic Scheduling" Proceedings of the 2nd World Congress on Intel-ligent Manufacturing Processes and Systems. 187-198 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] J.Vaario: "Toward intelligent control of multi-agent systems" Proceedings of International Conference on Intel-ligent Autonomous Systems (IAS-5). (1998)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] J.Vaario: "Lineless production for highly flexible and adaptive manufacturing" Proceedings of ICME'98. 391-398 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] M.Svinin, K.Kuroyama, Y.Nakamura, and K.Ueda: "Learning control of autonomous robots using an instance-based classifier generator in the continuous state space" Artificial Life and Robotics, Springer-Verlag. Vol.3. (1998)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] M.Svinin, K.Yamada, and K.Ueda: "An approach to self-organized control of locomotion robots" 1st Int.Symposium on Climbing and Walking Robots, Brussels, Belgium. 329-334 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] M.Svinin, K.Yamada, K.Ohkura, and K.Ueda: "Decentralized reinforce-ment learning control and emergence of motion patterns" SPIE Int.Symposium on Intelligent Systems and Advanced Manufacturing, Vol.3523, Boston, USA. 223-234 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] M.Svinin, K.Yamada, and K.Ueda: "On the emergence of motion patterns in locomotion systems" Proceedings of the 4th Int.Symposium on Artificial Life and Robotics, AROB'99, Vol.1, Oita, Japan. 158-161 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] K.Yamada, M.Svinin, and K.Ueda: "Reinforcement learning control of autonomous locomotion robots" Proceedings of the Japan-USA Symposium on Flex-ible Automation, Otsu, Japan. 1097-1100 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] K.Ohkura, K.Sera, and K.Ueda: "A learning multi-agent approach to dynamic scheduling for autonomous distributed manufacturing systems" 15th International Con-ference on COMPUTER-AIDED PRODUCTION ENGINEERING (CAPE'99). (Printing). (1999)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] K.Ohkura, Y.Matsumura, and K.Ueda: "Robust evolution strategies" Proc.of The Second Asia-Pacific Conference on Simulated Evolution and Learning (SEAL'98), Lec-ture Notes in Artificial Intelligence. (1998)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] K.Kawakami, K.Ohkura, and K.Ueda: "Reinforcement learning approach to cooperative carrying problem" Proc.of The Fourth Int.Symp.on Artificial Life and Robotics (AROB 4th '99). Vol.1. 154-157 (1999)

    • Description
      「研究成果報告書概要(欧文)」より

URL: 

Published: 1999-12-08  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi