An Integrated System Mimicking Brain Information Processing with Learning Functions for Self and Others, and Its Application

2013 Fiscal Year Final Research Report

• Project/Area Number: 23500181
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Multi-year Fund
• Section: 一般
• Research Field: Intelligent informatics
• Research Institution: Aichi Prefectural University (2012-2013); Yamaguchi University (2011)
• Principal Investigator: KOBAYASHI Kunikazu 愛知県立大学, 情報科学部, 准教授 (40263793)
• Co-Investigator(Kenkyū-buntansha): OBAYASHI Masanao 山口大学, 大学院・理工学研究科, 教授 (60213849) ; KUREMOTO Takashi 山口大学, 大学院・理工学研究科, 助教 (40294657)
• Project Period (FY): 2011 – 2013
• Keywords: マルチエージェント / 強化学習 / 意図推定 / 行動予測 / 注意生成 / 脳情報処理 / ロボット / 機械学習

Research Abstract

This study developed the following five models: (1) a state-action prediction model which predicts other's state and action, (2) a policy estimation model which estimates other's action policy, (3) an intention estimation model which estimates other's intention, (4) an attention generation model which focuses on particular stimulus out of plural sensitive stimuli, (5) an emotion generation model which imitates human emotion. After that, an integrated system mimicking brain information processing with learning functions was developed based on the five proposed models for emerging cooperative behavior in multi-agent systems. Through both computer simulation and robot experiment, the proposed system was evaluated.

Research Products

• [Journal Article] Time Series Forecasting Using a Deep Belief Network with Restricted Boltzmann Machines (2014)
  • Author(s): Kuremoto, T ., Kimura, S., Kobayashi, K., and Obayashi, M
  • Journal Title: Neurocomputing Volume: Vol.137 Pages: 47-56
  • Peer Reviewed
• [Journal Article] マルコフ情動モデルを備えたロボットの行動決定法 (2014)
  • Author(s): 綿田 将悟, 大林 正直, 呉本 尭, 間普真吾, 小林 邦和
  • Journal Title: 電気学会論文誌 Volume: Vol.134-C,No.1 Pages: 85-93
  • Peer Reviewed
• [Journal Article] 自己融合小脳パーセプトロン改良モデル利用型制御システムとその合意問題への適用 (2014)
  • Author(s): 内山 祥吾, 大林 正直, 呉本 尭, 小林邦和, 間普 真吾
  • Journal Title: 電気学会論文誌 Volume: Vol.134-C,No.7(印刷中)
• [Journal Article] ニューロファジィ型強化学習システムを用いた群行動の獲得 (2013)
  • Author(s): 呉本 尭, 山野 祐樹, 馮 良炳, 小林 邦和, 大林 正直
  • Journal Title: 気学会論文誌 Volume: Vol.133-C,No.5 Pages: 1076-1085
  • Peer Reviewed
• [Journal Article] QoS Optimization for Web Service Composition Based on Reinforcement Learning (2013)
  • Author(s): Feng, L., Obayashi, M., Kuremoto, T ., Kobayashi, K., and Watanabe, S
  • Journal Title: Int'l Journal of Innovative Computing, Information and Control Volume: Vol.9,No.6 Pages: 2361-2376
• [Journal Article] 小脳パーセプトロン改良モデル利用型ロバスト制御システム (2013)
  • Author(s): 内山 祥吾, 大林 正直, 呉本 尭, 小林邦和
  • Journal Title: 電気学会論文誌 Volume: Vol.133-C,No.6 Pages: 1251-1258
  • Peer Reviewed
• [Journal Article] An Improved Reinforcement Learning System Using Affective Factors (2013)
  • Author(s): Kuremoto, T ., Tsurusaki, T ., Kobayashi, K., Mabu, S., and Obayashi, M
  • Journal Title: Robotics Volume: Vol.2, No.3 Pages: 149-164
  • Peer Reviewed
• [Journal Article] Analyzing and Learning Opponent's Strategies in the RoboCup Small Size League (2013)
  • Author(s): Yasui, K., Kobayashi, K., Murakami, K., and Naruse, T
  • Journal Title: Lecture Notes in Artificial Intelligence Volume: (印刷中)
  • Peer Reviewed
• [Journal Article] A Model of Emotional Intelligent Agent for Cooperative Goal Exploration (2013)
  • Author(s): Kuremoto, T ., Tsurusaki, T ., Kobayashi, K., Mabu, S., and Obayashi, M
  • Journal Title: Lecture Notes in Computer Science Volume: Vol.7995 Pages: 21-30
  • Peer Reviewed
• [Journal Article] A Gesture Recognition System with Retina-V1 Model and One-pass Dynamic Programming (2013)
  • Author(s): Kuremoto, T ., Kinoshita, Y ., Feng, L., Watanabe, S., Kobayashi, K., and Obayashi, M
  • Journal Title: Neurocomputing Volume: Vol.116 Pages: 291-300
  • Peer Reviewed
• [Journal Article] A Method for Analyzing the Spatiotemporal Changes of Chaotic Neural Networks (2013)
  • Author(s): Watanabe, S., Kuremoto, T ., Kobayashi, K., and Obayashi, M
  • Journal Title: Artificial Life and Robotics Volume: Vol.18 Pages: 196-203
  • Peer Reviewed
• [Journal Article] A Learning Fuzzy Petri Net Model (2012)
  • Author(s): Feng, L., Obayashi, M., Kuremoto, T ., and Kobayashi, K
  • Journal Title: IEEJ Transactions on Electrical and Electronic Engineering Volume: Vol.7,No.3 Pages: 274-282
  • Peer Reviewed
• [Journal Article] H∞追従性能補償器を備えたリアルタイム強化学習制御システム (2012)
  • Author(s): 内山 祥吾, 大林 正直, 呉本 尭, 小林邦和
  • Journal Title: 電気学会論文誌 Volume: Vol.132-C,No.6 Pages: 1008-1015
  • Peer Reviewed
• [Journal Article] Cooperative Behavior Acquisition in Multi-agent Reinforcement Learning System Using Attention Degree (2012)
  • Author(s): Kobayashi, K., Kurano, T ., Kuremoto, T ., and Obayashi, M
  • Journal Title: Lecture Notes in Computer Science Volume: Vol.7665 Pages: 537-544
  • Peer Reviewed
• [Journal Article] Handwriting Character Classification Using Free- man's Olfactory KIII Model (2012)
  • Author(s): Obayashi, M., Koga, S., Feng, L., Kuremoto, T ., and Kobayashi, K
  • Journal Title: Artificial Life and Robotics Volume: Vol.17,No.x Pages: 1-6
  • Peer Reviewed
• [Journal Article] Time Series Forecasting Using Restricted Boltzmann Machine (2012)
  • Author(s): Kuremoto, T ., Kimura, S., Kobayashi, K., and , Obayashi, M
  • Journal Title: Communications in Computer and Information Science Volume: Vol.304 Pages: 17-22
  • Peer Reviewed
• [Journal Article] Multiple Action Sequence Learning and Automatic Generation for a Humanoid Robot Using RNNPB and Reinforcement Learning (2012)
  • Author(s): Kuremoto, T ., Hashiguchi, K., Morisaki, K., Watanabe, S., Kobayashi, K., Mabu, S., and Obayashi, M
  • Journal Title: A Journal of Software Engineering and Applications Volume: Vol.5 Pages: 128-133
  • Peer Reviewed
• [Journal Article] 相互結合型ネットワークにおけるメタヒューリスティクスを用いた動的想起 (2011)
  • Author(s): 呉本 尭, 渡邊 駿, 小林 邦和, 馮 良炳, 大林 正直
  • Journal Title: 電気学会論文誌 Volume: Vol.131-C,No.8 Pages: 1475-1484
  • Peer Reviewed
• [Journal Article] 強化学習制御と適応 H∞制御の協働型制御方式 (2011)
  • Author(s): 大林 正直, 内山 祥吾, 呉本 尭, 小林邦和
  • Journal Title: 電気学会論文誌 Volume: Vol.131-C,No.8 Pages: 1467-1474
  • Peer Reviewed
• [Journal Article] A Gesture Recognition System Using One-Pass DP Method (2011)
  • Author(s): Kuremoto, T ., Kinoshita, Y ., Feng, L., Watanabe, S., Kobayashi, K., and, Obayashi, M
  • Journal Title: Lecture Notes in Artificial Intelligence Volume: Vol.6839 Pages: 581-587
  • Peer Reviewed
• [Journal Article] Investigating the Influence of PFC Transection and Nicotine on Dynamics of AMP A and NMDA Receptors of VTA Dopaminergic Neurons (2011)
  • Author(s): Chen, T . Y., Zhang, D., Dragomir, A., Kobayashi, K., Akay , Y., and Akay , M
  • Journal Title: Journal of NeuroEngineering and Rehabilitation Volume: Vol.8,No.58
  • DOI: 10.1186/1743-0003-8-58
  • Peer Reviewed
• [Journal Article] An Action Selection Method Based on Estimation of Other's Intention in Time-V arying MultiAgent Environments (2011)
  • Author(s): Kobayashi, K., Kanehira, R., Kuremoto, T ., and Obayashi, M
  • Journal Title: Lecture Notes in Computer Science Volume: Vol.7064 Pages: 76-85
  • Peer Reviewed
• [Journal Article] A Neuro-Fuzzy Network with Reinforcement Learning Algorithms for Swarm Learning (2011)
  • Author(s): Kuremoto, T ., Yamano, Y ., Feng, L., Kobayashi, K., and Obayashi, M
  • Journal Title: Lecture Notes in Electrical Engineering Volume: Vol.144 Pages: 101-108
  • Peer Reviewed
• [Journal Article] Optimization and V erification for a Robot Control System Based on Learning Petri Net Model (2011)
  • Author(s): Feng, L., Obayashi, M, Kuremoto, T ., and Kobayashi, K
  • Journal Title: Lecture Notes in Electrical Engineering Volume: Vol.133 Pages: 815-823
  • Peer Reviewed
• [Journal Article] An Improved Internal Model of Autonomous Robots by a Psychological Approach (2011)
  • Author(s): Kuremoto, T ., Obayashi, M., Kobayashi, K., and Feng, L
  • Journal Title: Cognitive Computation Volume: Vol.3 Pages: 501-509
  • Peer Reviewed
• [Presentation] A Method to Estimate Ball' s State of Spin by Image Processing for Strategic Learning in RoboCup Small-Size-robot League (2014)
  • Author(s): Nunome, Y ., Murakami, K., Ito, M., Kobayashi, K., and Naruse, T
  • Organizer: Proc. of IWAIT2014
  • Year and Date: 20140000
• [Presentation] Decision Making System of Robots Introducing a Reconstruction of Emotions Based on Their Own Experiences (2014)
  • Author(s): Watada S., Obayashi, M., Kuremoto, T ., Mabu, S., and Kobayashi, K
  • Organizer: Proc. of ICAROB2014
  • Year and Date: 20140000
• [Presentation] The Recollection Characteristics of Generalized MCNN Using Different Control Methods (2014)
  • Author(s): Watanabe, S., Kuremoto, T ., Mabu, S., Obayashi, M., and Kobayashi, K
  • Organizer: Proc. of ICAROB2014
  • Year and Date: 20140000
• [Presentation] An Action Selection Method Using Degree of Cooperation in a Multi-agent System (2014)
  • Author(s): Kawamura, M., Kobayashi, K
  • Organizer: Proc. of ICAROB2014
  • Year and Date: 20140000
• [Presentation] Cooperative Action Acquisition Based on Intention Estimation Method in a Multi-agent Reinforcement Learning System (2014)
  • Author(s): Tsubakimoto, T ., Kobayashi, K
  • Organizer: Proc. of ICAROB2014
  • Year and Date: 20140000
• [Presentation] The Effect of the Internal Parameters on Association Performance of a Chaotic Neural Network (2013)
  • Author(s): Watanabe, S., Kuremoto, T ., Kobayashi, K., and Obayashi, M
  • Organizer: Proc. of AROB2013
  • Year and Date: 20130000
• [Presentation] A New Decision-Making System of an Agent Based on Emotional Model in Multi Agent System (2013)
  • Author(s): Watada, S., Obayashi, M., Kuremoto, T ., Kobayashi, K., and Mabu, S
  • Organizer: Proc. of AROB2013
  • Year and Date: 20130000
• [Presentation] Decentralized Adaptive Control Using an Affine plus Self-organizing Fuzzy Neural Network for Multi-Agent System Consensus Problem (2013)
  • Author(s): Obayashi, M., Otomi, Y ., Kuremoto, T ., Kobayashi, K., and Mabu, S
  • Organizer: Proc. of ICSSE2013
  • Year and Date: 20130000
• [Presentation] The Recollection Characteristics of a Generalized MCNN (2013)
  • Author(s): Watanabe, S., Kuremoto, T ., Kobayashi, K., Mabu, S., and Obayashi, M
  • Organizer: Proc. of SICE Annual Conf. 2013
  • Year and Date: 20130000
• [Presentation] Adaptive Control System Based on Self-organizing Wavelet Neural Network with Tracking Performance Compensator (2013)
  • Author(s): Obayashi, M., Kamikariya, T ., Uchiyama, S., Watada, S., Kuremoto, T ., Mabu, S., and Kobayashi, K
  • Organizer: Proc. of SMC2013
  • Year and Date: 20130000
• [Presentation] Dynamical Recollection and Storage of Video Images via MCNN and SOM (2013)
  • Author(s): Watanabe, S., Kuremoto, T ., Kobayashi, K., Mabu, S., and Obayashi, M
  • Organizer: Proc. of ICIARE2013
  • Year and Date: 20130000
• [Presentation] Innovative Practice of Robotics Education Using LEGO Mindstorms NXT (2013)
  • Author(s): Kuremoto, T ., Watanabe, S., Ko- bayashi, K., Mabu, S., and Obayashi, M
  • Organizer: Proc. of ICIARE2013
  • Year and Date: 20130000
• [Presentation] An Innovative Mental Task Classification Method with a Hierarchical Structure Based on EEG Data (2013)
  • Author(s): Obayashi, M., Shinkawa, M., Kuremoto, T ., Kobayashi, K., and Mabu, S
  • Organizer: Proc. of ICIARE2013
  • Year and Date: 20130000
• [Presentation] Development of a Brain Computer Interface Using Inexpensive Commercial EEG Sensor with One-channel (2012)
  • Author(s): Obayashi, M., Watanabe, K., Kuremoto, T ., and Kobayashi, K
  • Organizer: Proc. of AROB2012
  • Year and Date: 20120000
• [Presentation] Handwriting Character Classification Using Freeman's Olfactory KIII Model (2012)
  • Author(s): Obayashi, M., Koga, S., Kuremoto, T ., and Kobayashi, K
  • Organizer: Proc. of AROB2012
  • Year and Date: 20120000
• [Presentation] A Hand Image Instruction Learning System Using PL- G-SOM (2012)
  • Author(s): Kuremoto, T ., Otani, T ., Feng, L., Kobayashi, K., and , Obayashi, M
  • Organizer: Proc. of ICAI2012
  • Year and Date: 20120000
• [Presentation] An Emotional Model Embedded Reinforcement Learning System (2012)
  • Author(s): Obayashi, M., Takuno, T ., Kuremoto, T ., and Kobayashi, K
  • Organizer: Proc. of SMC2012
  • Year and Date: 20120000
• [Presentation] A Hu-man-Machine Interaction System, A Voice Command Learning System Using PL-G-SOM (2011)
  • Author(s): Kuremoto, T ., Y amane, T ., Feng, L., Kobayashi, K., and Obayashi, M
  • Organizer: Proc. of IEM2011
  • Year and Date: 20110000
• [Presentation] Robust Reinforcement Learning Control System with Tracking Performance Compensator (2011)
  • Author(s): Uchiyama, S., Obayashi, M., Kuremoto, T ., and Kobayashi, K
  • Organizer: Proc. of ICCAS2011
  • Year and Date: 20110000
• [Presentation] Intelligent Tracking Control Method of a Target by Group of Agents with Nonlinear Dynamics (2011)
  • Author(s): Obayashi, M., Y okoji, Y ., Uchiyama, S., Feng, L., Kuremoto, T ., and Kobayashi, K
  • Organizer: Proc. of ICCAS2011
  • Year and Date: 20110000
• [Presentation] H∞ Robust Reinforcement Learning Control System with Auto-Structuring Fuzzy Neural Network (2011)
  • Author(s): Uchiyama, S., Obayashi, M., Kuremoto, T ., and Kobayashi, K
  • Organizer: Proc. of ISDM2011
  • Year and Date: 20110000
• [Book] 機械学習技術の基礎と応用 (2013)
  • Author(s): 実応用を指向する械学習技術調査専門委員会(編), 小林 邦和
  • Publisher: 電気学会
• [Book] Advances in Robotics : Modeling, Control and Applications (2013)
  • Author(s): Ciufudean, C. ( 編 ) , Kuremoto, T ., Kobayashi, K., and Obayashi, M
  • Publisher: iConcept Press
• [Book] Horizons in Computer Science Research (Vol.8) (2013)
  • Author(s): Clary , T . S. ( 編 ) , Kuremoto, T ., Obayashi, M., and Kobayashi, K
  • Publisher: Nova Science Publishers
• [Book] Petri Nets-Manufacturing and Computer Science (2012)
  • Author(s): Pawlewski, P . (編) , Feng, L., Obayashi, M., Kuremoto, T ., and Kobayashi, K
  • Publisher: InTech Publishing
• [Book] Insights into the Amygdala: Structure, Functions and Implications for Disorders (2012)
  • Author(s): Yilmazer-Hanke, D. (編) , Kuremoto, T ., Obayashi, M., and Kobayashi, K
  • Publisher: Nova Science Publishers
• [Book] Robust Control, Theory and Applications (2011)
  • Author(s): Bartoszewicz, A.(編), Obayashi, M., Nakahara, N., Y amada, K., Kuremoto, T ., Kobayashi, K., and Feng, L
  • Publisher: InT ech Publishing
• [Remarks]
  • URL: http://www.ist.aichi-pu.ac.jp/~koba/