• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Intelligent System Controlling Autonomous Mobile Robots with an Intelligent Human-machine Interface and Research on Swarm Intelligence Acquired by Reinforcement Learning

Research Project

Project/Area Number 15500125
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Perception information processing/Intelligent robotics
Research InstitutionShibaura Institute of Technology (2004-2005)
Kinki University (2003)

Principal Investigator

IGARASHI Harukazu  Shibaura Institute of Technology, College of Engieering, Professor, 工学部, 教授 (80288886)

Co-Investigator(Kenkyū-buntansha) KUROSE Yoshinobu  Kinki University, School of Engineering, Professor, 工学部, 教授 (00043802)
IOI Kiyoshi  Kinki University, School of Engineering, Professor, 工学部, 教授 (90288887)
Project Period (FY) 2003 – 2005
Project Status Completed (Fiscal Year 2005)
Budget Amount *help
¥3,600,000 (Direct Cost: ¥3,600,000)
Fiscal Year 2005: ¥500,000 (Direct Cost: ¥500,000)
Fiscal Year 2004: ¥400,000 (Direct Cost: ¥400,000)
Fiscal Year 2003: ¥2,700,000 (Direct Cost: ¥2,700,000)
KeywordsAutonomous Mobile Robots / Reinforcement Learning / Multi-agent System / RoboCup / Pursuit Problem / Path Planning / Behavior Learning / RoboCuP / マルチエージェント
Research Abstract

In this research project, we constructed a soccer robot system that consists of a host PC, including a frame grabber, five mobile robots, and a video camera set-up over the robot field. Using this robot system, we conducted research on the following four subjects.
The first subject is robust color extraction that does not depend on lighting conditions. Accurate color extraction is necessary so that the robot system can accurately recognize robot markers. We proposed a color recognition method based on a database of threshold values to extract background color (green), the colors of two robot markers (yellow and blue), and the color of a ball (orange). In our experiments, highly accurate recognition rates were observed, even if a deep shadow in a belt-like shape existed in the robot field.
The second subject is the running control of mobile robots with four omniwheels. We used Q-learning to teach the running property to each robot and performed an experiment in which robots moved directly toward a goal. Experimental results showed that Q-learning reduces 50% of the angle deviation from a direct path to the goal.
The third subject is a policy gradient approach to agent learning in a multi-agent system. We applied this approach to such tasks as pursuit problems with obstacles, an inverse problem in a curling-like game, and a collaboration problem involving a kicker and a receiver at free kicks in a soccer simulation game. Our experiments showed the effectiveness of this approach.
The final subject is a portable pointer for positional data acquisition. We developed a portable pointer device and a software system to recognize where the device is pointing.

Report

(4 results)
  • 2005 Annual Research Report   Final Research Report Summary
  • 2004 Annual Research Report
  • 2003 Annual Research Report
  • Research Products

    (30 results)

All 2005 2004 2003 Other

All Journal Article (28 results) Publications (2 results)

  • [Journal Article] 非マルコフ決定過程における強化学習〜方策勾配法によるアプローチ〜2005

    • Author(s)
      五十嵐治一, 石原聖司, 木村昌臣
    • Journal Title

      第17回自律分散システム・シンポジウム資料

      Pages: 189-194

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary 2004 Annual Research Report
  • [Journal Article] Study on a Portable Pointer for Positional Data Acquisition2005

    • Author(s)
      K.Ioi, Y.Sato, S.Miyoshi
    • Journal Title

      Proceedings of the 2005 IEEE/ASME International Conference on Advanced Intelligent Machatronics

      Pages: 313-318

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 追跡問題への方策勾配法の適用〜ルール重みの再利用と障害物のある事例について〜2005

    • Author(s)
      五十嵐治一, 石原聖司, 高橋 潤, 丸山紘和
    • Journal Title

      第15回インテリジェント・システム・シンポジウム(FAN2005)講演論文集

      Pages: 375-380

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Journal Article] 方策勾配法を用いたサッカーエージェントの学習〜フリーキック〜2005

    • Author(s)
      中村浩二, 五十嵐治一, 石原聖司
    • Journal Title

      第10回ゲーム・プログラミング・ワークショップ予稿集

      Pages: 32-39

    • NAID

      170000080240

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 方策勾配法を用いた運動方程式中のパラメータ学習〜2ストーン系のカーリングゲーム〜2005

    • Author(s)
      五十嵐治一, 石原聖司, 野原 勉
    • Journal Title

      ロボティクス・メカトロニクス講演会'05(ROBOMEC'05)講演論文集 (CD-ROM)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 方策勾配法を用いたフリーキック時の行動学習2005

    • Author(s)
      中村浩二, 五十嵐治一, 石原聖司
    • Journal Title

      ロボティクス・メカトロニクス講演会'05(ROBOMEC'05)講演論文集 (CD-ROM)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Smart Pointer を用いた移動ロボットシステム2005

    • Author(s)
      溝田晋市, 三好伸弥, 五百位清, 杉山義春, 結城賢治, 森隆男
    • Journal Title

      計測自動制御学会第4回システムインテグレーション部門学術講演会予稿集

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Reinforcement Learning in Non-Markov Decision Processes - An Approach Based on Policy-Gradient Methods (in Japanese)2005

    • Author(s)
      H.Igarashi, S.Ishihara, M.Kimura
    • Journal Title

      Proceedings of The 17th SICE Symposium on Decentralized Autonomous Systems

      Pages: 189-194

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Study on a Portable Pointer for Positional Data Acquisition2005

    • Author(s)
      K.Ioi, Y.Sato, S.Miyoshi
    • Journal Title

      Proceedings of the 2005 IEEE/ASME International Conference on Advanced Intelligent Mechatronics

      Pages: 313-318

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] On Applying Policy Gradient Method to Pursuit Problems 〜Reuse of Rule Weights and Study of a Case with an Obstacle Included〜2005

    • Author(s)
      H.Igarashi, S.Ishihara, J.Takahashi, H.Maruyama
    • Journal Title

      Proceedings of FAN Symposium'05 in Kyoto

      Pages: 375-380

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Learning of Soccer Player Agents Using Policy Gradient Methods 〜Free Kicks〜 (in Japanese)2005

    • Author(s)
      K.Nakamura, Higarashi, S.Ishihara
    • Journal Title

      Proceedings of The 10th Game Programming Workshop in Japan 2005

      Pages: 32-39

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A Policy Gradient Approach to Learning Parameters in the Equations of Motion : Two-stone Curling Game (in Japanese)2005

    • Author(s)
      H.Igarashi, S.Ishihara, T.Nohara
    • Journal Title

      Proceedings of 2005 JSME Conference on Robotics and Mechatronics 1A1-N-028

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Learning of Decision Making at Free Kicks Using Policy Gradient Methods (in Japanese)2005

    • Author(s)
      K.Nakamura, H.Igarashi, S.Ishihara
    • Journal Title

      Proceedings of 2005 JSME Conference on Robotics and Mechatronics 2P1-S-022

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Mobile Robot System using Smart Pointer (in Japanese)2005

    • Author(s)
      S.Mizota, S.Miyoshi, K.Ioi, Y.Sugiyama, K.Yuki, T.Mori
    • Journal Title

      Proceedings of SICE Symposium on Systems and Information

      Pages: 41-42

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 方策勾配法を用いた運動方程式中のパラメータ学習"2ストーン系のカーリングゲーム"2005

    • Author(s)
      五十嵐治一, 石原聖司, 野原 勉
    • Journal Title

      ロボティクス・メカトロニクス講演会'05(ROBOMEC'05)講演論文集

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 方策勾配法を用いたフリーキック時の行動学習2005

    • Author(s)
      中村浩二, 五十嵐治一, 石原聖司
    • Journal Title

      ロボティクス・メカトロニクス講演会'05(ROBOMEC'05)講演論文集

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 方策勾配法を用いたサッカーエージェントの学習〜フリーキック〜2005

    • Author(s)
      中村浩二, 五十嵐治一, 石原聖司
    • Journal Title

      第10回ゲーム・プログラミング・ワークショップ(GPW2005)予稿集,IPSJ Symposium Series Vol.2005,No.15

      Pages: 32-39

    • NAID

      170000080240

    • Related Report
      2005 Annual Research Report
  • [Journal Article] マルチエージェント系における行動学習への方策こう配法の適用-追跡問題-2004

    • Author(s)
      石原聖司, 五十嵐治一
    • Journal Title

      電子情報通信学会論文誌 D-1 Vol.J87-D-1 No.3

      Pages: 390-397

    • NAID

      110003171315

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 近畿大学工学部におけるRoboCupへの取り組み2004

    • Author(s)
      五十嵐治一, 田中一基, 黒瀬能聿, 五百位清
    • Journal Title

      アドバンティ2004シンポジウム講演論文集

      Pages: 1-3

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Applying Policy Gradient Method to Behavior Learning in Multi- Agent Systems-Pursuit Problem- (in Japanese)2004

    • Author(s)
      H.Ishihara, H.Igarashi
    • Journal Title

      The IEICE Trans.Inf.& Syst.(Japanese Edition) Vol.J87-D1, No.3

      Pages: 390-397

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] RoboCup Project Developed at Kinki University (in Japanese)2004

    • Author(s)
      H.Igarashi, K.Tanaka, Y.Kurose, K.Ioi
    • Journal Title

      Proceedings of the ADVANTY 2004 SYMPOSIUM

      Pages: 1-3

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Navigation of a Mobile Robot Formulated in Terms of Discrete Optimization Problems2003

    • Author(s)
      H.Igarashi, H.Ioi
    • Journal Title

      Systems and Computers in Japan Vol.34, No.6

      Pages: 59-68

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Q学習による未知環境下の経路探索-多目的な問題への適用例-2003

    • Author(s)
      飯土井修一, 五十嵐治一, 田中一基
    • Journal Title

      人工知能学会第17回SIG-Challenge研究会資料

      Pages: 1-6

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 方策勾配法を用いた運動方程式中のパラメータ学習〜カーリングにおける事例〜2003

    • Author(s)
      五十嵐治一, 石原聖司
    • Journal Title

      日本ロボット学会第21回学術講演会講演集 (CD-ROM)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 携帯型位置情報取得デバイスの校正実験2003

    • Author(s)
      佐藤泰史, 五百位清, 杉山義春, 結城賢治, 森隆男
    • Journal Title

      計測自動制御学会第4回システムインテグレーション部門学術講演会予稿集

      Pages: 652-653

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Path Search in an Unknown Environment by Q-learning -Application to a Multi-purpose Problem- (in Japanese)2003

    • Author(s)
      S.Iidoi, H.Igarashi, K.Tanaka
    • Journal Title

      Technical Report of The 17th Workshop of SIG-challenge on AI

      Pages: 1-6

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A Policy Gradient Approach to Learning Parameters in the Equations of Motion -Curling Game- (in Japanese)2003

    • Author(s)
      H.Igarashi, S.Ishihara
    • Journal Title

      Proceedings of The 21st Annual Conference of the Robotics Society of Japan 3B11

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Calibration Experiment of a Portable Device for Positional Data Acquisition (in Japanese)2003

    • Author(s)
      Y.Sato, K.Ioi, Y.Sugiyama, K.Yuuki, T.Mori
    • Journal Title

      Proceedings of SICE Symposium on Systems and Information

      Pages: 652-653

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Publications] H.Igarashi, 他: "Navigation of a Mobile Robot Formulated in Terms of Discrete Optimization Problems"Systems and Computers in Japan. Vol.34,No.6. 59-68 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 五十嵐治一, 他: "近畿大学工学部におけるRoboCupへの取り組み"アドバンティ2004シンポジウム講演論文集. 1-3 (2004)

    • Related Report
      2003 Annual Research Report

URL: 

Published: 2003-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi