• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A challenge towards how far the emergence of higher functions can be explained by reinforcement learning using a neural network

Research Project

Project/Area Number 19300070
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Perception information processing/Intelligent robotics
Research InstitutionOita University

Principal Investigator

SHIBATA Katsunari  Oita University, 工学部, 准教授 (10260522)

Project Period (FY) 2007 – 2010
Project Status Completed (Fiscal Year 2010)
Budget Amount *help
¥7,800,000 (Direct Cost: ¥6,000,000、Indirect Cost: ¥1,800,000)
Fiscal Year 2010: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2009: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2008: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2007: ¥3,380,000 (Direct Cost: ¥2,600,000、Indirect Cost: ¥780,000)
Keywords知能ロボット / 強化学習 / ニューラルネット / 高次機能 / リカレントニューラルネット / コミュニケーション学習 / エッジ画像 / 適正度の履歴 / 色の恒常性 / 知能創発 / 高次機能創発 / シンボル / 予測 / 探索 / 記憶 / 意味付け / 自律学習 / 合目的性 / 離散状態遷移 / 乗算ニューロン / 決定論的知的探索 / 空間的抽象化 / 時間的抽象化
Research Abstract

Emergence of higher functions has been aimed based on autonomous learning by reinforcement learning using a neural network that connects from sensors to motors. Although no significant fruits could be shown as for the emergence of symbol processing, but the emergence of "abstraction", "memory", "prediction", or "exploration" through the learning from only rewards and punishments has been shown. For example, in the learning of a task using a movable camera in which the identification and memorization of arrow direction are necessary to get a reward, extraction of arrow direction from images and memorization of it were realized.

Report

(6 results)
  • 2010 Annual Research Report   Final Research Report ( PDF )
  • 2009 Annual Research Report   Self-evaluation Report ( PDF )
  • 2008 Annual Research Report
  • 2007 Annual Research Report
  • Research Products

    (40 results)

All 2011 2010 2009 2008 2007 Other

All Journal Article (21 results) (of which Peer Reviewed: 16 results) Presentation (12 results) Book (4 results) Remarks (3 results)

  • [Journal Article] Acquisition of Deterministic Exploration and Purposive Memory through Reinforcement Learning with a Recurrent Neural Network2010

    • Author(s)
      Kenta Goto, Katsunari Shibata
    • Journal Title

      Proc.of SICE Annual Conf. 2010

    • Related Report
      2010 Final Research Report
    • Peer Reviewed
  • [Journal Article] Emergence of prediction by reinforcement learning using a recurrent neural network2010

    • Author(s)
      Kenta Goto, Katsunari Shibata
    • Journal Title

      Journal of Robotics Vol.2010

    • Related Report
      2010 Final Research Report
    • Peer Reviewed
  • [Journal Article] Acquisition of Deterministic Exploration and Purposive Memory throuh Reinforcement Learning with a Recurrent Neural Network2010

    • Author(s)
      Kenta Goto, Katsunari Shibata
    • Journal Title

      Proc.of SICE Annual Conf.2010

      Volume: (CD-ROM)

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Learning of Camera Motion and Object Recognition Using Actor-Q Architecture2010

    • Author(s)
      Armad Afif Mohd Faudi, Katsunari Shibata
    • Journal Title

      Proc.of SICE Annual Conf.2010

      Volume: (CD-ROM)

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Emergence of prediction by reinforcement learning using a recurrent neural network2010

    • Author(s)
      Kenta Goto, Katsunari Shibata
    • Journal Title

      Journal of Robotics

      Volume: 2010

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Acquisition of Flexible Image Recognition by Coupling of Reinforcement Learning and a Neural Network2009

    • Author(s)
      Katsunari Shibata, Tomohiko Kawano
    • Journal Title

      SICE Journal of Control, Measurement, and System Integration (JCMSI) Vol.2, No.2

      Pages: 122-129

    • NAID

      10031152631

    • Related Report
      2010 Final Research Report
    • Peer Reviewed
  • [Journal Article] Learning of Action Generation from Raw Camera Images in a Real-World-like Environment by Simple Coupling of Reinforcement Learning and a Neural Network2009

    • Author(s)
      Katsunari Shibata, Tomohiko Kawano
    • Journal Title

      Advances in Neuro-Information Processing, Lecture Notes in Computer Science Vol.5506

      Pages: 755-762

    • Related Report
      2009 Self-evaluation Report
    • Peer Reviewed
  • [Journal Article] Contextual Behavior and Internal Representations Acquired by Reinforcement Learning with a Recurrent Neural Network in a Continuous State and Action Space Task2009

    • Author(s)
      Hioroki Utsunomiya, Katsunari Shibata
    • Journal Title

      Lecture Notes in Computer Science Vol.5507

      Pages: 970-978

    • Related Report
      2009 Self-evaluation Report
    • Peer Reviewed
  • [Journal Article] Learning of Action Generation from Raw Camera Images in a Real-World-like Environment by Simple Coupling of Reinforcement Learning and a Neural Network2009

    • Author(s)
      Katsunari Shibata, Tomohiko Kawano
    • Journal Title

      Advances in Neuro-Information Processing, Lecture Notes in Computer Science 5506

      Pages: 755-762

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Improvement of Practical Recurrent Learning Method and Application to a Pattern Classification Task2009

    • Author(s)
      Mohamad Faizal Bin Samsudin, Katsunari Shibata
    • Journal Title

      Advances in Neuro-Information Processing, Lecture Notes in Computer Science 5507

      Pages: 631-638

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Contextual Behavior and Internal Representations Acquired by Reinforcement Learning with a Recurrent Neural Network in a Continuous State and Action Space Task2009

    • Author(s)
      Hioroki Utsumomiya, Katsunari Shibata
    • Journal Title

      Advances in Neuro-Information Processing, Lecture Notes in Computer Science 5507

      Pages: 970-978

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Effect of number of hidden neurons on learning in large-scale layered neural networks2009

    • Author(s)
      Katsunari Shibata, Yusuke Ikeda
    • Journal Title

      Proc.of ICCAS-SICE(ICROS-SICE Int'l Joint Conf.)2009

      Pages: 5008-5013

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Acquisition of Flexible Image Recognition by Coupling of Reinforcement Learning and a Neural Network2008

    • Author(s)
      Katsunari Shibata, Tomohiko Kawano
    • Journal Title

      SICE Journal of Control, Measurement, and System Integration (JCMSI) Vol.2, No.2

    • NAID

      10031152631

    • Related Report
      2009 Self-evaluation Report
    • Peer Reviewed
  • [Journal Article] Practical Recurrent Learning (PRL)in the Discrete Time Domain2008

    • Author(s)
      Mohamad Faizal Bin Samsudin, Takeshi. Hirose, Katsunari. Shibata
    • Journal Title

      Neural Information Processing of Lecture Notes in Computer Science, (Proc. of Intl Conf. on Neural Information Processing System) Vol. 4984

      Pages: 228-237

    • Related Report
      2008 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Acquisition of Flexible Image Recognition by Coupling of Reinforcement Leaming and a Neural Network2008

    • Author(s)
      Katsunari Shibata, Tomohiko Kawano
    • Journal Title

      SICE Journal of Control, Measurement, and System Integration (JCMSI) Vol. 2, No. 2

      Pages: 122-129

    • Related Report
      2008 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 強化学習により対象物検出行動を学習した画像入力ニューラルネットにおける中間層ニューロンの解析2008

    • Author(s)
      柴田克成, 河野友彦
    • Journal Title

      第18回インテリジェント・システム・シンポジウム(FAN2008)講演予稿集

      Pages: 145-150

    • Related Report
      2008 Annual Research Report
  • [Journal Article] リカレントネットを用いた強化学習による記憶を利用した探索行動の学習2008

    • Author(s)
      後藤健太, 柴田克成
    • Journal Title

      第61回電気関係学会九州支部連合大会講演論文集 (CD-ROM)

    • NAID

      130005033184

    • Related Report
      2008 Annual Research Report
  • [Journal Article] Practical Recurrent Learning (PRL) in the Discrete Time Domain2007

    • Author(s)
      Mohamad Faizal Bin Samsudin, Takeshi. Hirose, Katsunari. Shibata
    • Journal Title

      Proc. of Int'l Conf. on Neural Information Processing System (CD-ROM)

    • Related Report
      2007 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 画像入カニューラルネットを用いた強化学習による可動カメラの対象物検出行動2007

    • Author(s)
      河野友彦, 幸和芳, 柴田克成
    • Journal Title

      第26回計測自動制御学会九州支部学術講演会予稿集

      Pages: 155-158

    • Related Report
      2007 Annual Research Report
  • [Journal Article] リカレント型ニューラルネットの実用的な学習則である離散時間PRL学習法2007

    • Author(s)
      Mohamad Faizal Bin Samsudin, 廣瀬武志, 柴田克成
    • Journal Title

      第26回計測自動制御学会九州支部学術講演会予稿集

      Pages: 57-60

    • Related Report
      2007 Annual Research Report
  • [Journal Article] 複数の隠れニューロンの生成が可能な成長型ニューラルネットの構築2007

    • Author(s)
      由崎高志, 柴田克成
    • Journal Title

      第26回計測自動制御学会九州支部学術講演会予稿集

      Pages: 53-56

    • Related Report
      2007 Annual Research Report
  • [Presentation] 強化学習によるパターンの意味付けと記憶に基づく行動の獲得2010

    • Author(s)
      柴田克成, 沢津橋由人, 宇都宮浩樹
    • Organizer
      計測自動制御学会九州支部学術講演会
    • Place of Presentation
      宮崎大学
    • Year and Date
      2010-12-05
    • Related Report
      2010 Final Research Report
  • [Presentation] 可動カメラを用いたActor-Q学習による能動認識の学習2010

    • Author(s)
      Armad Afif bin Mohd Faudi, 柴田克成
    • Organizer
      計測自動制御学会九州支部学術講演会
    • Place of Presentation
      宮崎大学
    • Year and Date
      2010-12-05
    • Related Report
      2010 Final Research Report
  • [Presentation] 強化学習によるパターンの意味付けと記憶に基づく行動の獲得2010

    • Author(s)
      柴田克成, 沢津橋由人, 宇都宮浩樹
    • Organizer
      SICE九州支部学術講演会
    • Place of Presentation
      宮崎大学
    • Year and Date
      2010-12-05
    • Related Report
      2010 Annual Research Report
  • [Presentation] 可動カメラを用いたActor-Q学習による能動認識の学習2010

    • Author(s)
      Armad Afif bin Mohd Faudi, 柴田克成
    • Organizer
      SICE九州支部学術講演会
    • Place of Presentation
      宮崎大学
    • Year and Date
      2010-12-05
    • Related Report
      2010 Annual Research Report
  • [Presentation] 強化学習とリカレントネットを用いた並列で柔軟な学習制御システムの枠組み2010

    • Author(s)
      高津聡志, 柴田克成
    • Organizer
      SICE九州支部学術講演会
    • Place of Presentation
      宮崎大学
    • Year and Date
      2010-12-04
    • Related Report
      2010 Annual Research Report 2010 Final Research Report
  • [Presentation] ニューラルネットを用いた強化学習による空間情報の抽象化と知識継承2009

    • Author(s)
      柴田克成
    • Organizer
      SICE九州支部学術講演会
    • Place of Presentation
      九州大学伊都キャンパス
    • Year and Date
      2009-11-29
    • Related Report
      2009 Annual Research Report
  • [Presentation] ニューラルネットと強化学習を用いた音声によるコミュニケーションの自律学習2009

    • Author(s)
      笹原冬月, 柴田克成
    • Organizer
      SICE九州支部学術講演会
    • Place of Presentation
      九州大学伊都キャンパス
    • Year and Date
      2009-11-29
    • Related Report
      2009 Annual Research Report
  • [Presentation] リカレントニューラルネットを用いた強化学習による予測機能の創発2009

    • Author(s)
      後藤健太, 松本康生, 柴田克成
    • Organizer
      SICE九州支部学術講演会
    • Related Report
      2009 Annual Research Report 2009 Self-evaluation Report
  • [Presentation] Improvement of Practical Recurrent Learning Method and Application into a Patt em Classification Task2008

    • Author(s)
      Mohamad Faizal Samsudin, Katsunari Shibata
    • Organizer
      Int'l Conf. on Neural Information Processing System (ICONIP)08
    • Place of Presentation
      Auckland, New Zealand
    • Year and Date
      2008-11-27
    • Related Report
      2008 Annual Research Report
  • [Presentation] Contextual Behaviors and Internal Representations Acquired by Reinforcement Leaming with a Recurrent Neural Network in a Continuous State and Action Space Task2008

    • Author(s)
      Hiroki, Utsunomiya, Katsunari Shibata
    • Organizer
      Int'l Conf. 0n Neural Information Processing System (ICONIP)08
    • Place of Presentation
      Auckland, New Zealand
    • Year and Date
      2008-11-27
    • Related Report
      2008 Annual Research Report
  • [Presentation] Learning of Action Generation from Raw Camera Images in a Real-World-like Environment by Simple Coupling of Reinforcement Learning and a Neural Network2008

    • Author(s)
      Katsunari Shibata, Tomohiko Kawano
    • Organizer
      Int'l Conf. on Neural Information Processing System (ICONIP)08
    • Place of Presentation
      Auckland, New Zealand
    • Year and Date
      2008-11-26
    • Related Report
      2008 Annual Research Report
  • [Presentation] リカレントネットを用いた強化学習による記憶を利用した探索行動の学習2008

    • Author(s)
      後藤健太, 柴田克成
    • Organizer
      電気関係学会九州支部連合大会
    • Related Report
      2009 Self-evaluation Report
  • [Book] Emergence of Intelligence through Reinforcement Learning with a Neural Network(Advances in Reinforcement Learning, InTech)(Abdelhamid Mellouk (Ed.))2011

    • Author(s)
      柴田克成
    • Related Report
      2010 Final Research Report
  • [Book] ニューラルネットワーク(「ロボット情報学ハンドブック」,ナノオプトニクスエナジー,第7.5節)2010

    • Author(s)
      柴田克成
    • Related Report
      2010 Final Research Report
  • [Book] Advances in Reinforcement Learning2010

    • Author(s)
      Katsunari Shibata
    • Publisher
      InTech
    • Related Report
      2010 Annual Research Report
  • [Book] 「ロボット情報学ハンドブック」(第7.5節 ニューラルネットワークのみ)2010

    • Author(s)
      柴田克成
    • Total Pages
      13
    • Publisher
      ナノオプトニクスエナジー
    • Related Report
      2009 Annual Research Report
  • [Remarks] ホームページ等

    • Related Report
      2010 Final Research Report
  • [Remarks] 解説記事:柴田克成、強化学習とニューラルネットによる知能創発,計測と制御, Vol. 48, No. 1, pp. 106--111, 2009.1 webページ

    • URL

      http://shws.cc.oita-u.ac.jp/~shibata/home-j.html

    • Related Report
      2008 Annual Research Report
  • [Remarks]

    • URL

      http://shws.cc.oita-u.ac.jp/~shibata/home-j.html

    • Related Report
      2007 Annual Research Report

URL: 

Published: 2007-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi