• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Derivation of a learning principle from irrational behaviors

Research Project

Project/Area Number 21700174
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeSingle-year Grants
Research Field Intelligent informatics
Research InstitutionTamagawa University

Principal Investigator

SAKAI Yutaka  玉川大学, 脳科学研究所, 准教授 (70323376)

Project Period (FY) 2009 – 2012
Project Status Completed (Fiscal Year 2012)
Budget Amount *help
¥3,250,000 (Direct Cost: ¥2,500,000、Indirect Cost: ¥750,000)
Fiscal Year 2012: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2011: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2010: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2009: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Keywords遅延割引 / 学習行動 / 強化学習 / 割引価値問題 / マッチング行動 / 衝動的選好 / 知能機械 / 神経科学 / 動物行動 / 知識獲得
Research Abstract

Animals, including human, apt to prefer immediate returns.The learning framework incorpolating such a behavioral property is established asthe reinforcement learing theory. However, we showed that the applicable range ofthe framework is small and outside of some simple examples of behavioralexperiments of animals. We constructed a novel framework that is always applicablefor animal behaviors and demonstrated that the proposed framework reproduces animal behaviors.

Report

(5 results)
  • 2012 Annual Research Report   Final Research Report ( PDF )
  • 2011 Annual Research Report
  • 2010 Annual Research Report
  • 2009 Annual Research Report
  • Research Products

    (21 results)

All 2012 2011 2010 Other

All Journal Article (4 results) (of which Peer Reviewed: 3 results) Presentation (16 results) (of which Invited: 1 results) Remarks (1 results)

  • [Journal Article] Reinforcement learning for discounted values often loses the goal in the application to animal learning2012

    • Author(s)
      Yamaguchi Y, Sakai Y
    • Journal Title

      Neural networks : the official journal of the International Neural Network Society

      Volume: 35C Pages: 88-91

    • DOI

      10.1016/j.neunet.2012.08.004

    • Related Report
      2012 Annual Research Report 2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] Reinforcing operandum: rapid andreliable learning of skilled forelimbmovements by head-fixed rodents2012

    • Author(s)
      Kimura R, et al. Sakai Y
    • Journal Title

      Journal of Neurophysiology

      Volume: vol.108 Issue: 6 Pages: 1781-1792

    • DOI

      10.1152/jn.00356.2012

    • Related Report
      2012 Annual Research Report 2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] A theoreticalapproach to animal's impulsivepreference: Impulsive choice behavioris interpreteded as a result of rewardmaximization failure2012

    • Author(s)
      Yamaguchi Y, Sakai Y
    • Journal Title

      Proceedings ofSCIS-ISIS2012, Kobe, Japan

      Volume: Nov. 20-24 Pages: 1182-1185

    • DOI

      10.1109/scis-isis.2012.6505271

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] シナプス可塑性と学習-新たな学習原理の発見へ2010

    • Author(s)
      酒井裕
    • Journal Title

      未来材料

      Volume: 10 Pages: 67-72

    • Related Report
      2010 Annual Research Report
  • [Presentation] Impulsivepreference emerges as a result fromreward-maximization failure2012

    • Author(s)
      Yamaguchi Y, Sakai Y
    • Organizer
      第35回日本神経科学大会
    • Place of Presentation
      名古屋
    • Year and Date
      2012-09-19
    • Related Report
      2012 Final Research Report
  • [Presentation] 割引価値問題は被験者の戦略によって不良設定問題となる2011

    • Author(s)
      山口良哉,酒井裕
    • Organizer
      日本神経回路学会 第21回全国大会
    • Place of Presentation
      沖縄
    • Year and Date
      2011-12-15
    • Related Report
      2012 Final Research Report
  • [Presentation] 割引価値問題は被験者の戦略によって不良設定問題となる2011

    • Author(s)
      酒井裕
    • Organizer
      日本神経回路学会第21回全国大会
    • Place of Presentation
      沖縄科学技術大学院大学(沖縄県)
    • Year and Date
      2011-12-15
    • Related Report
      2011 Annual Research Report
  • [Presentation] 非合理行動の背後にある合理的学習戦略2011

    • Author(s)
      酒井裕
    • Organizer
      日本基礎心理学会 第30回大会
    • Place of Presentation
      横浜
    • Year and Date
      2011-12-04
    • Related Report
      2012 Final Research Report
  • [Presentation] 非合理行動の背後にある合理的な学習戦略2011

    • Author(s)
      酒井裕
    • Organizer
      日本基礎心理学会第30回大会
    • Place of Presentation
      慶義塾大学日吉キャンパス(神奈川県)(招待講演)
    • Year and Date
      2011-12-04
    • Related Report
      2011 Annual Research Report
  • [Presentation] The reward-maximization learning indifferent to historical state reproduces the preference reversal in intertemporal choice2011

    • Author(s)
      Sakai Y
    • Organizer
      The 34th annual meeting of the Japan neuroscience society
    • Place of Presentation
      パシフィコ横浜(神奈川県)
    • Year and Date
      2011-09-17
    • Related Report
      2011 Annual Research Report
  • [Presentation] Discounted value problem becomes ill-posed by subject's strategy2011

    • Author(s)
      Sakai Y
    • Organizer
      The 8th IBRO World Congress of Neuroscience
    • Place of Presentation
      Fortezza da Basso (Florence, Italy)
    • Year and Date
      2011-07-17
    • Related Report
      2011 Annual Research Report
  • [Presentation] Discountedvalue problem becomes ill-posed bysubject's strategy2011

    • Author(s)
      Yamaguchi Y, Sakai Y
    • Organizer
      8th IBRO
    • Place of Presentation
      Florence, Italy
    • Year and Date
      2011-07-16
    • Related Report
      2012 Final Research Report
  • [Presentation] 強化学習における時間割引の再考2011

    • Author(s)
      山口良哉,酒井裕
    • Organizer
      日本物理学会 第66回年次大会
    • Place of Presentation
      新潟
    • Year and Date
      2011-03-25
    • Related Report
      2012 Final Research Report
  • [Presentation] 強化学習における時間割引の再考2011

    • Author(s)
      酒井裕
    • Organizer
      日本物理学会 第66回年次大会
    • Place of Presentation
      新潟大学(新潟県)
    • Year and Date
      2011-03-25
    • Related Report
      2010 Annual Research Report
  • [Presentation] Purpose orStrategy? Reconsideration of temporaldiscount in non-Markov situation2010

    • Author(s)
      Yamaguchi Y, Sakai Y
    • Organizer
      第33回日本神経科学大会
    • Place of Presentation
      神戸
    • Year and Date
      2010-09-04
    • Related Report
      2012 Final Research Report
  • [Presentation] Purpose or Strategy? Reconsideration of temporal discount in non-Markov situation2010

    • Author(s)
      Sakai, Y.
    • Organizer
      Neuro 2010
    • Place of Presentation
      神戸コンベンションセンター(兵庫県)
    • Year and Date
      2010-09-04
    • Related Report
      2010 Annual Research Report
  • [Presentation] A hypothesis ofefficient learning rule: dopaminedependent metaplasticity2010

    • Author(s)
      Yutaka Sakai
    • Organizer
      第33回日本神経科学大会
    • Place of Presentation
      神戸
    • Year and Date
      2010-09-03
    • Related Report
      2012 Final Research Report
  • [Presentation] A hypothesis of efficient learning rule : dopamine-dependent metaplasticity2010

    • Author(s)
      Sakai, Y.
    • Organizer
      Neuro 2010
    • Place of Presentation
      神戸コンベンションセンター(兵庫県)
    • Year and Date
      2010-09-03
    • Related Report
      2010 Annual Research Report
  • [Presentation] A theoretical approach to animal's impulsive preference - Impulsive choice behavior is interpreted as a result of reward-maximization failure

    • Author(s)
      Yoshiya Yamaguchi
    • Organizer
      SCIS-ISIS2012
    • Place of Presentation
      神戸コンベンションセンター(兵庫県)
    • Related Report
      2012 Annual Research Report
    • Invited
  • [Presentation] Impulsive preference emerges as a result from reward-maximization failure

    • Author(s)
      Yoshiya Yamaguchi
    • Organizer
      Neuroscience 2012
    • Place of Presentation
      名古屋国際会議場(愛知県)
    • Related Report
      2012 Annual Research Report
  • [Remarks]

    • URL

      http://spike.lab.tamagawa.ac.jp/

    • Related Report
      2012 Final Research Report

URL: 

Published: 2009-04-01   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi