• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Involvement of dopamine system and orbito frontal cortex in update and memory of value signals

Research Project

Project/Area Number 20240040
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Research Field Neurophysiology and muscle physiology
Research InstitutionTamagawa University (2010)
Kyoto Prefectural University of Medicine (2008-2009)

Principal Investigator

KIMURA Minoru  Kyoto Prefectural University of Medicine, 脳科学研究所, 教授 (40118451)

Co-Investigator(Kenkyū-buntansha) MATSUMOTO Naoyuki  京都府立医科大学, 医学研究科, 講師 (00252726)
Project Period (FY) 2008 – 2010
Project Status Completed (Fiscal Year 2010)
Budget Amount *help
¥50,180,000 (Direct Cost: ¥38,600,000、Indirect Cost: ¥11,580,000)
Fiscal Year 2010: ¥19,500,000 (Direct Cost: ¥15,000,000、Indirect Cost: ¥4,500,000)
Fiscal Year 2009: ¥14,690,000 (Direct Cost: ¥11,300,000、Indirect Cost: ¥3,390,000)
Fiscal Year 2008: ¥15,990,000 (Direct Cost: ¥12,300,000、Indirect Cost: ¥3,690,000)
Keywordsドーパミンニューロン / 線条体 / 価値判断 / 報酬予測 / 報酬予測誤差 / 試行錯誤 / 目標・ゴール / 教科学習 / 強化学習 / システム神経生理 / ニューロインフォマティクス
Research Abstract

We examined whether the midbrain dopamine neurons encode signals of long-term reward prediction and its error. Three Japanese monkeys performed multi-step choices for 3 rewards. Anticipatory licking during the task performance showed that monkey's expectation did not reflect reward probability of individual trials but precisely reflected reward value (probability x volume) of expected total rewards with future rewards discounted, value function of reinforcement learning. Remarkably, dopamine neuron activity encoded the long-term reward prediction rather than reward value of individual trials. The results suggested that the dopamine signals of long-term reward prediction may play critical roles in update of value signals for directing future goals in the target structures such as the striatum.

Report

(4 results)
  • 2010 Annual Research Report   Final Research Report ( PDF )
  • 2009 Annual Research Report
  • 2008 Annual Research Report
  • Research Products

    (40 results)

All 2011 2010 2009 2008

All Journal Article (12 results) (of which Peer Reviewed: 12 results) Presentation (24 results) Book (4 results)

  • [Journal Article] Inactivation of the putamen selectively impairs reward history-based action selection.2011

    • Author(s)
      Muranishi M, Inokawa H, Yamada H, Ueda Y, Matsumoto N, Nakagawa M, Kimura M.
    • Journal Title

      Exp Brain Res. 209(2)

      Pages: 235-246

    • URL

      http://www.springerlink.com/content/9206161690133t47/

    • Related Report
      2010 Final Research Report
    • Peer Reviewed
  • [Journal Article] Inactivation of the putamen selectively impairs reward history-based action selection.2011

    • Author(s)
      Muranishi M.
    • Journal Title

      Exp Brain Res.

      Volume: 209(2) Pages: 235-246

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Juxtacellular labeling of tonically active neurons and phasically active neurons in the rat striatum.2010

    • Author(s)
      Inokawa H, Yamada H, Matsumoto N, Muranishi M, Kimura M.
    • Journal Title

      Neuroscience 168(2)

      Pages: 395-404

    • URL

      http://www.sciencedirect.com/science/article/pii/S0306452210004975

    • Related Report
      2010 Final Research Report
    • Peer Reviewed
  • [Journal Article] Juxtacellular labeling of tonically active neurons and phasically active neurons in the rat striatum.2010

    • Author(s)
      Inokawa H.
    • Journal Title

      Neuroscience.

      Volume: 168(2) Pages: 395-404

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Juxtacellular labeling of tonically active neurons (TANs) and phasically active neurons (PANs) in the rat striatum.2010

    • Author(s)
      Inokawa H, Yamada H, Matsumoto N, Muranishi M., Kimura, M.
    • Journal Title

      Neuroscience (印刷中)

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Optical imaging of interaural time difference representation in rat auditory cortex.2009

    • Author(s)
      Tsytsarev V, Fukuyama H, Pope D, Pumbo E., Kimura M.
    • Journal Title

      Front. Neuroeng. 2:2

    • URL

      http://www.frontiersin.org/neuroengineering/10.3389/neuro.16.002.2009/abstract

    • Related Report
      2010 Final Research Report
    • Peer Reviewed
  • [Journal Article] Roles of the thalamic CM-PF complex?Basal ganglia circuit in externally driven rebias of action.2009

    • Author(s)
      Minamimoto T, Hori Y., Kimura M.
    • Journal Title

      Brain Res.Bull. 78

      Pages: 75-79

    • URL

      http://www.sciencedirect.com/science/article/pii/S0361923008002906

    • Related Report
      2010 Final Research Report
    • Peer Reviewed
  • [Journal Article] Neuronal encoding of reward value and direction of actions in the primate putamen.2009

    • Author(s)
      Hori Y, Minamimoto T, Kimura M.
    • Journal Title

      J Neurophysiol 102

      Pages: 3530-3543

    • URL

      http://jn.physiology.org/content/102/6/3530.full

    • Related Report
      2010 Final Research Report
    • Peer Reviewed
  • [Journal Article] Neuronal encoding of reward value and direction of actions in the primate putamen.2009

    • Author(s)
      Hori Y, Minamimoto T., Kimura M.
    • Journal Title

      J Neurophysiol 102(6)(●)

      Pages: 3530-3543

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Roles of the thalamic CM-PF complex-Basal ganglia circuit in externally driven rebias of action.2009

    • Author(s)
      Minamimoto T, Hori Y., Kimura M.
    • Journal Title

      Brain Res Bull 78(●)

      Pages: 75-79

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Role of the thalamic CM-PF complex-Basal ganglia circuit in externally driven rebias of action.2009

    • Author(s)
      Minamimoto T, Hori Y. & Kimura M.
    • Journal Title

      Brain Research Bulletin 78

      Pages: 75-79

    • Related Report
      2008 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Optical imaging of interaural time difference representation in rat auditory cortex.2009

    • Author(s)
      Tsytsarev V, Fukuyama H, Pope D, Pumbo E. & Kimura M.
    • Journal Title

      Front Neuroeng 2

      Pages: 2-2

    • Related Report
      2008 Annual Research Report
    • Peer Reviewed
  • [Presentation] Value signals for decision and action selection in the basal ganglia.2011

    • Author(s)
      Kimura M, Enomoto K, Yamanaka K.
    • Organizer
      Janelia Conference Neural Circuits of Decision-Making
    • Place of Presentation
      Janelia Farm Research Campus, VA, USA
    • Year and Date
      2011-03-06
    • Related Report
      2010 Final Research Report
  • [Presentation] Value signals for decision and action selection in the basal ganglia2011

    • Author(s)
      Kimura M.
    • Organizer
      Janelia Conference Neural Circuits of Decision-Making
    • Place of Presentation
      Janelia Farm Research Campus, VA, USA
    • Year and Date
      2011-03-06
    • Related Report
      2010 Annual Research Report
  • [Presentation] Differential encoding of reward value and its prediction error by dopamine neurons located in ventromedial and dorsolateral parts of the midbrain.2010

    • Author(s)
      Enomoto K, Matsumoto N, Haruno M, Kimura M.
    • Organizer
      The 40th annual meeting of Society for Neuroscience.
    • Place of Presentation
      San Diego, USA
    • Year and Date
      2010-11-17
    • Related Report
      2010 Final Research Report
  • [Presentation] Differential encoding of reward value and its prediction error by dopamine neurons located in ventromedial and dorsolateral parts of the midbrain2010

    • Author(s)
      Enomoto K.
    • Organizer
      The 40th annual meeting of Society for Neuroscience
    • Place of Presentation
      San Diego, USA
    • Year and Date
      2010-11-17
    • Related Report
      2010 Annual Research Report
  • [Presentation] Top-down signal from the frontal cortex regulates social value orientation.2010

    • Author(s)
      Haruno M, Frith C, Sakagami M, Kimura M.
    • Organizer
      第33回日本神経科学大会
    • Place of Presentation
      神戸国際会議場,兵庫県
    • Year and Date
      2010-09-04
    • Related Report
      2010 Final Research Report
  • [Presentation] Top-down signal from the frontal cortex regulates social value orientation.2010

    • Author(s)
      Haruno M.
    • Organizer
      第33回日本神経科学大会
    • Place of Presentation
      神戸国際会議場, 兵庫県
    • Year and Date
      2010-09-04
    • Related Report
      2010 Annual Research Report
  • [Presentation] Dopamine neurons in ventromedial and dorsolateral part of the midbrain differentially encode reward value and its error.2010

    • Author(s)
      Enomoto K, Matsumoto N, Haruno M, Kimura M.
    • Organizer
      33回日本神経科学大会
    • Place of Presentation
      神戸国際会議場,兵庫県
    • Year and Date
      2010-09-03
    • Related Report
      2010 Final Research Report
  • [Presentation] Dopamine neurons in ventromedial and dorsolateral part of the midbrain differentially encode reward value and its error.2010

    • Author(s)
      Enomoto K.
    • Organizer
      第33回日本神経科学大会
    • Place of Presentation
      神戸国際会議場, 兵庫県
    • Year and Date
      2010-09-03
    • Related Report
      2010 Annual Research Report
  • [Presentation] ご褒美と罰によって私達の行動を司る脳のしくみ2010

    • Author(s)
      木村實
    • Organizer
      包括的脳科学研究・教育センター設立記念シンポジウム
    • Place of Presentation
      東北大学,宮城県
    • Year and Date
      2010-01-16
    • Related Report
      2010 Final Research Report
  • [Presentation] ご褒美と罰によって私達の行動を司る脳のしくみ2010

    • Author(s)
      木村實
    • Organizer
      包括的脳科学研究・教育センター設立記念シンポジウム.(シンポジウム特別講演)
    • Place of Presentation
      仙台(東北大学)
    • Year and Date
      2010-01-16
    • Related Report
      2009 Annual Research Report
  • [Presentation] Neuronal basis of action valuation and selection in the basal ganglia.2009

    • Author(s)
      Kimura M.
    • Organizer
      International Symposium : New Perspectives on Neural Mechanisms of Cognition and Action.
    • Place of Presentation
      玉川大学,東京都
    • Year and Date
      2009-11-13
    • Related Report
      2010 Final Research Report
  • [Presentation] Neuronal basis of action valuation and selection in the basal ganglia.2009

    • Author(s)
      Kimura M.
    • Organizer
      International Symposium : New Perspectives on Neural Mechanisms of Cognition and Action.(シンポジウム特別講演)
    • Place of Presentation
      東京(玉川大学)
    • Year and Date
      2009-11-13
    • Related Report
      2009 Annual Research Report
  • [Presentation] 被殻の機能脱落は状態価値ではなく行動価値を障害する2009

    • Author(s)
      村西学,井之川仁,山田洋,木村實
    • Organizer
      第32回日本神経科学大会
    • Place of Presentation
      名古屋国際会議場,愛知県
    • Year and Date
      2009-09-17
    • Related Report
      2010 Final Research Report
  • [Presentation] 被殻の機能脱落は状態価値ではなく行動価値を障害する2009

    • Author(s)
      村西学, 井之川仁, 山田洋, 木村實
    • Organizer
      第32回日本神経科学大会(ポスター発表)
    • Place of Presentation
      名古屋(名古屋国際会議場)
    • Year and Date
      2009-09-17
    • Related Report
      2009 Annual Research Report
  • [Presentation] サルの視床CM核細胞の報酬予告と行動に対する応答2009

    • Author(s)
      山中航,堀由紀子,上田康雅,木村實
    • Organizer
      第32回日本神経科学大会
    • Place of Presentation
      名古屋国際会議場,愛知県
    • Year and Date
      2009-09-16
    • Related Report
      2010 Final Research Report
  • [Presentation] ドーパミン細胞は複数のステップで得られる総報酬量に基づく報酬価値とその誤差を表現する2009

    • Author(s)
      榎本一紀,松本直幸,木村實
    • Organizer
      第32回日本神経科学学会大会
    • Place of Presentation
      名古屋国際会議場(愛知県)
    • Year and Date
      2009-09-16
    • Related Report
      2010 Final Research Report
  • [Presentation] ドーパミン細胞は複数のステップで得られる総報酬量に基づく報酬価値とその誤差を表現する2009

    • Author(s)
      榎本一紀, 松本直幸, 木村實
    • Organizer
      第32回日本神経科学大会(ポスター発表)
    • Place of Presentation
      名古屋(名古屋国際会議場)
    • Year and Date
      2009-09-16
    • Related Report
      2009 Annual Research Report
  • [Presentation] サルの視床CM核細胞の報酬予告と行動に対する応答2009

    • Author(s)
      山中航, 堀由紀子, 上田康雅, 木村實
    • Organizer
      第32回日本神経科学大会(ポスター発表)
    • Place of Presentation
      名古屋(名古屋国際会議場)
    • Year and Date
      2009-09-16
    • Related Report
      2009 Annual Research Report
  • [Presentation] Involvement of the basal ganglia in valuation and selection of actions.2009

    • Author(s)
      Kimura M, Yamada H, Enomoto K, Matsumoto N, Hori Y, Ueda Y., Yamanaka K.
    • Organizer
      The 36th Congress of the International Union of Physiological Sciences (IUPS2009)
    • Place of Presentation
      国立京都国際会館,京都府
    • Year and Date
      2009-07-29
    • Related Report
      2010 Final Research Report
  • [Presentation] Involvement of the basal ganglia in valuation and selection of actions.2009

    • Author(s)
      Kimura M, Yamada H, Enomoto K, Matsumoto N, Hori Y, Ueda Y., Yamanaka K.
    • Organizer
      The 36^<th> Congress of the International Union of Physiological Sciences(IUPS 2009)(シンポジウム特別講演)
    • Place of Presentation
      京都(京都国際会館)
    • Year and Date
      2009-07-29
    • Related Report
      2009 Annual Research Report
  • [Presentation] Adaptation of reward-based free-choices is impaired by D1 but not D2 dopamine receptor antagonist in the striatum.2008

    • Author(s)
      Ueda Y, Samejima K, Yamanaka K, Doya K, Kimura M.
    • Organizer
      The 38th annual meeting of Society for Neuroscience.
    • Place of Presentation
      Washington DC, USA.
    • Year and Date
      2008-11-17
    • Related Report
      2008 Annual Research Report
  • [Presentation] Adaptation of reward-based free-choices is impaired by D1 but not D2 dopamine receptor antagonist in the striatum.2008

    • Author(s)
      Ueda Y, Samejima K, Yamanaka K, Doya K, Kimura M.
    • Organizer
      The 38th annual meeting of Society for Neuroscience
    • Place of Presentation
      Washington DC, USA
    • Year and Date
      2008-11-16
    • Related Report
      2010 Final Research Report
  • [Presentation] 被殻へのムシモル注入による報酬価値に基づく行動選択の障害2008

    • Author(s)
      村西学,井之川仁,山田洋,木村實
    • Organizer
      第31回日本神経科学大会
    • Place of Presentation
      東京国際フォーラム,東京都
    • Year and Date
      2008-07-10
    • Related Report
      2010 Final Research Report
  • [Presentation] 被殻へのムシモル注入による報酬価値に基づく行動選択の障害2008

    • Author(s)
      村西 学, 井之川 仁, 山田 洋, 木村 實.
    • Organizer
      第31回日本神経科学大会
    • Place of Presentation
      東京
    • Year and Date
      2008-07-10
    • Related Report
      2008 Annual Research Report
  • [Book] Encyclopedia of Neuroscience. (Sensorimotor Learning and the Basal Ganglia)2009

    • Author(s)
      Kimura M., Ueda Y.
    • Publisher
      Springer
    • Related Report
      2010 Final Research Report
  • [Book] Neuroeconomics : Decision Making and the Brain2009

    • Author(s)
      Doya K. & Kimura M.
    • Total Pages
      538
    • Publisher
      Academic Press
    • Related Report
      2008 Annual Research Report
  • [Book] Neuroeconomics : Decision Making and the Brain. (The basal ganglia and the encoding of value.)2008

    • Author(s)
      Doya K., Kimura M.
    • Publisher
      Academic Press
    • Related Report
      2010 Final Research Report
  • [Book] Encyclopedia of Neuroscience(分担執筆Sensorimotor Learning and the Basal Ganglia の項)2008

    • Author(s)
      Kimura M. & Ueda Y.
    • Total Pages
      4399
    • Publisher
      Springer
    • Related Report
      2008 Annual Research Report

URL: 

Published: 2008-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi