Long-term reward value coding by midbrain dopamine neurons

• Project/Area Number: 23700503
• Research Category: Grant-in-Aid for Young Scientists (B)
• Allocation Type: Multi-year Fund
• Research Field: Fusional social brain science
• Research Institution: Tamagawa University
• Principal Investigator: ENOMOTO Kazuki 玉川大学, 脳科学研究所, 嘱託研究員 (10585904)
• Project Period (FY): 2011 – 2012
• Project Status: Completed (Fiscal Year 2012)
• Budget Amount: ¥3,770,000 (Direct Cost: ¥2,900,000、Indirect Cost: ¥870,000); Fiscal Year 2012: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000); Fiscal Year 2011: ¥2,340,000 (Direct Cost: ¥1,800,000、Indirect Cost: ¥540,000)
• Keywords: ドーパミン / 霊長類 / 報酬価値 / 予測誤差 / 意思決定 / 強化学習 / 大脳基底核 / 神経化学 / 報酬 / 学習 / 生理学 / 神経科学

Research Abstract

We showed that midbrain dopamine neurons encode long-term value and its expectation errors of future rewards. By using electrophysiological methods and computational simulations based on reinforcement learning theories, we recorded and analyzed dopamine neuron responses in monkeys performing a behavioral task in which they obtained multiple rewards by multi-step actions. We also confirmed that dopamine neurons evolved these activities by learning the task. These functions play an important role in decision-making and action selection to achieve a distant goal.

Research Products

• [Journal Article] Coding of the long-term value of multiple future rewards in the primate striatum (2013)
  • Author(s): Yamada H, Inokawa H, Matsumoto N, Ueda Y, Enomoto K, Kimura M
  • Journal Title: J Neurophysiol Volume: 109(4) Issue: 4 Pages: 1140-51
  • DOI: 10.1152/jn.00289.2012
  • Peer Reviewed
• [Journal Article] Dopamine neurons learn to encode the long-term value of multiple future rewards (2011)
  • Author(s): Enomoto K.
  • Journal Title: Proc Natl Acad Sci USA Volume: 108(37) Issue: 37 Pages: 15462-15467
  • DOI: 10.1073/pnas.1014457108
  • Peer Reviewed
• [Presentation] Location-specific roles of dopamine neurons in the midbrain in learning and decision-making (2012)
  • Author(s): Enomoto K, Matsumoto N, Kimura M
  • Organizer: Neuroscience 2012 (SfN's 42nd annual meeting)
  • Place of Presentation: Ernest N. Morial Convention Center, New Orleans, USA
  • Year and Date: 2012-10-13
• [Presentation] ドーパミン神経系による予測と意思決定の制御機構(霊長類における研究を中心に) (2012)
  • Author(s): 榎本一紀
  • Organizer: 第34回日本生物学的精神医学会
  • Place of Presentation: 神戸国際会議場, 兵庫県
  • Year and Date: 2012-09-28
• [Presentation] 学習と意思決定課題におけるサルの中脳部位特異的なドーパミン細胞の活動 Heterogeneous signals of midbrain dopamine neurons during learning and decision-making (2012)
  • Author(s): 榎本一紀, 松本直幸, 木村實
  • Organizer: 第35回日本神経科学大会
  • Place of Presentation: 名古屋国際会議場, 愛知県
  • Year and Date: 2012-09-18
• [Presentation] 中脳ドーパミン細胞による、異なった時間スケールでの報酬価値とその誤差の表現 Midbrain dopamine neurons encode reward value and its error on heterogeneous time scale (2012)
  • Author(s): 榎本一紀, 松本直幸, 木村實
  • Organizer: 第34回日本神経科学大会
  • Place of Presentation: パシフィコ横浜, 神奈川県
  • Year and Date: 2012-09-16
• [Presentation] 学習と意思決定課題におけるサルの中脳部位特異的なドーパミン細胞の活動 Heterogeneous signals of midbrain dopamine neurons during learning and decision-making (2012)
  • Author(s): 榎本一紀
  • Organizer: 第35回日本神経科学大会
  • Place of Presentation: 名古屋国際会議場（愛知県）
• [Presentation] Location-specific roles of dopamine neurons in the midbrain in learning and decision-making (2012)
  • Author(s): Kazuki Enomoto
  • Organizer: Neuroscience 2012
  • Place of Presentation: Ernest N. Morial Convention Center (New Orleans, USA)
• [Presentation] ドパミン神経系による予測と意思決定の制御機構（霊長類における研究を中心に） (2012)
  • Author(s): 榎本一紀
  • Organizer: 第34回日本生物学的精神医学会
  • Place of Presentation: 神戸国際会議場（兵庫県）
• [Presentation] 中脳ドーパミン細胞による、異なった時間スケールでの報酬価値とその誤差の表現 Midbrain dopamine neurons encode reward value and its error on heterogeneous time scale (2011)
  • Author(s): 榎本 一紀
  • Organizer: 第34回日本神経科学大会
  • Place of Presentation: パシフィコ横浜（神奈川県）
• [Book] 実験医学増刊 (2012)
  • Author(s): 榎本一紀, 木村實
  • Total Pages: 257
  • Publisher: 羊土社
• [Book] 実験医学増刊 Vol.30 No.2 「in vivo実験医学によるヒト疾患解明の最前線」 (2012)
  • Author(s): 榎本一紀
  • Total Pages: 257
  • Publisher: 羊土社
• [Remarks]
  • URL: http://physiology.jp/exec/page/stopics76
• [Remarks]
  • URL: http://brainprogram.mext.go.jp/media/press/110905tamagawa_kimura_press2.pdf
• [Remarks]
  • URL: http://physiology.jp/exec/page/stopics76/
• [Remarks]
  • URL: http://brainprogram.mext.go.jp/media/press/110905tamagawa_kimura_press2.pdf