• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

STUDIES ON NEURAL MECHANISMS OF DECISION-MAKING AND LEARNING

Research Project

Project/Area Number 12210016
Research Category

Grant-in-Aid for Scientific Research on Priority Areas (C)

Allocation TypeSingle-year Grants
Review Section Biological Sciences
Research InstitutionJUNTENDO UNIVERSITY

Principal Investigator

HIKOSAKA Okihide  JUNTENDO UNIV., PHYSIOLOGY, PROFESSOR, 医学部, 教授 (70120300)

Co-Investigator(Kenkyū-buntansha) TAKIKAWA Yoriko  JUNTENDO UNIV., PHYSIOLOGY, RESEARCH ASSOCIATE, 助手 (90053339)
KAWAGOE Reiko  JUNTENDO UNIV., PHYSIOLOGY, RESEARCH ASSOCIATE, 助手 (30138250)
SATO Makoto  JUNTENDO UNIV., PHYSOLOGY, RESEARCH ASSOCIATE, 助手 (90255688)
SAKAGAMI Masamichi  TAMAGAWA UNIV., RESEARCH INSTITUTE, ASSOCIATE PROFESSOR, 学術研究所, 助教授 (10225782)
Project Period (FY) 2000 – 2001
Project Status Completed (Fiscal Year 2001)
Budget Amount *help
¥39,600,000 (Direct Cost: ¥39,600,000)
Fiscal Year 2001: ¥39,600,000 (Direct Cost: ¥39,600,000)
KeywordsBasal ganglia / reward / motivation / eye movement / decision making / dopamin / reinforcement learning / 尾状核 / 単一ニューロン活動 / 学習 / 視覚性応答 / 大脳皮質前頭葉
Research Abstract

Expectation of reward motivates our behaviors and influences our decisions. Recent studies have shown that neuronal activity in many brain areas is modulated by expected reward. However, it is still unclear where and how the reward-modulation occurs and how the reward-modulated signal is sent out as motor outputs. Studies from our laboratory using saccadic eye movement suggest that the basal ganglia play a key role in guiding the gaze to the location where reward is available. First, projection neurons in the caudate nucleus are extremely sensitive to a positional bias of reward, usually preferring a larger reward on the contralateral side. The biased signal is then sent to the superior colliculus through the substantia nigra pars reticulata, mainly as disinhibition. This creates a bias in excitability between the superior colliculi such that the saccade to the to-be-rewarded- position occurs more quickly. Second, visual responses of caudate neurons are strongly modulated by expected reward, thus facilitating the preparatory process of saccade to the rewarded position. A possible underlying mechanism is that cortical inputs carrying spatial signals are strengthened or weakened (with possible synaptic plasticity) by the concurrent dopaminergic input carrying reward prediction error signal. These data lend strong support to the reinforcement learning theories which has been very successful in explaining behavioral learning and neural plasticity. Our results have shown that there exists a neuronal network in the basal ganglia that operates similarly to what the reinforcement learning model predicts. On the other hand, the basal ganglia network shows greater adaptability to behavioral contexts than the current model can do. Further studies using the reward-biased saccade tasks will provide an ideal paradigm for understanding the neuronal mechanism of reward-oriented behavior.

Report

(3 results)
  • 2001 Annual Research Report   Final Research Report Summary
  • 2000 Annual Research Report
  • Research Products

    (50 results)

All 2002 2001 2000 Other

All Journal Article (32 results) Publications (18 results)

  • [Journal Article] Long-term retention of motor skill in macaque monkeys and humans.2002

    • Author(s)
      Hikosaka O, Rand MK, Nakamura K, Miyachi S, Kitaguchi K, Sakai K, Lu X, Shimo Y
    • Journal Title

      Exp Brain Res 147

      Pages: 494-504

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] Differential activation of monkey striatal neurons in the early and late stages of procedural learning.2002

    • Author(s)
      Miyachi S, Hikosaka O, Lu X
    • Journal Title

      Exp Brain Res 146

      Pages: 122-126

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] A neural correlate of response bias in monkey caudate nucleus.2002

    • Author(s)
      Lauwereyns J, Watanabe K, Coe B, Hikosaka O
    • Journal Title

      Nature 418

      Pages: 413-417

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] Visual and Anticipatory Bias in Three Cortical Eye Fields of the Monkey during an Adaptive Decision-Making Task.2002

    • Author(s)
      Coe B, Tomihara K, Matsuzawa M, Hikosaka O
    • Journal Title

      J Neurosci 22

      Pages: 5081-5090

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] A neural correlate of oculomotor sequences in supplementary eye field.2002

    • Author(s)
      Lu X, Matsuzawa M, Hikosaka 0
    • Journal Title

      Neuron 34

      Pages: 317-325

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] Self-organization in the basal ganglia with modulation of reinforcement signals.2002

    • Author(s)
      Nakahara H, Amari Si S, Hikosaka O
    • Journal Title

      Neural Comput 14

      Pages: 819-844

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] Role of primate substantia nigra pars reticulata in reward-oriented saccadic eye movement.2002

    • Author(s)
      Sato M, Hikosaka O
    • Journal Title

      J Neurosci 22

      Pages: 2363-2373

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] Influence of reward expectation on visuospatial processing in macaque lateral prefrontal cortex.2002

    • Author(s)
      Kobayashi S, Lauwereyns J, Koizumi M, Sakagami M, Hikosaka O
    • Journal Title

      J Neurophysiol 87

      Pages: 1488-1498

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] Reward-dependent spatial selectivity of anticipatory activity in monkey caudate neurons.2002

    • Author(s)
      Takikawa Y, Kawagoe R, Hikosaka O
    • Journal Title

      J Neurophysiol 87

      Pages: 508-515

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] Feature-based anticipation of cues that predict reward in monkey caudate nucleus.2002

    • Author(s)
      Lauwereyns J, Takikawa Y, Kawagoe R, Kobayashi S, Koizumi M, Coe B, Sakagami M, Hikosaka O
    • Journal Title

      Neuron 33

      Pages: 463-473

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] Modulation of saccadic eye movements by predicted reward outcome.2002

    • Author(s)
      Takikawa Y, Kawagoe R, Itoh H, Nakahara H, Hikosaka O
    • Journal Title

      Exp Brain Res 142

      Pages: 284-291

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] A new approach to the functional systems of the brain.2002

    • Author(s)
      Hikosaka O
    • Journal Title

      Epilepsia 43

      Pages: 9-15

    • NAID

      10010883396

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] Central mechanisms of motor skill learning.2002

    • Author(s)
      Hikosaka O, Nakamura K, Sakai K, Nakahara H
    • Journal Title

      Curr Opin Neurobiol 12

      Pages: 217-222

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] A neural correlate of response bias in monkey caudate nucleus.2002

    • Author(s)
      Lauwereyns.1, Watanabe K, Coe B, Hikosaka 0
    • Journal Title

      Nature 418

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] A neural correlate of oculomotor sequences in supplementary eye field.2002

    • Author(s)
      Lu X, Matsuzawa M, Hikosaka O
    • Journal Title

      Neuron 34

      Pages: 317-325

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] Influence of reward expectation on visuospatial processing in macaque lateral prefrontal cortex.2002

    • Author(s)
      Kobayashi S.Lauwereyns J.Koizumi M, Sakagami M, Hikosaka O
    • Journal Title

      J Neurophysiol 87

      Pages: 1488-1498

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] Reward-dependent spatial selectivity of anticipatory activity in monkey caudate neurons.2002

    • Author(s)
      Takikawa Y, Kawagoe R, Hikosaka O
    • Journal Title

      Journal of Neurophysiology 87

      Pages: 508-515

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] Modulation of saccadic eye movements by predicted reward outcome.2002

    • Author(s)
      Takikawa Y, Kawagoe R, Itoh H, Nakahara H, Hikosaka O
    • Journal Title

      Experimental Brain Research 142

      Pages: 284-291

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] A new approach to the functional systems of the brain.2002

    • Author(s)
      Hikosaka O
    • Journal Title

      Epilepsia 43 Suppl 9

      Pages: 9-15

    • NAID

      10010883396

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] Parallel cortico-basal ganglia mechanisms for acquisition and execution of visuomotor seqeunces- A computational approach.2001

    • Author(s)
      Nakahara H, Doya K, Hikosaka O
    • Journal Title

      Journal of Cognitive Neuroscience 13

      Pages: 1-22

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] A code for behavioral inhibition on the basis of color, but not motion, in ventrolateral prefrontal cortex of macaque monkey.2001

    • Author(s)
      Sakagami M, Tsutsui K-I, Lauwereyns J, Koizumi M, Kobayashi S, Hikosaka O
    • Journal Title

      J Neurosci 21

      Pages: 4801-4808

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] Responses to task-irrelevant visual features by primate prefrontal neurons.2001

    • Author(s)
      Lauwereyns J, Sakagami M, Tsutsui K-I, Kobayashi S, Koizumi M, Hikosaka O
    • Journal Title

      J Neurophysiol 86

      Pages: 2001-2010

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] Role of tonically active neurons in primate caudate in reward-oriented saccadic eye movement.2001

    • Author(s)
      Shimo Y, Hikosaka O
    • Journal Title

      J Neurosci 21

      Pages: 7804-7814

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] Parallel cortico-basal ganglia mechanisms for acquisition and execution of visuomotor seqeunces-A computational approach.2001

    • Author(s)
      Nakahara H, Doya K, Hikosaka O
    • Journal Title

      Journal of Cognitive Neuroscience 13

      Pages: 1-22

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] A code for behavioral inhibition on the basis of color, but not motion, in ventrolateral prefrontal cortex of macaque monkey.2001

    • Author(s)
      Sakagami M, Tsutsui K-1, Lauwereyns J, Koizumi M, Kobayashi S, Hikosaka O
    • Journal Title

      J Neurosci 21

      Pages: 4801-4808

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] Interference from irrelevant features on visual discrimination by macaques (Macaca fuscata) : a behavioral analogue of human stroop effect.2000

    • Author(s)
      Lauwereyns J, Koizumi M, Sakagami M, Hikosaka O, Kobayashi S, Tsutsui K
    • Journal Title

      Journal of Experimental Psychology : Animal Behavior Processes 26

      Pages: 352-357

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] Characteristics of sequential movements during early learning period in monkeys.2000

    • Author(s)
      Rand MK, Hikosaka O, Miyachi S, Lu X, Nakamura K, Kitaguchi K, Shimo Y
    • Journal Title

      Exp Brain Res 131

      Pages: 293-304

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] What and when : parallel and convergent processing in motor control2000

    • Author(s)
      Sakai K, Hikosaka O, Takino R, Miyauchi S, Nielsen M, Tamada T
    • Journal Title

      J Neurosci 20

      Pages: 2691-2700

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] Role of the basal ganglia in the control of purposive saccadic eye movements.2000

    • Author(s)
      Hikosaka O, Takikawa Y, Kawagoe R
    • Journal Title

      Physiol. Rev. 80

      Pages: 953-978

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] Interference from irrelevant features on visual discrimination by macaques (Macaca fuscata) : a behavioral analogue of human strop effect.2000

    • Author(s)
      Lauwereyns J, Koizumi M, Sakagami M, Ilikosaka O, Kobayashi S, Tsutsui K
    • Journal Title

      Journal of Experimental Psychology : Animal Behavior Processes 26

      Pages: 352-357

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] What and when : parallel and convergent processing in motor control.2000

    • Author(s)
      Sakai K, Hikosaka O, Takino R, Miyauchi S, Nielsen M, Tamada T
    • Journal Title

      J Neurosci 20

      Pages: 2691-2700

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Journal Article] Role of the basal ganglia in the control of purposive saccadic eye movements.2000

    • Author(s)
      Hikosaka 0, Takikawa Y, Kawagoe R
    • Journal Title

      Physiol. Rev. 80

      Pages: 953-978

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Nakahara H, Doya K, Hikosaka O: "Parallel cortico-basal ganglia mechanisms for acquisition and execution of risuomotor sequences-A computational approach"J. Cog. Neurosci.. 13. 1-22 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] Sakagami M, Tsutsui K-1, Lauwereyns J, Koizumi M, Kobayashi S, Hikosaka O: "A code for behavioral inhibition on the basis of color, but not motion, in ventrolateral prefrontal cortex of macaque monkey"J. Neurosci. 21. 4801-4808 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] Lauwereyns J, Sakagami M, Tsutsui K-1, Kobayashi S, Koizumi M, Hikosaka O: "Responses to task-irrelevant visual by primate prefrontal neurons"J. Neurophysiol. 86. 2001-2010 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] Shimo Y, Hikosaka O: "Role of tonically active neurons in primate caudate in reward-oriented saccadic eye movement"J. Neurosci.. 21. 7804-7814 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] Takikawa Y, Kawagoe R, Hikosaka O: "Reward-dependent spatial selectivity of anticipatory activity in monkey neurons"J. Neurophysiol.. 87. 508-515 (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] Takikawa Y, Kawagoe R, Ito H, Nakahara H, Hikosaka O: "Modulation of saccadic eye movements by predicted reward outcome"Exp. Brain Res.. 142. 284-291 (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] Lauwereyns J, Takikawa Y, Kawagoe R, Kobayashi S, Koizumi M, Coe B, Sakagami M, Hikosaka O: "Feature-based anticipation of cues that predict reward in monkey caudate nucleus"Neuron. 33. 463-473 (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] Kobayashi S, Lauwereyns J, Koizumi M, Sakagami M, Hikosaka O: "Influence of reward expectation on visuospatial processing in macaque latelal prefrontal cortex"J. Neurophysiol.. (in press). (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] Lu X, Matsuzawa M, Hikosaka O: "A neural correlate of oculomotor sequences in supplementary eye field"Neuron. (in press). (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] Sato M, Hikosaka O: "Role of primate substantia nigra pars reticulata in reward-oriented saccadic eye"J. Neurosci. (in press). (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] Nakahara H, Amari S, Hikosaka O: "Self-organization in the basal ganglia with modulation of reinforcement signals"Neural Computation. (in press). (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] Rand MK,Hikosaka O,Miyachi S,Lux,Nukamura K,Kitaguchi K,Shimo Y.: "Characteristics of sequential movements during early learning periad in monkeys"Exp.Brain Res. 131. 293-304 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] Sakai K,Hikosaka O,Takino R,Miyachi S,Nielsen M,Tamada T.: "What and when : parallel and convergent processing in motor control"J.Neurosci. 20. 2691-2700 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] Lauwereyns J.Koizumi M,Sakagami M,Mikosaka O,Kobayashi S,Tsutsui K.: "Interference from irrelevant features on visual discrimination ly macaques (Macacafuscata): a behavioral analogue of human scroop effect"J.Exp.Psychol; Animal Behavior Processes. 26. 352-357 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] Hikosaka O,Takikawa Y,Kawagoe R.: "Role of the basal ganglia in the control of purposive saccadic eye movements"Physiol.Rev.. 80. 953-978 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 彦坂興秀: "精神機能への神経科学的アプローチ"実験医学. 12. 2668-2672 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 彦坂興秀: "運動制御における小脳の役割-最近の進歩"神経研究の進歩. 44. 974-982 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 彦坂興秀: "脳科学大事典 編者:甘利俊一,外山敬介(バリスティック運動制御)"朝倉書店. 306-316 (2000)

    • Related Report
      2000 Annual Research Report

URL: 

Published: 2001-04-01   Modified: 2018-03-28  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi