• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Elucidation of the Neural Circuit Dynamics for Prediction and Decision Making

Planned Research

Project AreaElucidation of neural computation for prediction and decision making: toward better human understanding and applications
Project/Area Number 23120007
Research Category

Grant-in-Aid for Scientific Research on Innovative Areas (Research in a proposed research area)

Allocation TypeSingle-year Grants
Review Section Complex systems
Research InstitutionOkinawa Institute of Science and Technology Graduate University

Principal Investigator

Doya Kenji  沖縄科学技術大学院大学, 神経計算ユニット, 教授 (80188846)

Co-Investigator(Renkei-kenkyūsha) KUHN Bernd  沖縄科学技術大学院大学, 光学ニューロイメージングユニット, 准教授 (90599557)
Project Period (FY) 2011-04-01 – 2016-03-31
Project Status Completed (Fiscal Year 2015)
Budget Amount *help
¥147,160,000 (Direct Cost: ¥113,200,000、Indirect Cost: ¥33,960,000)
Fiscal Year 2015: ¥15,860,000 (Direct Cost: ¥12,200,000、Indirect Cost: ¥3,660,000)
Fiscal Year 2014: ¥16,770,000 (Direct Cost: ¥12,900,000、Indirect Cost: ¥3,870,000)
Fiscal Year 2013: ¥16,640,000 (Direct Cost: ¥12,800,000、Indirect Cost: ¥3,840,000)
Fiscal Year 2012: ¥17,550,000 (Direct Cost: ¥13,500,000、Indirect Cost: ¥4,050,000)
Fiscal Year 2011: ¥80,340,000 (Direct Cost: ¥61,800,000、Indirect Cost: ¥18,540,000)
Keywords意思決定 / モデルフリー / モデルベース / 強化学習 / ベイズ推定 / 二光子顕微鏡 / 大脳基底核 / 大脳皮質
Outline of Final Research Achievements

We performed two-photon imaging of the mouse parietal cortex during an Auditory Virtual Navigation Task. By using Bayesian decoder of the target location from neural activities, we showed that the target location is updated by prediction even during no-sound periods and that the target location is disambiguated during sound presentation, which are the signatures of Dynamic Bayesian Filtering.
We recorded and analyzed the striatal neural activities of rats during a probabilistic reward task and revealed that the many neurons in the dorsomedial striatum encode action values. We also used a miniature endoscope microscope to image the neural activities of the hippocampus and the striatum and showed that reward predictive responses develop in the striatum during learning of conditioned responses.

Report

(6 results)
  • 2015 Annual Research Report   Final Research Report ( PDF )
  • 2014 Annual Research Report
  • 2013 Annual Research Report
  • 2012 Annual Research Report
  • 2011 Annual Research Report
  • Research Products

    (115 results)

All 2016 2015 2014 2013 2012 2011 Other

All Journal Article (24 results) (of which Int'l Joint Research: 3 results,  Peer Reviewed: 18 results,  Acknowledgement Compliant: 4 results,  Open Access: 8 results) Presentation (82 results) (of which Int'l Joint Research: 10 results,  Invited: 28 results) Book (2 results) Remarks (6 results) Funded Workshop (1 results)

  • [Journal Article] Consensus Paper: Towards a Systems-Level View of Cerebellar Function: the Interplay Between Cerebellum, Basal Ganglia, and Cortex2016

    • Author(s)
      Caligiore D, Pezzulo G, Baldassarre G, Bostan A C., Strick P L., Doya K, Helmich R C., Dirkx M, Houk J, Jörntell H, Lago-Rodriguez A, Galea J M., Miall R. C, Popa T, Kishore A, Verschure P F.M.J., Zucca R,Herreros I
    • Journal Title

      The Cerebellum

      Volume: 15 Issue: 1 Pages: 1-27

    • DOI

      10.1007/s12311-016-0763-3

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Forward and Inverse Reinforcement Learning Based on Linearly Solvable Markov Decision Processes2016

    • Author(s)
      内部英治
    • Journal Title

      The Brain & Neural Networks

      Volume: 23 Issue: 1 Pages: 2-13

    • DOI

      10.3902/jnns.23.2

    • NAID

      130005150459

    • ISSN
      1340-766X, 1883-0455
    • Related Report
      2015 Annual Research Report
    • Acknowledgement Compliant
  • [Journal Article] EM-based policy hyper parameter exploration: application to standing and balancing of a two-wheeled smartphone robot2016

    • Author(s)
      Wang J, Uchibe E, Doya K
    • Journal Title

      Artificial Life and Robotics

      Volume: 21 Issue: 1 Pages: 125-131

    • DOI

      10.1007/s10015-015-0260-7

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Hierarchical control of goal-directed action in the cortical–basal ganglia network2015

    • Author(s)
      Balleine B, Dezfouli A, Ito M, Doya K
    • Journal Title

      Current Opinion in Behavioral Sciences

      Volume: 5 Pages: 1-7

    • DOI

      10.1016/j.cobeha.2015.06.001

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Parallel Representation of Value-Based and Finite State-Based Strategies in the Ventral and Dorsal Striatum2015

    • Author(s)
      Ito M, Doya K
    • Journal Title

      PLOS Computational Biology

      Volume: 11 Issue: 11 Pages: e1004540-e1004540

    • DOI

      10.1371/journal.pcbi.1004540

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] 予測 大脳新皮質のベイジアンフィルタ仮説2015

    • Author(s)
      船水章大, 銅谷賢治
    • Journal Title

      生体の科学

      Volume: 66 Pages: 33-37

    • Related Report
      2014 Annual Research Report
  • [Journal Article] 報酬のための辛抱強さを調節するセロトニンの役割2015

    • Author(s)
      宮崎佳代子, 宮崎勝彦, 銅谷賢治
    • Journal Title

      生体の科学

      Volume: 66 Pages: 38-43

    • Related Report
      2014 Annual Research Report
  • [Journal Article] Condition interference in rats performing a choice task with switched variable- and fixed-reward conditions.2015

    • Author(s)
      Funamizu A., Ito M., Doya K., Kanzaki R.,Takahashi H.
    • Journal Title

      Frontiers in Neuroscience

      Volume: 9 Pages: 27-27

    • DOI

      10.3389/fnins.2015.00027

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Distinct Neural Representation in the Dorsolateral, Dorsomedial, and Ventral Parts of the Striatum during Fixed- and Free-Choice Tasks2015

    • Author(s)
      Ito M., Doya K.
    • Journal Title

      Journal of Neuroscience

      Volume: 35 Issue: 8 Pages: 3499-3514

    • DOI

      10.1523/jneurosci.1962-14.2015

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed
  • [Journal Article] A Spiking Neural Network Model of Model-Free Reinforcement Learning with High-Dimensional Sensory Input and Perceptual Ambiguity2015

    • Author(s)
      Nakano T., Otsuka M., Yoshimoto J., Doya K.
    • Journal Title

      Plos one

      Volume: 10 Issue: 3 Pages: e0115620-e0115620

    • DOI

      10.1371/journal.pone.0115620

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Emergence of Polymorphic Mating Strategies in Robot Colonies2014

    • Author(s)
      Elfwing S., Doya K.
    • Journal Title

      Plos One

      Volume: 9 Issue: 4 Pages: e93622-e93622

    • DOI

      10.1371/journal.pone.0093622

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Optogenetic activation of dorsal raphe serotonin neurons enhances patience for future rewards.2014

    • Author(s)
      Miyazaki KW, Miyazaki K, Tanaka KF, Yamanaka A, Takahashi A, Tabuchi S, Doya K
    • Journal Title

      Curr Biol

      Volume: 24 Issue: 17 Pages: 2033-2040

    • DOI

      10.1016/j.cub.2014.07.041

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] うつ病の脳内メカニズム-Functional MRIを用いた検討2014

    • Author(s)
      岡田剛, 岡本泰昌, 志士田一宏, 上田一貴, 小野田慶一, 国里愛彦, 田中沙織, 銅谷賢治, 山脇成人
    • Journal Title

      精神神経学会雑誌

      Volume: 116 Pages: 825-831

    • Related Report
      2014 Annual Research Report
  • [Journal Article] Expected energy-based restricted Boltzmann machine for classification2014

    • Author(s)
      Elfwing S.,Uchibe E., Doya K.
    • Journal Title

      Neural Networks

      Volume: 64 Pages: 29-38

    • DOI

      10.1016/j.neunet.2014.09.006

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] 脳内シミュレーションと意志決定の神経回路2013

    • Author(s)
      銅谷賢治
    • Journal Title

      生体の科学

      Volume: 64 Pages: 297-300

    • Related Report
      2013 Annual Research Report
  • [Journal Article] Evaluation of linearly solvable Markov decision process with dynamic model learning in a mobile robot navigation task2013

    • Author(s)
      Kinjo K, Uchibe E, Doya K
    • Journal Title

      Frontiers in Neurorobotics

      Volume: 7 Pages: 7-7

    • DOI

      10.3389/fnbot.2013.00007

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] A model-based prediction of the calcium responses in the striatal synaptic spines depending on the timing of cortical and dopaminergic inputs and post-synaptic spikes2013

    • Author(s)
      Nakano T, Yoshimoto J, Doya K.
    • Journal Title

      Frontiers in Computational Neuroscience

      Volume: 7 Pages: 119-119

    • DOI

      10.3389/fncom.2013.00119

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] リレー解説:強化学習の最近の発展(第10回:脳の意思決定機構と強化学習)2013

    • Author(s)
      吉本潤一郎、伊藤真、銅谷賢治
    • Journal Title

      計測と制御

      Volume: 52 Pages: 749-754

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] caled free-energy based reinforcement learning for robust and efficient learning in high-dimensional state spaces2013

    • Author(s)
      Elfwing S
    • Journal Title

      Frontiers in Neurorobotics

      Volume: 7 Pages: 3-3

    • DOI

      10.3389/fnbot.2013.00003

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Uncertainty in action-value estimation affects both action choice and learning rate of the choice behaviors of rats2012

    • Author(s)
      Funamizu A, Ito M, Doya K, Kanzaki R, Takahashi H
    • Journal Title

      European Journal of Neuroscience

      Volume: 35 Issue: 7 Pages: 1180-1189

    • DOI

      10.1111/j.1460-9568.2012.08025.x

    • Related Report
      2012 Annual Research Report 2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Activation of Dorsal Raphe Serotonin Neurons Is Necessary for Waiting for Delayed Reward2012

    • Author(s)
      Kayoko W. Miyazaki, Katsuhiko Miyazaki and Kenji Doya
    • Journal Title

      The Journal of Neuroscience

      Volume: 32 Issue: 31 Pages: 10451-10457

    • DOI

      10.1523/jneurosci.0915-12.2012

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] The Role of Serotonin in the Regulation of Patience and Impulsivity2012

    • Author(s)
      Katsuhiko Miyazaki, Kayoko W. Miyazaki & Kenji Doya
    • Journal Title

      Molecular Neurobiology

      Volume: 45 Issue: 2 Pages: 213-224

    • DOI

      10.1007/s12035-012-8232-6

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Decision making2012

    • Author(s)
      Doya K
    • Journal Title

      Current Opinion Neurobiology

      Volume: 22 Issue: 6 Pages: 911-913

    • DOI

      10.1016/j.conb.2012.10.003

    • Related Report
      2012 Annual Research Report
  • [Journal Article] Multiple representations and alogrithms for reinforcement learning in the cortico-basal ganglia circuit2011

    • Author(s)
      伊藤真、銅谷賢治
    • Journal Title

      Current Opinion in Neurobiology

      Volume: 21

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Presentation] Neural Circuits and Neuromodulations Prediction and Decision under Uncertainty:Roles of the Cortical Circuit and Serotonin2015

    • Author(s)
      Doya K
    • Organizer
      7th International Symposium on Optogenetics:Neural Circuits and Neuromodulations
    • Place of Presentation
      Akio Suzuki Memorial Hall, Medical and Dental University,Tokyo
    • Year and Date
      2015-12-04
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] モデルベース予測の脳機構2015

    • Author(s)
      銅谷賢治
    • Organizer
      日本心理学会7第9回大会
    • Place of Presentation
      名古屋国際会議場
    • Year and Date
      2015-09-23
    • Related Report
      2015 Annual Research Report
    • Invited
  • [Presentation] Investigating neural implementation of model-based decision making by two-photon microscopy2015

    • Author(s)
      Funamizu A, Kuhn B, Doya K
    • Organizer
      The 6th FAONS Congress and 11th Biennial Conference of the Chinese Neuroscience Society (CNS)
    • Place of Presentation
      Wuzhen, CHINA
    • Year and Date
      2015-09-22
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Uncovering representations and algorithms of decision making by model-based analysis of striatal neuron activities2015

    • Author(s)
      Ito M
    • Organizer
      The 6th FAONS Congress and 11th Biennial Conference of the Chinese Neuroscience Society (CNS)
    • Place of Presentation
      Wuzhen, CHINA
    • Year and Date
      2015-09-22
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Neuronal Mechanism of Reward-Based Learning and Decision2015

    • Author(s)
      Doya K
    • Organizer
      Brain Conference 2015; Joint Conference of KSBNS and KSND
    • Place of Presentation
      Korea Brain Research Institute, Daegu, KOREA
    • Year and Date
      2015-09-11
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 行動学習の多層的な表現・アルゴリズムとその制御2015

    • Author(s)
      銅谷賢治
    • Organizer
      日本発達神経科学学会第4回学術集会
    • Place of Presentation
      大阪大学
    • Year and Date
      2015-09-06
    • Related Report
      2015 Annual Research Report
    • Invited
  • [Presentation] Serotonin and the regulation of patience2015

    • Author(s)
      Doya K, Miyazaki Kayoko W, Miyazaki Katsuhiko
    • Organizer
      Neuroscience2015-38th Annual Meeting of the Japan Neuroscience Society
    • Place of Presentation
      Kobe International Conference Center
    • Year and Date
      2015-07-30
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Action-dependent state prediction in mouse parietal cortex during an auditory virtual navigation task2015

    • Author(s)
      Funamizu A, Kuhn B, Doya K
    • Organizer
      Neuroscience2015-38th Annual Meeting of the Japan Neuroscience Society
    • Place of Presentation
      Kobe International Conference Center
    • Year and Date
      2015-07-29
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] The role of the cortico-basal ganglia loops for reward-motivated choice motor behavior2015

    • Author(s)
      Yoshizawa T, Ito M, Doya K
    • Organizer
      Neuroscience2015- 38th Annual Meeting of the Japan Neuroscience Society
    • Place of Presentation
      Kobe International Conference Center
    • Year and Date
      2015-07-29
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Neural representations of memory-based and value-based decision strategies in the cortico-basal ganglia loops2015

    • Author(s)
      Ito M, Doya K
    • Organizer
      Neuroscience 2015-38th Annual Meeting of the Japan Neuroscience Society
    • Place of Presentation
      Kobe International Conference Center
    • Year and Date
      2015-07-28
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] How do we define the rewards in reinforcement learning?2015

    • Author(s)
      Uchibe E
    • Organizer
      電子情報通信学会ニューロコンピューティング研究会
    • Place of Presentation
      OIST
    • Year and Date
      2015-06-23
    • Related Report
      2015 Annual Research Report
    • Invited
  • [Presentation] Inverse Reinforcement Learning with Density Ratio Estimation2015

    • Author(s)
      Uchibe E, Doya K
    • Organizer
      The Multi-disciplinary Conference on Reinforcement Learning and Decision Making 2015(RLDM2015)
    • Place of Presentation
      University of Alberta, Edmonton, Canada
    • Year and Date
      2015-06-08
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Neural implementation of mental simulation2015

    • Author(s)
      Doya K
    • Organizer
      The 5th International conference on Cognitive Neurodynamics
    • Place of Presentation
      Sanya, China
    • Year and Date
      2015-06-05
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 後頭頂葉におけるモデルベース意思決定時の神経表現2015

    • Author(s)
      船水章大
    • Organizer
      第54回日本生体医工学会大会
    • Place of Presentation
      名古屋国際会議場
    • Year and Date
      2015-05-07
    • Related Report
      2015 Annual Research Report
    • Invited
  • [Presentation] 辛抱強さとセロトニン2015

    • Author(s)
      宮崎勝彦
    • Organizer
      第92回日本生理学会大会
    • Place of Presentation
      神戸国際会議場
    • Year and Date
      2015-03-23
    • Related Report
      2014 Annual Research Report
    • Invited
  • [Presentation] A Kinetic Signal Transduction Model for Structural Plasticity of Striatal Medium Spiny Neurons2015

    • Author(s)
      Yukinawa N., Doya K., Yoshimoto J.
    • Organizer
      The third annual Winter q-biio meeting
    • Place of Presentation
      Maui, Hawaii, USA
    • Year and Date
      2015-02-17 – 2015-02-20
    • Related Report
      2014 Annual Research Report
  • [Presentation] ロボティクス、機械学習と脳科学2015

    • Author(s)
      銅谷賢治
    • Organizer
      沖縄総合事務局 第4回全国組込み産業フォーラム・地域連携セミナー
    • Place of Presentation
      那覇市,沖縄県
    • Year and Date
      2015-02-13
    • Related Report
      2014 Annual Research Report
    • Invited
  • [Presentation] 強化学習の脳機構:大脳基底核とドーパミン・セロトニンの役割2014

    • Author(s)
      銅谷賢治
    • Organizer
      第19回情動・社会行動と精神医学研究会
    • Place of Presentation
      京都大学芝蘭会館
    • Year and Date
      2014-12-19
    • Related Report
      2014 Annual Research Report
    • Invited
  • [Presentation] Machine learning and brain science2014

    • Author(s)
      Doya K.
    • Organizer
      14th International conference on Intelligent Systems Design and Applications (ISDA2014)
    • Place of Presentation
      OIST Seaside House
    • Year and Date
      2014-11-27
    • Related Report
      2014 Annual Research Report
    • Invited
  • [Presentation] Promotion of patience by dorsal raphe serotonin neuron activation depends on the certainty of future rewards2014

    • Author(s)
      Miyazaki Katsuhiko, Miyazaki Kayoko, Tanaka W., Yamanaka K., Takahashi.A., Doya K.
    • Organizer
      44th Annual Meeting of the Society for Neuroscience(SFN2014)
    • Place of Presentation
      Washington, D.C USA
    • Year and Date
      2014-11-16
    • Related Report
      2014 Annual Research Report
  • [Presentation] Action-dependent state prediction in the parietal cortex of mouse during a virtual navigation task2014

    • Author(s)
      Funamizu A., Kuhn B., Doya K.
    • Organizer
      44th Annual Meeting of the Society for Neuroscience(SFN2014)
    • Place of Presentation
      Washington, D.C USA
    • Year and Date
      2014-11-15 – 2014-11-19
    • Related Report
      2014 Annual Research Report
  • [Presentation] Selective activation of columnar neural population by lateral inhibition in a realistic model of primary motor cortex2014

    • Author(s)
      Igarashi J., Moren J., Yoshimoto J., Doya K.
    • Organizer
      44th Annual Meeting of the Society for Neuroscience(SFN2014)
    • Place of Presentation
      Washington, D.C USA
    • Year and Date
      2014-11-15
    • Related Report
      2014 Annual Research Report
  • [Presentation] 観測と制御の双対性と脳アーキテクチャー2014

    • Author(s)
      銅谷賢治
    • Organizer
      第57回自動制御連合講演会
    • Place of Presentation
      天坊ホテル(群馬県伊香保)
    • Year and Date
      2014-11-11
    • Related Report
      2014 Annual Research Report
    • Invited
  • [Presentation] Obtaining reward functions of rats using inverse reinforcement learning2014

    • Author(s)
      Sezener C.E., Uchibe E., Doya K.
    • Organizer
      Turkish Autonomous Robots Conference
    • Place of Presentation
      Ankara, Turkey
    • Year and Date
      2014-11-06 – 2014-11-07
    • Related Report
      2014 Annual Research Report
  • [Presentation] ロボットと脳の強化学習2014

    • Author(s)
      銅谷賢治
    • Organizer
      第 160回 ヒューマンコンピュータインタラクション研究会
    • Place of Presentation
      OISTシーサイドハウス
    • Year and Date
      2014-10-14
    • Related Report
      2014 Annual Research Report
    • Invited
  • [Presentation] Toward the neurophysiology of mental simulation2014

    • Author(s)
      Doya K.
    • Organizer
      17th World Congress of Psychophysiology (IOP2014)
    • Place of Presentation
      International Conference Center Hiroshima
    • Year and Date
      2014-09-24
    • Related Report
      2014 Annual Research Report
    • Invited
  • [Presentation] 機械学習と脳科学2014

    • Author(s)
      銅谷賢治
    • Organizer
      第24回インテリジェント・システム・シンポジウムFAN2014
    • Place of Presentation
      北見工業大学,北海道
    • Year and Date
      2014-09-18 – 2014-09-19
    • Related Report
      2014 Annual Research Report
    • Invited
  • [Presentation] 一次運動皮質モデルの水平結合による出力選択2014

    • Author(s)
      五十嵐潤, モレンヤン, 吉本潤一郎, 銅谷賢治
    • Organizer
      Neuroscience 2014
    • Place of Presentation
      パシフィコ横浜
    • Year and Date
      2014-09-13
    • Related Report
      2014 Annual Research Report
  • [Presentation] Dissociation of working memory-based and value-based strategies in a free-choice task2014

    • Author(s)
      Ito M.
    • Organizer
      Neuroscience 2014
    • Place of Presentation
      パシフィコ横浜
    • Year and Date
      2014-09-12
    • Related Report
      2014 Annual Research Report
  • [Presentation] 二光子顕微鏡法によるマウス頭頂葉の行動依存的な状態予測の解明/Investigation of action-dependent state prediction in the mouse parietal cortex with two-photon microscopy2014

    • Author(s)
      Funamizu A.
    • Organizer
      Neuroscience 2014
    • Place of Presentation
      パシフィコ横浜
    • Year and Date
      2014-09-12
    • Related Report
      2014 Annual Research Report
  • [Presentation] Neural representation of task-level and motor information in the cortico-basal ganglia loops2014

    • Author(s)
      Yoshizawa T., Ito M., Doya K.
    • Organizer
      Neuroscience 2014
    • Place of Presentation
      パシフィコ横浜
    • Year and Date
      2014-09-11
    • Related Report
      2014 Annual Research Report
  • [Presentation] 密度比推定を用いた逆強化学習法2014

    • Author(s)
      内部英治, 銅谷賢治
    • Organizer
      第32回日本ロボット学会学術講演会
    • Place of Presentation
      パシフィコ横浜
    • Year and Date
      2014-09-04 – 2014-09-06
    • Related Report
      2014 Annual Research Report
  • [Presentation] Combining learned controllers to achieve new goals based on linearly solvable MDPs2014

    • Author(s)
      Uchibe E. Doya K
    • Organizer
      IEEE International Conference on Robotics and Automation
    • Place of Presentation
      Hong Kong
    • Year and Date
      2014-05-31 – 2014-06-07
    • Related Report
      2014 Annual Research Report
  • [Presentation] Investigation of model-based decision making by two-photon microscopy2014

    • Author(s)
      Funamizu A, Kuhn B. Doya K
    • Organizer
      脳と心のメカニズム 第14回冬のワークショップ
    • Place of Presentation
      Rusutsu, Hokkaido
    • Related Report
      2013 Annual Research Report
  • [Presentation] Group LASSO for the Classification of Depression Related fMRI Data2014

    • Author(s)
      Shimizu Y, Yoshimoto J, Toki S, Takumura M, Yoshimura S, Okamoto Y, Yamawaki S, Doya K
    • Organizer
      脳と心のメカニズム 第14回冬のワークショップ
    • Place of Presentation
      Rusutsu, Hokkaido
    • Related Report
      2013 Annual Research Report
  • [Presentation] Optogenetic activation of dorsal raphe serotonin neurons enhances patience for future rewards2014

    • Author(s)
      Miyazaki K, Miyazaki KW, Tanaka K, Yamanaka A, Takahashi A, Doya K
    • Organizer
      The 87th Anuual Meeting of the Japanese Pharmacological Society
    • Place of Presentation
      Sendai, Miyagi
    • Related Report
      2013 Annual Research Report
  • [Presentation] Investigation of neuronal activity in secondary motor cortex by two-photon microscopy2013

    • Author(s)
      Funamizu A, Kuhn B, Doya K
    • Organizer
      13th Winter Workshop on the Mechanism of Brain and Mind
    • Place of Presentation
      北海道虻田郡留寿都村
    • Year and Date
      2013-01-09
    • Related Report
      2012 Annual Research Report
  • [Presentation] Hierarchical representation in the striatum during a free choice task2013

    • Author(s)
      Ito M, Doya K
    • Organizer
      13th Winter Workshop on the Mechanism of Brain and Mind
    • Place of Presentation
      北海道虻田郡留寿都村
    • Year and Date
      2013-01-09
    • Related Report
      2012 Annual Research Report
  • [Presentation] Bayesian co-clustering analysis of resting-state MRI data: Toward elucidating the pathophisiology of depression2013

    • Author(s)
      Tokuda T, J Y, Shimizu Y, Takamura M, Yoshimura S, Okamoto Y, Yamawaki S, Doya K
    • Organizer
      13th Winter Workshop on the Mechanism of Brain and Mind
    • Place of Presentation
      北海道虻田郡留寿都村
    • Year and Date
      2013-01-09
    • Related Report
      2012 Annual Research Report
  • [Presentation] Bayesian co-clustering analysis of questionnaire data from normal and depressive subjects2013

    • Author(s)
      Yoshimoto J, Shimizu Y, Tokuda T, Takamura M, Yoshimura S, Okamoto Y, Yamawaki S, Doya K
    • Organizer
      13th Winter Workshop on the Mechanism of Brain and Mind
    • Place of Presentation
      北海道虻田郡留寿都村
    • Year and Date
      2013-01-09
    • Related Report
      2012 Annual Research Report
  • [Presentation] Neural networks for reinforcement learning2013

    • Author(s)
      Doya K
    • Organizer
      Francis Crick Symposium on Neuroscience
    • Place of Presentation
      Suzhou, China
    • Related Report
      2013 Annual Research Report
    • Invited
  • [Presentation] Analysis of human behaviors by inverse reinforcement learning in a pole balancing task2013

    • Author(s)
      Ota S, Uchibe E, Doya K
    • Organizer
      Symposium on Biology of Decision Making 2013
    • Place of Presentation
      Paris, France
    • Related Report
      2013 Annual Research Report
  • [Presentation] Role of prefrontal and striatal neurons in task-condition-dependent action selection of rat2013

    • Author(s)
      Funamizu A, Ito M, Doya K., Knazaki R. Takahashi H.
    • Organizer
      Neuro2013
    • Place of Presentation
      Kyoto, Kyoto
    • Related Report
      2013 Annual Research Report
  • [Presentation] Hierarchical coding in the striatum during a free-choice task2013

    • Author(s)
      Ito M, Doya K.
    • Organizer
      Neuro2013
    • Place of Presentation
      Kyoto, Kyoto
    • Related Report
      2013 Annual Research Report
  • [Presentation] Combining learned controllers to achieve new goals based on linearly solvable MDPs2013

    • Author(s)
      Uchibe E, Doya K
    • Organizer
      Neuro2013
    • Place of Presentation
      Kyoto, Kyoto
    • Related Report
      2013 Annual Research Report
  • [Presentation] 脳の機能と障害をコンピューターで理解する2013

    • Author(s)
      銅谷賢治
    • Organizer
      北大-理研ジョイントシンポジウム「未来医療を拓く生体予測シミュレーション」
    • Place of Presentation
      Sapporo, Hokkaido
    • Related Report
      2013 Annual Research Report
  • [Presentation] 報酬学習を支える神経基盤の理解に向けた多角的アプローチ2013

    • Author(s)
      吉本潤一郎、伊藤真
    • Organizer
      計測自動制御学会特別企画シンポジウム「強化学習の夢と未来」
    • Place of Presentation
      Shibuya-ku, Tokyo
    • Related Report
      2013 Annual Research Report
  • [Presentation] Optogenetic activation of dorsal raphe serotonin neurons enhances patience for future rewards2013

    • Author(s)
      Miyazaki K, Miyazaki K.W, Tanaka,K.F, Yamanaka,A., Takahashi A, Doya K.
    • Organizer
      Optgenetics 2013
    • Place of Presentation
      Minato-ku, Tokyo
    • Related Report
      2013 Annual Research Report
  • [Presentation] Investigation of neuronal activity in the posterior parietal cortex by two-photon microscopy2013

    • Author(s)
      Funamizu A, Kuhn B. Doya K
    • Organizer
      International Symposium on Prediction and Decision Making
    • Place of Presentation
      Kyoto, Kyoto
    • Related Report
      2013 Annual Research Report
  • [Presentation] Hierarchical representation of trial phases in the dorsolateral striatum, the dorsomedial striatum, and the ventral stratum during a choice task2013

    • Author(s)
      Ito M, Doya K
    • Organizer
      International Symposium on Prediction and Decision Making
    • Place of Presentation
      Kyoto, Kyoto
    • Related Report
      2013 Annual Research Report
  • [Presentation] Hierarchical population coding of trial phases by the striatal neurons during a choice task2013

    • Author(s)
      Ito M, Doya K
    • Organizer
      Neuroscience2013(SfN annual meeting)
    • Place of Presentation
      San Diego, USA
    • Related Report
      2013 Annual Research Report
  • [Presentation] Optogenetic activation of dorsal raphe serotonin neurons enhances patience for future rewards2013

    • Author(s)
      Miyazaki KW, Miyazaki K, Tanaka K, Ymanaka A, Takahashi A, Doya K
    • Organizer
      Neuroscience2013(SfN annual meeting)
    • Place of Presentation
      San Diego, USA
    • Related Report
      2013 Annual Research Report
  • [Presentation] Value-updating interaction among contexts in choice behaviors of rats2013

    • Author(s)
      Funamizu A, Ito M, Kanzaki R, Takahashi H
    • Organizer
      COSYNE2013
    • Place of Presentation
      Salt Lake City, U.S.A
    • Related Report
      2012 Annual Research Report
  • [Presentation] How patient can a mouse be with serotonin stimulation2013

    • Author(s)
      Doya K
    • Organizer
      Tamagwa-Caltech joint lecture course: reward and decision making on risk and aversion
    • Place of Presentation
      Hawaii,U.S.A
    • Related Report
      2012 Annual Research Report
  • [Presentation] Reinforcement learning and the basal ganglia2012

    • Author(s)
      Doya K
    • Organizer
      IBRO-UNESCO
    • Place of Presentation
      Hyderabad, India
    • Year and Date
      2012-12-05
    • Related Report
      2012 Annual Research Report
    • Invited
  • [Presentation] Bayesian inference and model-based decision making2012

    • Author(s)
      Doya K
    • Organizer
      IBRO-UNESCO
    • Place of Presentation
      Hyderabad, India
    • Year and Date
      2012-12-05
    • Related Report
      2012 Annual Research Report
    • Invited
  • [Presentation] Hierarchical representation in the striatum during a choice task2012

    • Author(s)
      伊藤真, 銅谷賢治
    • Organizer
      Comprehensive Brain Science Network Summer Workshop 2012
    • Place of Presentation
      宮城県仙台市
    • Year and Date
      2012-07-26
    • Related Report
      2012 Annual Research Report
  • [Presentation] Neural activities of rats prefrontal cortex and striatum in a free choice task with two reward conditions2012

    • Author(s)
      船水章大, 伊藤真, 銅谷賢治, 神埼亮平, 高橋宏知
    • Organizer
      Comprehensive Brain Science Network Summer Workshop 2012
    • Place of Presentation
      宮城県仙台市
    • Year and Date
      2012-07-26
    • Related Report
      2012 Annual Research Report
  • [Presentation] 意思決定の脳科学2012

    • Author(s)
      銅谷賢治
    • Organizer
      北海道大学生命科学院・生命システム科学特別講演「計算論的神経科学」公開セミナー
    • Place of Presentation
      北海道大学(北海道)
    • Year and Date
      2012-01-19
    • Related Report
      2011 Annual Research Report
  • [Presentation] Proposal for investigation of model-based decision making by two-photon microscopy2012

    • Author(s)
      船水章大
    • Organizer
      脳と心のメカニズム第12回冬のワークショップ
    • Place of Presentation
      ルスツリゾート(北海道)
    • Year and Date
      2012-01-15
    • Related Report
      2011 Annual Research Report
  • [Presentation] Multiple strategies for decision making2012

    • Author(s)
      Doya K
    • Organizer
      Second Symposium on Biology of Decision Making
    • Place of Presentation
      Paris, France
    • Related Report
      2012 Annual Research Report
    • Invited
  • [Presentation] 運動-視覚ダイナミクス学習と線形ベルマン方程式によるロボット制御2012

    • Author(s)
      金城健, 内部英治, 吉本潤一郎, 銅谷賢治
    • Organizer
      電子情報通信学会ニューロコンピューティング研究
    • Place of Presentation
      OIST,沖縄県国頭郡恩納村
    • Related Report
      2012 Annual Research Report
  • [Presentation] Basal ganglia, serotonin, and reward expectation2012

    • Author(s)
      Doya K
    • Organizer
      Computational and Cognitive Neurobiology Summer School
    • Place of Presentation
      Beijing, China
    • Related Report
      2012 Annual Research Report
    • Invited
  • [Presentation] Motor control: basal ganglia and motor control2012

    • Author(s)
      Doya K
    • Organizer
      Computational and Cognitive Neurobiology Summer School
    • Place of Presentation
      Beijing, China
    • Related Report
      2012 Annual Research Report
    • Invited
  • [Presentation] Toward understanding the neural substrate of mental simulation2012

    • Author(s)
      Doya K
    • Organizer
      Joint Symposium interactive brain dynamics for decision making and communication
    • Place of Presentation
      宮城県仙台市
    • Related Report
      2012 Annual Research Report
  • [Presentation] Reinforcement learning and the basal ganglia2012

    • Author(s)
      Doya K
    • Organizer
      Neural Computations Supporting Cognition
    • Place of Presentation
      北海道札幌市
    • Related Report
      2012 Annual Research Report
  • [Presentation] Brain and reinforcement Learning2012

    • Author(s)
      Doya K
    • Organizer
      21st Machine Learning Summer School
    • Place of Presentation
      Kyoto
    • Related Report
      2012 Annual Research Report
  • [Presentation] 知識の表象2012

    • Author(s)
      銅谷賢治
    • Organizer
      日本認知科学会サマースクール 2012
    • Place of Presentation
      神奈川県箱根市
    • Related Report
      2012 Annual Research Report
  • [Presentation] Model-free and Model-based Reinforcement Learning2012

    • Author(s)
      Doya K
    • Organizer
      The 76th Annual Convention of the Japanese Psychological Association
    • Place of Presentation
      神奈川県川崎市
    • Related Report
      2012 Annual Research Report
  • [Presentation] The theory of reinforcement learning and the neurobiology of decision making2012

    • Author(s)
      Doya K
    • Organizer
      Japan Neuroscience Society 2012 Symposium
    • Place of Presentation
      愛知県名古屋市
    • Related Report
      2012 Annual Research Report
    • Invited
  • [Presentation] 意思決定、学習、合理性2012

    • Author(s)
      銅谷賢治
    • Organizer
      日本科学哲学会シンポジウム
    • Place of Presentation
      宮崎大学,宮崎県
    • Related Report
      2012 Annual Research Report
    • Invited
  • [Presentation] 強化学習と意思決定の脳科学2012

    • Author(s)
      銅谷賢治
    • Organizer
      Autumn School for Computational Neuroscience
    • Place of Presentation
      長野県諏訪市
    • Related Report
      2012 Annual Research Report
    • Invited
  • [Presentation] 強化学習理論と心の科学2012

    • Author(s)
      銅谷賢治
    • Organizer
      玉川大学グローバルCOEプログラム 公開シンポジウム
    • Place of Presentation
      玉川大学,東京都
    • Related Report
      2012 Annual Research Report
    • Invited
  • [Presentation] 報酬に基づく意思決定のアルゴリズムと線状体の情報表現2012

    • Author(s)
      伊藤真
    • Organizer
      第40回ホミニゼーション研究会
    • Place of Presentation
      霊長類研究所(愛知県)
    • Related Report
      2011 Annual Research Report
  • [Presentation] Parallelism of multiple decision strategies in the cortico-basal ganglia networks2011

    • Author(s)
      銅谷賢治
    • Organizer
      The 11^<th> Japan-Korea-China Workshop on Neurobiology and Neuroinformatics (NBNI 2011)
    • Place of Presentation
      沖縄科学技術大学院大学(沖縄県)
    • Year and Date
      2011-12-19
    • Related Report
      2011 Annual Research Report
  • [Presentation] Task-dependent uncertainty preference of rats in a free choice task2011

    • Author(s)
      船水章大
    • Organizer
      日本神経回路学会第21回全国大会
    • Place of Presentation
      沖縄科学技術大学院大学(沖縄県)
    • Year and Date
      2011-12-15
    • Related Report
      2011 Annual Research Report
  • [Presentation] How the brain makes decisions2011

    • Author(s)
      銅谷賢治
    • Organizer
      Symposium for Dr Brenner
    • Place of Presentation
      沖縄科学技術大学院大学(沖縄県)
    • Year and Date
      2011-11-19
    • Related Report
      2011 Annual Research Report
  • [Presentation] Activation of dorsal raphe serotonin neurons is necessary for waiting for delayed rewards2011

    • Author(s)
      宮崎佳代子
    • Organizer
      第34回日本神経科学大会
    • Place of Presentation
      パシフィコ横浜(神奈川県)
    • Year and Date
      2011-09-17
    • Related Report
      2011 Annual Research Report
  • [Presentation] Uncertainty-seeking in rats' choice behaviors and its dependence on reward context2011

    • Author(s)
      船水章大
    • Organizer
      第34回日本神経科学大会
    • Place of Presentation
      パシフィコ横浜(神奈川県)
    • Year and Date
      2011-09-16
    • Related Report
      2011 Annual Research Report
  • [Presentation] Neural coding of value-based and finite state-based decision strategies in the dorsal and ventral striatum2011

    • Author(s)
      伊藤真
    • Organizer
      第34回日本神経科学大会
    • Place of Presentation
      パシフィコ横浜(神奈川県)
    • Year and Date
      2011-09-16
    • Related Report
      2011 Annual Research Report
  • [Presentation] 強化学習の脳機構:研究と現状と今後の展開2011

    • Author(s)
      銅谷賢治
    • Organizer
      豊田中央研究所講演会
    • Place of Presentation
      豊田中央研究所(愛知県)
    • Year and Date
      2011-09-13
    • Related Report
      2011 Annual Research Report
  • [Presentation] Serotonin activity and the regulation of impulsivity2011

    • Author(s)
      銅谷賢治
    • Organizer
      平成23年度アルコール・薬物依存関連学会合同学術総会
    • Place of Presentation
      愛知県産業労働センター(愛知県)
    • Related Report
      2011 Annual Research Report
  • [Book] The Basal ganglia, Reinforcement Learning, and the Encoding of Value2013

    • Author(s)
      Doya K, Kimura M
    • Total Pages
      13
    • Publisher
      Elsevier
    • Related Report
      2013 Annual Research Report
  • [Book] The Basal Ganglia, Reinforcement Learning and the Encoding of Value. In P. Glimcher et al. eds. Neuroeconomics: Decision-Making and the Brain, 2nd Edition2013

    • Author(s)
      Doya K
    • Publisher
      Elsevier
    • Related Report
      2012 Annual Research Report
  • [Remarks] 「予測と意思決定」新学術領域webページ

    • URL

      http://www.decisions.jp

    • Related Report
      2015 Annual Research Report 2014 Annual Research Report 2012 Annual Research Report
  • [Remarks] 沖縄科学技術大学院大学 神経計算ユニット

    • URL

      https://groups.oist.jp/ncu

    • Related Report
      2015 Annual Research Report 2012 Annual Research Report
  • [Remarks] 沖縄科学技術大学院大学 神経計算ユ二ット

    • URL

      https://groups.oist.jp/ncu

    • Related Report
      2014 Annual Research Report
  • [Remarks] 「予測と意思決定」新学術領域webページ

    • URL

      http://www.decisions.jp

    • Related Report
      2013 Annual Research Report
  • [Remarks] 沖縄科学技術大学院大学 神経計算ユニット

    • URL

      https://groups.oist.jp/ncu

    • Related Report
      2013 Annual Research Report
  • [Remarks]

    • URL

      http://www.decisions.jp

    • Related Report
      2011 Annual Research Report
  • [Funded Workshop] International Symposium on Prediction and Decision Making 20152015

    • Place of Presentation
      Koshiba Hall, The University of Tokyo
    • Year and Date
      2015-10-31
    • Related Report
      2015 Annual Research Report

URL: 

Published: 2011-08-01   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi