• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Elucidation of the Mathematical Basis and Neural Mechanisms of Multi-layer Representation Learning

Planned Research

Project AreaCorrespondence and Fusion of Artificial Intelligence and Brain Science
Project/Area Number 16H06563
Research Category

Grant-in-Aid for Scientific Research on Innovative Areas (Research in a proposed research area)

Allocation TypeSingle-year Grants
Review Section Complex systems
Research InstitutionOkinawa Institute of Science and Technology Graduate University

Principal Investigator

Doya Kenji  沖縄科学技術大学院大学, 神経計算ユニット, 教授 (80188846)

Project Period (FY) 2016-06-30 – 2021-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥82,160,000 (Direct Cost: ¥63,200,000、Indirect Cost: ¥18,960,000)
Fiscal Year 2020: ¥14,560,000 (Direct Cost: ¥11,200,000、Indirect Cost: ¥3,360,000)
Fiscal Year 2019: ¥14,560,000 (Direct Cost: ¥11,200,000、Indirect Cost: ¥3,360,000)
Fiscal Year 2018: ¥14,560,000 (Direct Cost: ¥11,200,000、Indirect Cost: ¥3,360,000)
Fiscal Year 2017: ¥14,560,000 (Direct Cost: ¥11,200,000、Indirect Cost: ¥3,360,000)
Fiscal Year 2016: ¥23,920,000 (Direct Cost: ¥18,400,000、Indirect Cost: ¥5,520,000)
Keywords強化学習 / 深層学習 / データ効率 / モデルベース / 大脳皮質 / 大脳基底核 / セロトニン / ディープラーニング / モジュール自己組織化 / 表現学習
Outline of Final Research Achievements

In accordance with the aims of the project, we developed brain inspired algorithms for artificial intelligence and utilized the theories and methods of artificial intelligence for advancing brain science.
We developed data-efficient model-based reinforcement algorithms and analyzed the data-efficiency of deep reinforcement learning algorithms.
We clarified representations of different variables for sensory inference and reinforcement learning in the cerebral cortex and the basal ganglia. We also revealed that the enhancement of the patience for delayed rewards by serotonin neuron stimulation is dependent on the certainty of reward delivery and the uncertainty of delivery timing, and proposed a novel Bayesian decision model to reproduce animal behaviors.

Academic Significance and Societal Importance of the Research Achievements

脳にならった新たな人工知能の開発と、人工知能の理論や手法による脳科学の進展という領域のねらいの具現化をめざし、限られた経験から効率よく行動学習を行う強化学習アルゴリズムの開発と、その性能を予測する理論の構築を行った。また、知覚推論と強化学習に関わる情報の大脳皮質と大脳基底核における表現を明らかにするとともに、セロトニンが将来報酬の予測に基づく行動を制御するしくみの解明を進めた。

Report

(6 results)
  • 2021 Final Research Report ( PDF )
  • 2020 Annual Research Report
  • 2019 Annual Research Report
  • 2018 Annual Research Report
  • 2017 Annual Research Report
  • 2016 Annual Research Report
  • Research Products

    (154 results)

All 2022 2021 2020 2019 2018 2017 Other

All Int'l Joint Research (2 results) Journal Article (25 results) (of which Int'l Joint Research: 7 results,  Peer Reviewed: 20 results,  Open Access: 23 results) Presentation (117 results) (of which Int'l Joint Research: 62 results,  Invited: 66 results) Remarks (5 results) Patent(Industrial Property Rights) (3 results) (of which Overseas: 1 results) Funded Workshop (2 results)

  • [Int'l Joint Research] University of California Berkeley(米国)

    • Related Report
      2020 Annual Research Report
  • [Int'l Joint Research] University College London(英国)

    • Related Report
      2020 Annual Research Report
  • [Journal Article] A whole brain probabilistic generative model: Toward realizing cognitive architectures for developmental robots2022

    • Author(s)
      Taniguchi T, Yamakawa H, Nagai T, Doya K, Sakagami M, Suzuki M, Nakamura T, Taniguchi A
    • Journal Title

      Neural Networks

      Volume: 150 Pages: 293-312

    • DOI

      10.1016/j.neunet.2022.02.026

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Structural relational inference actor-critic for multi-agent reinforcement learning2021

    • Author(s)
      Zhang X, Liu Y, Xu X, Huang Q, Mao H, Carie, A
    • Journal Title

      Neurocomputing

      Volume: 459 Pages: 383-394

    • DOI

      10.1016/j.neucom.2021.07.014

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Canonical cortical circuits and the duality of Bayesian inference and optimal control2021

    • Author(s)
      Doya K
    • Journal Title

      Current Opinion in Behavioral Sciences

      Volume: 41 Pages: 160-167

    • DOI

      10.1016/j.cobeha.2021.07.003

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Increased serotonin prevents compulsion in addiction2021

    • Author(s)
      Miyazaki K, Miyazaki K W
    • Journal Title

      Science

      Volume: 373 Issue: 6560 Pages: 1197-1198

    • DOI

      10.1126/science.abl6285

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Forward and inverse reinforcement learning sharing network weights and hyperparameters2021

    • Author(s)
      Uchibe E, Doya K
    • Journal Title

      Neural Networks

      Volume: 144 Pages: 138-153

    • DOI

      10.1016/j.neunet.2021.08.017

    • Related Report
      2020 Annual Research Report
    • Open Access
  • [Journal Article] ZFPM1 Necessary for Development of Serotonergic Projections Related to Anxiety and Contextual Fear Learning2021

    • Author(s)
      Taira M, Desforges M
    • Journal Title

      Journal of Neuroscience

      Volume: 41 Issue: 18 Pages: 3945-3947

    • DOI

      10.1523/jneurosci.3125-20.2021

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Serotonergic Modulation of Cognitive Computations2021

    • Author(s)
      Kenji Doya, Kayoko W. Miyazaki, Katsuhiko Miyazaki
    • Journal Title

      Current opinion of Behavioral Sciences

      Volume: Volume 38, April 2021 Pages: 116-123

    • DOI

      10.1016/j.cobeha.2021.02.003

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] A biologically constrained spiking neural network model of the primate basal ganglia with overlapping pathways exhibits action selection2021

    • Author(s)
      Girard B, Lienard J, Gutierrez C E, Delord B, Doya K
    • Journal Title

      European Journal of Neuroscience

      Volume: 53 Issue: 7 Pages: 2254-2277

    • DOI

      10.1111/ejn.14869

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Diffusion functional MRI reveals global brain network functional abnormalities driven by targeted local activity in a neuropsychiatric disease mouse model2020

    • Author(s)
      Abe Yoshifumi、Takata Norio、Sakai Yuki、Hamada Hiro Taiyo、Hiraoka Yuichi、Aida Tomomi、Tanaka Kohichi、Bihan Denis Le、Doya Kenji、Tanaka Kenji F
    • Journal Title

      NeuroImage

      Volume: 223 Pages: 117318-117318

    • DOI

      10.1016/j.neuroimage.2020.117318

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Optimization and validation of diffusion MRI-based fiber tracking with neural tracer data as a reference2020

    • Author(s)
      Gutierrez C E, Skibbe H, Nakae K, Tsukada H, Lienard J, Watakabe A, Hata J, Reisert M, Woodward A, Yamaguchi Y, Yamamori T, Okano H, Ishii S, Doya K
    • Journal Title

      Scientific reports

      Volume: 10 Issue: 1 Pages: 21285-21285

    • DOI

      10.1038/s41598-020-78284-4

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Self-organization of action hierarchy and compositionality by reinforcement learning with recurrent neural networks2020

    • Author(s)
      Han D, Doya K, Tani J
    • Journal Title

      Neural Networks

      Volume: 129 Pages: 149-162

    • DOI

      10.1016/j.neunet.2020.06.002

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Serotonergic projections to the orbitofrontal and medial prefrontal cortices differentially modulate waiting for future rewards2020

    • Author(s)
      Miyazaki K, Miyazaki KW, Sivori G, Yamanaka A, Tanaka KF, Doya K
    • Journal Title

      Science Advances

      Volume: 6 Issue: 48 Pages: 7246-7246

    • DOI

      10.1126/sciadv.abc7246

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] AIと脳神経科学―精神神経疾患へのデータ駆動と理論駆動のアプローチ2020

    • Author(s)
      高橋 英彦, 山下 祐一, 銅谷 賢治
    • Journal Title

      Clinical Neuroscience

      Volume: 38 Pages: 1358-1363

    • Related Report
      2020 Annual Research Report
  • [Journal Article] 増大特集 人工知能と神経科学 人工知能と脳科学の現在とこれから2019

    • Author(s)
      銅谷賢治、松尾豊
    • Journal Title

      BRAIN and NERVE

      Volume: 71 Issue: 7 Pages: 649-655

    • DOI

      10.11477/mf.1416201337

    • ISSN
      1344-8129, 1881-6096
    • Year and Date
      2019-07-01
    • Related Report
      2019 Annual Research Report
  • [Journal Article] Gap-Increasing Policy Evaluation for Efficient and Noise-Tolerant Reinforcement Learning.2019

    • Author(s)
      Kozuno T, Han D, Doya K
    • Journal Title

      arXiv.

      Volume: N/A

    • Related Report
      2019 Annual Research Report
    • Open Access
  • [Journal Article] A unified view of likelihood ratio and reparameterization gradients and an optimal importance sampling scheme.2019

    • Author(s)
      Parmas P, Sugiyama M
    • Journal Title

      arXiv.

      Volume: N/A

    • Related Report
      2019 Annual Research Report
    • Open Access
  • [Journal Article] Toward evolutionary and developmental intelligence2019

    • Author(s)
      Doya K, Taniguchi T
    • Journal Title

      Current Opinion in Behavioral Sciences

      Volume: 29 Pages: 91-96

    • DOI

      10.1016/j.cobeha.2019.04.006

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Theoretical analysis of efficiency and robustness of softmax and gap-increasing operators in reinforcement learning2019

    • Author(s)
      Kozuno T, Uchibe E, Doya K
    • Journal Title

      Proceedings of Machine Learning Research (PMLR)

      Volume: 89 Pages: 2995-3003

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Reward probability and timing uncertainty alter the effect of dorsal raphe serotonin neurons on patience2018

    • Author(s)
      Miyazaki K*, Miyazaki KW*, Yamanaka A, Tokuda T, Tanaka KF, Doya K *These authors contributed equally to this work.
    • Journal Title

      Nature Communications

      Volume: 9 Issue: 1 Pages: 2048-2048

    • DOI

      10.1038/s41467-018-04496-y

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Identification of depression subtypes and relevant brain regions using a data-driven approach2018

    • Author(s)
      Tokuda Tomoki, Yoshimoto Junichiro,Shimizu Yu, Okada Go,Takamura Masahiro, Okamoto Yasumasa, Yamawaki Shigeto, Doya Kenji
    • Journal Title

      Scientific Reports

      Volume: 8 Issue: 1 Pages: 14082-14082

    • DOI

      10.1038/s41598-018-32521-z

    • NAID

      120006537400

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Connectivity inference from neural recording data: Challenges, mathematical bases and research directions2018

    • Author(s)
      Magrans de Abril I, Yoshimoto J, Doya K
    • Journal Title

      Neural Networks

      Volume: 102 Pages: 120-137

    • DOI

      10.1016/j.neunet.2018.02.016

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Reward-predictive neural activities in striatal striosome compartments2018

    • Author(s)
      Yoshizawa T, Ito M, Doya K
    • Journal Title

      eNeuro

      Volume: 5 Issue: 1 Pages: 0367-0367

    • DOI

      10.1523/eneuro.0367-17.2018

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Sigmoid-weighted linear units for neural network function approximation in reinforcement learning2018

    • Author(s)
      Elfwing S, Uchibe E, Doya K
    • Journal Title

      Neural Networks

      Volume: 2017 Specail issue Pages: 30297-6

    • DOI

      10.1016/j.neunet.2017.12.012

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Multiple co-clustering based on nonparametric mixture models with heterogeneous marginal distributions2017

    • Author(s)
      Tokuda T, Yoshimoto J, Shimizu Y Okada G, Takamura M, Okamoto Y, Yamawaki S, Doya K
    • Journal Title

      PLoS One

      Volume: 12 Issue: 10 Pages: e0186566-e0186566

    • DOI

      10.1371/journal.pone.0186566

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Adaptive Baseline Enhances EM-based Policy Search: Validation in a View-based Positioning Task of a Smartphone Balancer2017

    • Author(s)
      Jiexin Wang, Eiji Uchibe, Kenji Doya
    • Journal Title

      Frontiers in Neurorobotics

      Volume: 11 Pages: 1-15

    • DOI

      10.3389/fnbot.2017.00001

    • NAID

      120005980916

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] Canonical Cortical Circuits and the Duality of Inference and Control2022

    • Author(s)
      Doya K
    • Organizer
      神経研究所発表会 (Online)
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] Embodied agents for survival, reproduction, and prediction2022

    • Author(s)
      Doya K
    • Organizer
      International Workshop on Next Generation Embodied Intelligence
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Context-dependent interaction of dopamine and serotonin2022

    • Author(s)
      Doya K
    • Organizer
      COSYNE2022 (Online)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Serotonergic Control of Model-based Decision Making2022

    • Author(s)
      Taira M
    • Organizer
      COSYNE2022
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Natural and artificial reinforcement learning2021

    • Author(s)
      Doya K
    • Organizer
      NeurIPS2021 (Online)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 進化するスマホロボットは何をめざすか2021

    • Author(s)
      銅谷賢治
    • Organizer
      第38回AI美芸研シンポジウム「コンセプチュアルウイルス」
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] 動物の行動と神経活動を予測する2021

    • Author(s)
      銅谷賢治
    • Organizer
      日本動物実験代替法学会第34回大会
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] 強化学習とベイズ推定の神経回路を探る2021

    • Author(s)
      銅谷賢治
    • Organizer
      中部大学 AI数理データサイエンスセンターキックオフシンポジウム
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] The duality of inference and control as a key to understanding canonical cortical circuits2021

    • Author(s)
      Doya K
    • Organizer
      "RIKEN-OIST symposium ""Kinds of Minds-What is thinking?" (Online)
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] 不確かさ判断の神経機構2021

    • Author(s)
      山根ゆか子、銅谷賢治
    • Organizer
      日本視覚学会2021年夏季大会 (Online)
    • Related Report
      2020 Annual Research Report
  • [Presentation] マーモセットカルシウムイメージングデータの因果解析2021

    • Author(s)
      Yamane Y, Ebina T, Sasagawa A, Terada S, Uemura M, Ohki K, Matsuzaki M, Doya K
    • Organizer
      日本神経回路学会 (Online)
    • Related Report
      2020 Annual Research Report
  • [Presentation] Investigation of information flow and temporal-spatial organization of neurons across cortical layers from multi-depth two-photon imaging data2021

    • Author(s)
      Li Y, Doya K
    • Organizer
      JNNS2021
    • Related Report
      2020 Annual Research Report
  • [Presentation] 脳型人工知能による人間理解と応用2021

    • Author(s)
      銅谷賢治
    • Organizer
      サントリーホールディングス株式会社 研究交流会議 (Online)
    • Related Report
      2020 Annual Research Report
  • [Presentation] 人工知能は脳から何を学べば良いのか2021

    • Author(s)
      銅谷賢治
    • Organizer
      【応用脳科学コンソーシアム】2021年度応用脳科学アカデミー (Online)
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] Reinforcement learning, Bayesian inference and the brain2021

    • Author(s)
      Doya K
    • Organizer
      AI and Brain Computation (lecture at summer school) (Online)
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] The duality of control and inference as a clue for cracking the codes of frontal and sensory cortical architectures2021

    • Author(s)
      Doya K
    • Organizer
      CJK Symposium 17, Theoretical Brain (Online)
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] The effect of photoinhibition of dorsal raphe serotonin neurons on stationary waiting and sustained motor actions for future rewards2021

    • Author(s)
      Taira M
    • Organizer
      The 44th annual meeting of the Japan Neuroscience Society
    • Related Report
      2020 Annual Research Report
  • [Presentation] Duality of control and inference and the cortical circuit architecture2021

    • Author(s)
      Doya K
    • Organizer
      SBDM 2021
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] What can we learn from the brain for future AI?2021

    • Author(s)
      Doya K
    • Organizer
      ICLR2021
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Neural circuit for mental simulation2021

    • Author(s)
      Doya K
    • Organizer
      China-Japan Expert Symposium on Brain Science
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 人工知能は脳から何を学べば良いのか2020

    • Author(s)
      銅谷 賢治
    • Organizer
      応用脳科学アカデミーアドバンスコース「脳とAI」第1回
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] AI and brain science2020

    • Author(s)
      Doya K
    • Organizer
      2020 IEEE CIS Summer School on Emerging Research Trends in Computational Intelligence: Theory and Applications
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Communication and Self-organization of Intelligent Agents2020

    • Author(s)
      Doya K
    • Organizer
      NOLTA 2020
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Extracting information flow across cortical layers from multi-depth two-photon imaging data2020

    • Author(s)
      Li Y, Doya K
    • Organizer
      第63回自動制御連合講演会
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] 人工知能と脳科学の融合と社会2020

    • Author(s)
      銅谷 賢治
    • Organizer
      第8回神経法学研究会
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] 脳とAIの接点から何を学びうるのか2020

    • Author(s)
      銅谷 賢治
    • Organizer
      第5回全脳アーキテクチャシンポジウム
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] Toward the society of AI agents: what should we learn from the brain and human society2020

    • Author(s)
      Doya K
    • Organizer
      International Symposium on Artificial Intelligence and Brain Science
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] What can we further learn from the brain for artificial intelligence?2020

    • Author(s)
      Doya K
    • Organizer
      Neurotheory Forum
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] How to let robots learn, develop, communicate and evolve2020

    • Author(s)
      Doya K
    • Organizer
      Latin American Summer School on Cognitive Robotics (LACORO)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] What can we further learn from the brain for artificial intelligence2020

    • Author(s)
      Doya K
    • Organizer
      Neuroscience2020
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] Toward multi-scale brain data assimilation2020

    • Author(s)
      Doya K
    • Organizer
      CNS*2020 Workshop: Machine learning and mechanistic modeling for understanding brain in health and disease
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Effects of transcranial direct current stimulation in brain-computer interface2020

    • Author(s)
      Kasahara Ki, Nakamura T, Uehara K, Ogata Y, Doya K, Hanakawa T
    • Organizer
      2021 IEEE 3rd Global Conference on life science and technology (LifeTech 2021)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Leverage the average: an analysis of KL regularization in reinforcement learning2020

    • Author(s)
      Vieillard N, Kozuno T, Scherrer B, Pietquin O, Munos R, Geist M
    • Organizer
      Neural Information Processing Systems Online Conference 2020 (NeurIPS 2020)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Effects of the neural activity in basal ganglia on the choice behavior in rats2020

    • Author(s)
      Sugiura I, Irei T, Doya K, Kurata K, Miyata R
    • Organizer
      The 30th Annual Conference of Japanese Neural Network Society (JNNS2020)
    • Related Report
      2020 Annual Research Report
  • [Presentation] Maximum credibility voting (MCV): An integrative approach for accurate diagnosis of major depressive disorder from clinically readily available data2020

    • Author(s)
      himizu Y, Yoshimoto J, Takamura M, Okada G, Matsumoto T, Fuchikami M, Okada S, Morinobu S, Okamoto Y, Yamawaki S, Doya K
    • Organizer
      APSIPA 2020
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Neuron hubs distributed differently in deep layers and superficial layers in different brain states2020

    • Author(s)
      Li Y, Doya K
    • Organizer
      The 1st Asia-Pacific Computational and Cognitive Neuroscience Conference. (2020 AP-CCN)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Investigation of temporal and spatial origination of neural network in sensory cortex.2020

    • Author(s)
      Li Y, Doya K
    • Organizer
      The 30th Annual Conference of Japanese Neural Network Society (JNNS2020)
    • Related Report
      2020 Annual Research Report
  • [Presentation] Changes in the basal ganglia-thalamic functional connectivity induced by longitudinal motor training in mice2020

    • Author(s)
      Hikishima-Kasahara K, Doya K
    • Organizer
      Neuroscience 2020
    • Related Report
      2020 Annual Research Report
  • [Presentation] Variational recurrent models for solving partially observable control tasks2020

    • Author(s)
      Han D, Doya K, Tani J
    • Organizer
      Eighth International Conference on Learning Representations (ICLR 2020)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] How Can the Brain Connect Predictors and Actors on the Fly?2020

    • Author(s)
      Doya K
    • Organizer
      Workshop on Learning for flexible, context-sensitive behavior
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Identifying the Evolutionary Conditions for the Emergence of Alternative Reproductive Tactics in Simulated Robot Colonies2020

    • Author(s)
      Rahman F, Doya K, Mickheyev A
    • Organizer
      AROB 25th 2020
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] What can we further learn from the brain for artificial intelligence?2020

    • Author(s)
      Doya K
    • Organizer
      脳と心のメカニズム第20回冬のワークショップ
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Representation and grounding of abstract concepts: a preliminary investigation. Mechanism of Mind and Brain2020

    • Author(s)
      Chiu HC, Doya K
    • Organizer
      脳と心のメカニズム第20回冬のワークショップ
    • Related Report
      2019 Annual Research Report
  • [Presentation] セロトニンによる報酬待機行動の制御機構2019

    • Author(s)
      宮崎勝彦
    • Organizer
      第254回つくばブレインサイエンス・セミナー
    • Related Report
      2019 Annual Research Report
    • Invited
  • [Presentation] What Can We Learn from the Brain for Next AI?2019

    • Author(s)
      Doya K
    • Organizer
      The 3rd Ryudai-OIST Symposium: Basic Medical Science to Clinical Medicine
    • Related Report
      2019 Annual Research Report
  • [Presentation] Intrinsic motivation in creative activity: A human behavioral experiment for identifying the factors that influence intrinsic motivation.2019

    • Author(s)
      Ota S, Doya K
    • Organizer
      WIML, NeurIPS
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A unified view of likelihood ratio and reparameterization gradients and an optimal importance sampling scheme2019

    • Author(s)
      Parmas P, Sugiyama M
    • Organizer
      Deep Reinforcement Learning Workshop, NeurIPS
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] マウスの脳内シミュレーションとロボットの報酬進化2019

    • Author(s)
      銅谷賢治
    • Organizer
      第12回日本人間行動進化学会
    • Related Report
      2019 Annual Research Report
    • Invited
  • [Presentation] Consciousness as Data Assimilation2019

    • Author(s)
      Doya K
    • Organizer
      Consciousness Club. ARAYA
    • Related Report
      2019 Annual Research Report
    • Invited
  • [Presentation] Toward whole-brain multi-scale modeling2019

    • Author(s)
      Doya K
    • Organizer
      NBNI: Neurobiology and Neuroinformatics
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Patience, Confidence and Serotonin2019

    • Author(s)
      Doya K
    • Organizer
      Blue Brain Seminar
    • Related Report
      2019 Annual Research Report
    • Invited
  • [Presentation] What Can We Further Learn from the Brain for Cognitive Robotics?2019

    • Author(s)
      Doya K
    • Organizer
      IROS 2019 Workshop: Deep Probabilistic Generative Models for Cognitive Architecture in Robotics
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Systems Biology of Reinforcement Learning2019

    • Author(s)
      Doya K
    • Organizer
      International Conference on Systems Biology (ICSB 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Reinforcement Learning in Machines and the Brain2019

    • Author(s)
      Doya K
    • Organizer
      Conference on Robot Learning (CoRL 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Stimulation of serotonergic terminals in the orbitofrontal and medial prefrontal cortices differentially affects waiting for the future rewards2019

    • Author(s)
      Miyazaki KW, Miyazaki K, Yamanaka A, Tanaka KF, Doya K
    • Organizer
      Society for Neuroscience (SfN 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Artificial Intelligence and Brain Science2019

    • Author(s)
      Doya K
    • Organizer
      The Joint Symposium of WPI-IIIS, Ph.D. Program in Humanics, and 36th Takamine Conference
    • Related Report
      2019 Annual Research Report
    • Invited
  • [Presentation] Neural Circuits for Reinforcement Learning and Mental Simulation2019

    • Author(s)
      Doya K
    • Organizer
      IBRO 2019 Symposium: Valence and Reward Encoding
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] ベイジアンブレインの今日2019

    • Author(s)
      銅谷賢治
    • Organizer
      日本認知科学会第36回大会
    • Related Report
      2019 Annual Research Report
    • Invited
  • [Presentation] Intrinsic motivation in play: Preliminary experiment for analyzing how learning environmental condition influences intrinsic motivation2019

    • Author(s)
      Ota S, Doya K
    • Organizer
      International Conference on Cognitive Science (ICCS 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Neural circuits for mental simulation2019

    • Author(s)
      Doya K
    • Organizer
      International Conference on Cognitive Science (ICCS2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] What can we further learn from the brain for AI and robotics?2019

    • Author(s)
      Doya K
    • Organizer
      Global AI Summit: Cognitive AI
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Big Data Challenges in Neuroscience2019

    • Author(s)
      Doya K
    • Organizer
      IEEE CIS Summer School: Big Data Analytics and Stream Processing
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Neural Circuits for Mental Simulation2019

    • Author(s)
      Doya K
    • Organizer
      CNS*2019, 28th Annual Computational Neuroscience Meeting
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Possible roles of dopamine in model-free and model-based decision and learning2019

    • Author(s)
      Doya K
    • Organizer
      CNS*2019, Dopaminergic Signaling Workshop
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Ethologically Grounded Motivation and Neural Implementation of Mental Simulation2019

    • Author(s)
      Doya K
    • Organizer
      The 4th International Workshop on Intrinsically Motivated Open-ended Learning (IMOL2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 人工知能と脳科学2019

    • Author(s)
      銅谷賢治
    • Organizer
      第58回日本生体医工学会大会
    • Related Report
      2019 Annual Research Report
    • Invited
  • [Presentation] Learning to Communicate for Ecological Fitness2019

    • Author(s)
      Doya K
    • Organizer
      Shonan Meeting No. 141. Language as Goal-Directed Sequential Behavior: Computational Theories, Brain Mechanisms, Evolutionary Roots
    • Related Report
      2019 Annual Research Report
  • [Presentation] Neural circuit for mental simulation2019

    • Author(s)
      Doya K
    • Organizer
      Computational and Systems Neuroscience 2019 (COSYNE2019)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Patience and beyond2019

    • Author(s)
      Doya K
    • Organizer
      COSYNE 2019 Workshop -Advances and Convergences in 5-HT Research
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Neural circuits for reinforcement learning and mental simulation2019

    • Author(s)
      Doya K
    • Organizer
      5th Coreto Core International Symposium "3D LabExchange Program"
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Neuronal activity of macaque visual cortices during free viewing2019

    • Author(s)
      Yamane Y, Ito J, Joana C, Fujita I, Tamura H, Maldonado P, Doya K, Grun S
    • Organizer
      The 19th winter workshop Mechanism of Brain and Mind
    • Related Report
      2018 Annual Research Report
  • [Presentation] 人工知能は脳から何を学べるか2018

    • Author(s)
      銅谷賢治
    • Organizer
      第26回脳の世紀シンポジウム「AIと脳」
    • Related Report
      2018 Annual Research Report
    • Invited
  • [Presentation] 想像力と知能の脳回路を可視化する2018

    • Author(s)
      銅谷賢治
    • Organizer
      第58回日本核医学会学術総会-合同特別講演(県民公開講座を兼ねる)
    • Related Report
      2018 Annual Research Report
    • Invited
  • [Presentation] Introductory talk: Building autonomous robots to understand what brains do2018

    • Author(s)
      Doya K
    • Organizer
      Satellite workshop of The 8th International Symposium on Biology of Decision Making (SBDM2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] ロボットと人工知能から行動障害と脳機能へのアプローチ2018

    • Author(s)
      銅谷賢治
    • Organizer
      第22回日本摂食障害学会学術集会
    • Related Report
      2018 Annual Research Report
    • Invited
  • [Presentation] Neural circuits for reinforcement learning and mental simulation2018

    • Author(s)
      Doya K
    • Organizer
      OIST-KAIST Symposium: Intelligence in Biological Systems and Its Application to Machines
    • Related Report
      2018 Annual Research Report
    • Invited
  • [Presentation] 脳の回路モジュールはなぜうまく繋がれるのか2018

    • Author(s)
      銅谷賢治
    • Organizer
      第3回 全脳アーキテクチャシンポジウム 「脳に学んで良き汎用知能に至る道筋」
    • Related Report
      2018 Annual Research Report
    • Invited
  • [Presentation] Theoretical analysis of Non-exact retrace algorithm2018

    • Author(s)
      Kozuno T, Doya K
    • Organizer
      The 28th Annual Conference of the Japanese Neural Network Society (JNNS2018 )
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Total stochastic gradient algorithms and applications in reinforcement learning2018

    • Author(s)
      Paramas P
    • Organizer
      The 32nd Conference on Neural Information Processing Systems (NeurIPS2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Total stochastic gradient algorithms with application to model-based reinforcement learning2018

    • Author(s)
      Paramas P
    • Organizer
      The 21st Information -based induction science workshop (IBIS2018)
    • Related Report
      2018 Annual Research Report
  • [Presentation] PIPPS: Flexible model-based policy search robust to the curse of chaos2018

    • Author(s)
      Parmas P, Rasmussen Carl E, Peters Jan, Doya, Kenji
    • Organizer
      The 35th International Conference on Machine Learning (ICML2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Representation of fixated objects by multiple single unit activity in visual cortices of freely viewing macaque monkeys2018

    • Author(s)
      Yamane Y, Ito J, Joana C, Fujita I, Tamura H, Maldonado P, Doya K, Grun S
    • Organizer
      11th FENS Forum of Neuroscience
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Inferring fixated objects in free viewing from parallel neuronal spiking activities in macaque monkeys2018

    • Author(s)
      Yamane Y, Ito J, Joana C, Fujita I, Tamura H, Maldonado P, Doya K, Grun S
    • Organizer
      The 41st Annual Meeting of the Japan Neuroscience Society
    • Related Report
      2018 Annual Research Report
  • [Presentation] Cell-type specific calcium imaging of striatal neurons in the striosome compartments during an odor-conditioning task2018

    • Author(s)
      Yoshizawa T, Ito M, Doya K
    • Organizer
      Gordon Research Conference
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Experimental investigation of hierarchical Bayesian inference in sensory and motor cortices2018

    • Author(s)
      Zobnin S, Li Yuzhe, Doya K
    • Organizer
      脳と心のメカニズム第18回冬のワークショップ
    • Related Report
      2017 Annual Research Report
  • [Presentation] 報酬待機行動を制御するセロトニンの役割ーoptogeneticsによる検証ー2018

    • Author(s)
      宮崎勝彦
    • Organizer
      セロトニン研究会
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] Imaging the neural circuit for mental simulation2018

    • Author(s)
      Doya K
    • Organizer
      COSYNE 2018 Workshop Session: Concepts, attention, and consciousness in (reinforcement) learning 3.5
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Neural circuits for reinforcement learning and mental simulation2018

    • Author(s)
      Doya K
    • Organizer
      Canonical Computation in Brains and Machines, New York University
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] What should we further learn from the brain?2018

    • Author(s)
      Doya K
    • Organizer
      Joint Workshop of Korean AI flagship Project and Japanese AI and Brain Scinece Project
    • Related Report
      2017 Annual Research Report
  • [Presentation] Neural circuits for reinforcement learning and mental simulation2018

    • Author(s)
      Doya K
    • Organizer
      Brain and AI Symposium Korea
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Neural circuits for reinforcement learning and mental simulation2018

    • Author(s)
      Doya K
    • Organizer
      Seminar at Cold Spring Harbor Laboratory
    • Related Report
      2017 Annual Research Report
  • [Presentation] How does the brain wire up itself on the fly?2018

    • Author(s)
      Doya K
    • Organizer
      Seminar at Institute for Advnced Study, Princeton
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] Neural Circuit for Mental Simulation2018

    • Author(s)
      Doya K
    • Organizer
      The Neuroscience and Social Decision Making Talk Series
    • Related Report
      2017 Annual Research Report
  • [Presentation] Fast Adaptation of Behavior to Changing Goals with a Gamma Ensemble2017

    • Author(s)
      Chris Reinke, Eiji Uchibe, Kenji Doya
    • Organizer
      The 3rd Multidisciplinary Conference on Reinforcement Learning and Decision Making (RLDM2017)
    • Place of Presentation
      The University of Michigan, Ann Arbor, Michigan, U.S.A.
    • Year and Date
      2017-06-11
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Coding of action and state values in the striatal compartments2017

    • Author(s)
      Kenji Doya
    • Organizer
      12th International Basal Ganglia Society Meeting (IBAGS-XII 2017)
    • Place of Presentation
      Merida, Yucatan, Mexico
    • Year and Date
      2017-03-26
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Robust and Efficient Off-Policy Policy Evaluation via Enhanced Action-Gap2017

    • Author(s)
      Kozuno T, Uchibe E, Doya K
    • Organizer
      The 20th Information-Based Induction Sciences Workshop
    • Related Report
      2017 Annual Research Report
  • [Presentation] The optimal-baseline estimator is not the optimal baseline-estimator2017

    • Author(s)
      Parmas P, Peters J, Doya, K
    • Organizer
      Information-based induction sciences workshop (IBIS)
    • Related Report
      2017 Annual Research Report
  • [Presentation] Adaptation of Optimization Algorithms to Problem Domains by Transfer Learning2017

    • Author(s)
      Reinke C, Doya K
    • Organizer
      2017 International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS)
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Average Reward Optimization with Multiple Discounting Reinforcement Learners2017

    • Author(s)
      Reinke C, Uchibe E, Doya K
    • Organizer
      ICONIP (Lecture Notes in Computer Science)
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Fast Adaptation of Behavior to Changing Goals with a Gamma Ensemble2017

    • Author(s)
      Reinke C, Uchibe E, Doya K
    • Organizer
      3rd Multidisciplinary conference on reinforcement learning and decision making
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Coding of value information in the striatal striosome compartment2017

    • Author(s)
      Yoshizawa T, Ito M, Doya K
    • Organizer
      44th Naito Conference
    • Related Report
      2017 Annual Research Report
  • [Presentation] Neural representation of sensory-state value in the striatal striosome compartment2017

    • Author(s)
      Yoshizawa T, Ito M, Doya K
    • Organizer
      Society for Neuroscience 47th Annual Meeting
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Experimental investigation of hierarchical Bayesian inference in sensory and motor cortices2017

    • Author(s)
      Zobnin S, Li Yuzhe, Doya K
    • Organizer
      新学術領域研究「人工知能と脳科学」第3回領域会議
    • Related Report
      2017 Annual Research Report
  • [Presentation] Neural coding, brain imaging and information extraction by circuit modeling2017

    • Author(s)
      Doya K
    • Organizer
      Neuroscience 2017 Sattelite Symposium / CREST Symposium
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Reinforcement learning: basic concepts and recent advances2017

    • Author(s)
      Doya K
    • Organizer
      Workshop on "Human & Machine Learning"
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Neural mechanisms of reinforcement learning and mental simulation2017

    • Author(s)
      Doya K
    • Organizer
      Workshop on "Human & Machine Learning"
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] What should we further learn from the brain?2017

    • Author(s)
      Doya K
    • Organizer
      Korean AI Flagship Project Workshop
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] Exploring the deep brain network for reinforcement learning2017

    • Author(s)
      Doya K
    • Organizer
      Neuroscience 2017, 40th Annual Meeting of the Japan Neuroscience Societ,Luncheon Seminar
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Decoding the contents of mental simulation2017

    • Author(s)
      Doya K
    • Organizer
      Neuroscience 2017 Sattelite Symposium: Computational Principles of the Nervous System
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] What should We further Learn from the Brain?2017

    • Author(s)
      Doya K
    • Organizer
      Brain-AI Workshop, NYU Shanhai
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] BRAINxBayes2017

    • Author(s)
      銅谷賢治
    • Organizer
      新学術領域研究「人工知能と脳科学」若手サマースクール
    • Related Report
      2017 Annual Research Report
  • [Presentation] 大脳基底核の機能モデル・病態モデルと実験的検証2017

    • Author(s)
      Doya K
    • Organizer
      第32回 日本大脳基底核研究会 (JBAGS2017)
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] 「脳内シミュレーション」の神経回路を可視化する2017

    • Author(s)
      銅谷賢治
    • Organizer
      新適塾「脳はおもしろい」第18回会合
    • Related Report
      2017 Annual Research Report
  • [Presentation] Artificial Intelligence and Brain Science2017

    • Author(s)
      Doya K
    • Organizer
      Seminar at Kyungpook National University
    • Related Report
      2017 Annual Research Report
  • [Presentation] What can we further learn from the brain?2017

    • Author(s)
      Doya K
    • Organizer
      24th International Conference on Neural Information Processing ICONIP2017
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Neural circuits for reinforcement learning and mental simulation2017

    • Author(s)
      Doya K
    • Organizer
      SCiNDU: Systems & Computational Neuroscience Down Under
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 脳内シミュレーションの神経機構2017

    • Author(s)
      銅谷賢治
    • Organizer
      第32回日本整形外科学会基礎学術集会
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Remarks] 沖縄科学技術大学院大学 神経計算ユニット

    • URL

      https://groups.oist.jp/ja/ncu

    • Related Report
      2020 Annual Research Report
  • [Remarks] 人工知能と脳科学の対照と融合

    • URL

      http://www.brain-ai.jp/jp/

    • Related Report
      2020 Annual Research Report 2019 Annual Research Report 2018 Annual Research Report 2017 Annual Research Report
  • [Remarks] International Symposium on AI and Brain Science

    • URL

      http://www.brain-ai.jp/jp/symposium2020/

    • Related Report
      2020 Annual Research Report
  • [Remarks] 沖縄科学技術大学院大学 神経計算ユニット

    • URL

      https://groups.oist.jp/ncu

    • Related Report
      2019 Annual Research Report
  • [Remarks] 沖縄科学技術大学院大学 神経計算ユニット

    • URL

      https://groups.oist.jp/ncu

    • Related Report
      2018 Annual Research Report 2017 Annual Research Report 2016 Annual Research Report
  • [Patent(Industrial Property Rights)] Inverse reinforcement learning by density ratio estimation2021

    • Inventor(s)
      Uchibe E, Doya K
    • Industrial Property Rights Holder
      Uchibe E, Doya K
    • Industrial Property Rights Type
      特許
    • Filing Date
      2021
    • Acquisition Date
      2021
    • Related Report
      2020 Annual Research Report
  • [Patent(Industrial Property Rights)] Direct inverse reinforcement learning with density ratio estimation2021

    • Inventor(s)
      Uchibe E, Doya K
    • Industrial Property Rights Holder
      Uchibe E, Doya K
    • Industrial Property Rights Type
      特許
    • Filing Date
      2021
    • Acquisition Date
      2021
    • Related Report
      2020 Annual Research Report
  • [Patent(Industrial Property Rights)] Total stochastic gradient method2018

    • Inventor(s)
      Paavo Parmas
    • Industrial Property Rights Holder
      沖縄科学技術大学院大学
    • Industrial Property Rights Type
      特許
    • Filing Date
      2018
    • Acquisition Date
      2018
    • Related Report
      2018 Annual Research Report
    • Overseas
  • [Funded Workshop] International Symposium on Artificial Intelligence and Brain Science 20202020

    • Related Report
      2020 Annual Research Report
  • [Funded Workshop] 第40回日本神経科学大会2017

    • Related Report
      2017 Annual Research Report

URL: 

Published: 2016-07-04   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi