• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Metacognitive control of the neural signals that shape behaviour changes

Planned Research

Project AreaDeciphering and Manipulating Brain Dynamics for Emergence of Behaviour Change in Multidimensional Biology
Project/Area Number 22H05156
Research Category

Grant-in-Aid for Transformative Research Areas (A)

Allocation TypeSingle-year Grants
Review Section Transformative Research Areas, Section (III)
Research InstitutionAdvanced Telecommunications Research Institute International

Principal Investigator

CORTESE Aurelio  株式会社国際電気通信基礎技術研究所, 脳情報通信総合研究所, 研究室長 (60842028)

Co-Investigator(Kenkyū-buntansha) 川人 光男  株式会社国際電気通信基礎技術研究所, 脳情報通信総合研究所, 所長 (10144445)
細谷 晴夫  株式会社国際電気通信基礎技術研究所, 脳情報通信総合研究所, 主任研究員 (50335296)
Project Period (FY) 2022-06-16 – 2027-03-31
Project Status Granted (Fiscal Year 2025)
Budget Amount *help
¥108,420,000 (Direct Cost: ¥83,400,000、Indirect Cost: ¥25,020,000)
Fiscal Year 2026: ¥25,220,000 (Direct Cost: ¥19,400,000、Indirect Cost: ¥5,820,000)
Fiscal Year 2025: ¥24,960,000 (Direct Cost: ¥19,200,000、Indirect Cost: ¥5,760,000)
Fiscal Year 2024: ¥24,830,000 (Direct Cost: ¥19,100,000、Indirect Cost: ¥5,730,000)
Fiscal Year 2023: ¥14,170,000 (Direct Cost: ¥10,900,000、Indirect Cost: ¥3,270,000)
Fiscal Year 2022: ¥19,240,000 (Direct Cost: ¥14,800,000、Indirect Cost: ¥4,440,000)
Keywordsadaptive behavior change / reinforcement learning / metacognition / neural dynamics / cerebellum / 適応的行動変容 / テンソル成分分析 / multimodal neuroimaging / Adaptive behavior change / decision-making / prefrontal cortex / neuroimaging / decoded neurofeedback / learning / probabilistic PCA / behavioral change / neurofeedback
Outline of Research at the Start

Our research aims to revolutionise how we understand behaviour change. Over five years we will develop new computer algorithms that can very accurately analyse many behaviour measures from recordings of neural activity. Our team will apply machine learning techniques to complicated behavioural and neural data acquired from experiments in which mice and humans solve decision-making problems. We will then combine our new algorithms with advanced brain imaging in a novel experiment design, in both humans and mice, to control patterns of brain activity and cause changes in the targeted behaviour.

Outline of Annual Research Achievements

Research stream 1 (Hoang, Toyama, Kawato, Cortese): Our previous findings (Hoang et al. 2023) suggested that climbing fibre inputs encode reward-prediction errors, modulating Purkinje cell activity and refining motor behaviour. Building on this, our most recent study introduced three innovations. First, we applied Q-learning to model licking behaviour and extract reinforcement learning variables. Second, we performed regression analyses linking climbing fibre activity to reward and sensorimotor variables on a trial-by-trial basis. Third, we developed a cerebellar neural network model incorporating modular architecture with bidirectional plasticity. The results showed that distinct Purkinje cell modules could generate context-specific motor outputs based on reward-prediction error signals from climbing fibres (Hoang et al., 2025).
Research stream 2 (Okamoto, Six, Taylor, Ovadia, Oka, Gutierrez, Lobaskin, Cortese): We analysed and applied computational models - reinforcement learning and hierarchical Bayesian models - to study different confidence signals (perceptual, rule confidence) and their contributions to behaviour strategies (e.g. Okamoto et al. 2025). Importantly, we evaluated low-dimensional metacognitive representations in time and space across neuroimaging modalities (fMRI, MEG, ECoG). Beyond metacognitive signals, we also studied how beliefs about events transform and shape memories that later define behaviour changes (e.g., Cortese et al., 2024) We completed the neurofeedback experiment design.
We received the president award for our work related to neurofeedback.

Current Status of Research Progress
Current Status of Research Progress

2: Research has progressed on the whole more than it was originally planned.

Reason

Research stream 1 (Hoang, Toyama, Kawato, Cortese): we constructed a large-scale spiking neuron network (5000 neurons) that includes various neuron types found within the cerebellum. This model has a modular structure to reflect the organizational principles observed in the cerebellar cortex. We investigated the role of positive feedback loops and of Purkinje cells, cerebellar nucleus neurons, and inferior olive neurons, in generating self-organizing network dynamics. Integration with a basal ganglia module enables to explore the interactions between these two key brain regions in learning from reward signals. In parallel, we began preparation with the Matsuzaki lab on the mouse DecNef project, defining the target cortical regions and neural population coverage, the decoding approach, and the behaviour dimensions to be modified through neurofeedback.
Research stream 2 (Okamoto, Six, Taylor, Ovadia, Oka, Gutierrez, Lobaskin, Cortese): Our current focus is characterising multidimensional confidence representations at behaviour, computational, and neural levels. To this end, we are analysing behaviour and neuroimaging data (fMRI, ECoG, MEG) from our novel unique decision task, in collaboration with the De Martino Lab at UCL, and developing a new hierarchical decision model based on multiple sources of noisy uncertainty. To extend our work on low-dimensional metacognitive neural signals, we are piloting a new task and neurofeedback protocol to be used in the next fiscal year. We are also moving ahead with organising the first international symposium on DecNef in July 2025.

Strategy for Future Research Activity

Research stream 1 (Hoang, Toyama, Kawato, Cortese): Our collaborators (Kitamura lab) are collecting two-photon calcium imaging data of climbing fibre inputs in mice performing an advanced Go/NoGo task. This new paradigm allows us to differentiate (1) motor errors, (2) cognitive errors, and (3) reward-prediction errors. We will apply and extend our previous framework to this new dataset by performing TCA to identify low-dimensional, task-relevant components of climbing fibre activity. Next, we will use trial-by-trial regression analyses to relate climbing fibre activity in each component to behavioural variables. Finally, we will refine our existing cerebellar network model by incorporating the new data and perform simulations. In parallel, we will initiate with the Matsuzaki lab the mouse DecNef project.
Research stream 2 (Okamoto, Six, Taylor, Ovadia, Oka, Lobaskin, Cortese): we will refine our computational models to our behaviour data to test the link between metacognition (confidence) and behaviour change measures. In particular, we will be focusing on how metacognition reflects multiple sources of error uncertainty. Our multimodal neuroimaging data (fMRI, MEG, ECoG) allows us to evaluate comprehensively low-dimensional metacognitive representations. We plan to collect new behaviour data with eye tracking to evaluate a new physiological correlate of confidence. In parallel, we will start piloting our new human decoded neurofeedback experiment for behaviour change. Finally, we will host the first international symposium on decoded neurofeedback in Japan in July 2025.

Report

(3 results)
  • 2024 Annual Research Report
  • 2023 Annual Research Report
  • 2022 Annual Research Report
  • Research Products

    (47 results)

All 2025 2024 2023 Other

All Journal Article (9 results) (of which Int'l Joint Research: 3 results,  Peer Reviewed: 8 results,  Open Access: 8 results) Presentation (33 results) (of which Int'l Joint Research: 11 results,  Invited: 11 results) Remarks (5 results)

  • [Journal Article] Dopamine-induced relaxation of spike synchrony diversifies burst patterns in cultured hippocampal networks2025

    • Author(s)
      Hoang Huu、Matsumoto Nobuyoshi、Miyano Miyuki、Ikegaya Yuji、Cortese Aurelio
    • Journal Title

      Neural Networks

      Volume: 181 Pages: 106888-106888

    • DOI

      10.1016/j.neunet.2024.106888

    • Related Report
      2024 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Predictive reward-prediction errors of climbing fiber inputs integrate modular reinforcement learning with supervised learning2025

    • Author(s)
      Hoang Huu、Tsutsumi Shinichiro、Matsuzaki Masanori、Kano Masanobu、Toyama Keisuke、Kitamura Kazuo、Kawato Mitsuo
    • Journal Title

      PLOS Computational Biology

      Volume: 21 Issue: 3 Pages: 1012899-1012899

    • DOI

      10.1371/journal.pcbi.1012899

    • Related Report
      2024 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Interaction between the prefrontal and visual cortices supports subjective fear2024

    • Author(s)
      Taschereau-Dumouchel V, Cote Marjorie、Manuel Shawn、Valevicius Darius、Cushing Cody A.、Cortese Aurelio、Kawato Mitsuo、Lau HakwanTaschereau-Dumouchel Vincent、C
    • Journal Title

      Philosophical Transactions of the Royal Society B: Biological Sciences

      Volume: 379 Issue: 1908

    • DOI

      10.1098/rstb.2023.0245

    • Related Report
      2024 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Decoding and modifying dynamic attentional bias in gaming disorder2024

    • Author(s)
      Oka Taiki、Kubo Takatomi、Kobayashi Nao、Murakami Misa、Chiba Toshinori、Cortese Aurelio
    • Journal Title

      Philosophical Transactions of the Royal Society B: Biological Sciences

      Volume: 379 Issue: 1915

    • DOI

      10.1098/rstb.2023.0090

    • Related Report
      2024 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Context changes retrieval of prospective outcomes during decision deliberation2024

    • Author(s)
      Goktepe-Kavis P, Allen MF, Cortese A, Castegnetti G, Martino DB, Tzovara A.
    • Journal Title

      Cerebral Cortex

      Volume: 34 Issue: 12

    • DOI

      10.1093/cercor/bhae483

    • Related Report
      2024 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] The cognitive reality monitoring network and theories of consciousness2024

    • Author(s)
      Aurelio CORTESE, Mitsuo KAWATO
    • Journal Title

      Neuroscience Research

      Volume: 201 Pages: 31-38

    • DOI

      10.1016/j.neures.2024.01.007

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Goals, usefulness and abstraction in value-based choice2024

    • Author(s)
      Benedetto de MARTINO, Aurelio CORTESE
    • Journal Title

      Trends in Cognitive Sciences

      Volume: 27-1 Issue: 1 Pages: 65-80

    • DOI

      10.1016/j.tics.2022.11.001

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Dynamic organization of cerebellar climbing fiber response and synchrony in multiple functional components reduces dimensions for reinforcement learning2023

    • Author(s)
      Huu Hoang, Shinichiro Tsutsumi, Masanori Matsuzaki, Masanobu Kano, Mitsuo Kawato, Kazuo Kitamura, Keisuke Toyama
    • Journal Title

      eLife

      Volume: 12:e86340 Pages: 1-28

    • DOI

      10.7554/elife.86340

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Negative reward-prediction errors of climbing fiber inputs for cerebellar reinforcement learning algorithm2023

    • Author(s)
      Huu HOANG, Shinichiro TSUTSUMI, Masanori MATSUZAKI, Masanobu KANO, Keisuke TOYAMA, Kazuo KITAMURA, Mitsuo KAWATO
    • Journal Title

      bioRxiv(Web)

      Volume: -

    • DOI

      10.1101/2023.03.13.532374

    • Related Report
      2022 Annual Research Report
    • Open Access
  • [Presentation] A computaitonal model that reuses grid cells for structural analogy to learn abstract relational representations2025

    • Author(s)
      Haruo HOSOYA
    • Organizer
      脳と心のメカニズム・第24回冬のワークショップ
    • Related Report
      2024 Annual Research Report
  • [Presentation] Criterion adaptation link to environmental statistics induces metacognition ability shifting2025

    • Author(s)
      Shiyi CAO, Hugo SIX, Aurelio CORTESE, Kazushi IKEDA
    • Organizer
      脳と心のメカニズム・第24回冬のワークショップ
    • Related Report
      2024 Annual Research Report
  • [Presentation] Spiking network model of the cerebellum in go/no-go task2024

    • Author(s)
      HOANG Thien Huu, Shinichiro TSUTSUMI, Masanori MATSUZAKI, Masanobu KANO, Keisuke TOYAMA, Kazuo KITAMURA, Mitsuo KAWATO
    • Organizer
      第4回「行動変容生物学」領域会議
    • Related Report
      2024 Annual Research Report
  • [Presentation] Metacognitive control of behaviour change2024

    • Author(s)
      Aurelio CORTESE, Takuya ANZAI, Naoyuki OKAMOTO, Hugo SIX
    • Organizer
      第4回「行動変容生物学」領域会議
    • Related Report
      2024 Annual Research Report
  • [Presentation] Human brain forms sustained representations of goal-relevant stimuli and metacognition to allow credit assignment about ambiguous error sources2024

    • Author(s)
      Takuya ANZAI, Aurelio CORTESE
    • Organizer
      第4回「行動変容生物学」領域会議
    • Related Report
      2024 Annual Research Report
  • [Presentation] Overview of research at the department of decoded neurofeedback2024

    • Author(s)
      Aurelio CORTESE
    • Organizer
      Workshop at Ecole polytechnique federale de Lausanne (EPFL)
    • Related Report
      2024 Annual Research Report
    • Invited
  • [Presentation] 海馬系と抽象化に関する学習モデル2024

    • Author(s)
      細谷 晴夫
    • Organizer
      第7回脳情報の解読と制御研究会
    • Related Report
      2024 Annual Research Report
  • [Presentation] Reinforcement learning to model outcome-related activity in decoded neurofeedback2024

    • Author(s)
      Aurelio CORTESE
    • Organizer
      Seminar at Queen Mary University of London (QMUL)
    • Related Report
      2024 Annual Research Report
    • Invited
  • [Presentation] Reinforcement learning to model outcome-related activity in decoded neurofeedback2024

    • Author(s)
      Aurelio CORTESE
    • Organizer
      Real-Time Functional Imaging and Neurofeedback meeting (rtFIN2024)
    • Related Report
      2024 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Context-dependent metacognitive signals govern adaptive decision-making2024

    • Author(s)
      Maria Juliana GUTIERREZ CAMPEROS, Aurelio CORTESE
    • Organizer
      一般社団法人日本神経回路学会 第34回 全国大会 (JNNS2024)
    • Related Report
      2024 Annual Research Report
  • [Presentation] Confidence, abstractions, and learning in humans and machines2024

    • Author(s)
      Aurelio CORTESE
    • Organizer
      Seminar at Center for Neuroscience Imaging Research (SKKU)
    • Related Report
      2024 Annual Research Report
    • Invited
  • [Presentation] Multiple metacognitive signals contribute to credit assignment about ambiguous error sources2024

    • Author(s)
      Takuya ANZAI, Aurelio CORTESE
    • Organizer
      「行動変容生物学」第2回国際シンポジウム
    • Related Report
      2024 Annual Research Report
  • [Presentation] Using categories to infer reward without direct experience2024

    • Author(s)
      Jessica TAYLOR, Taiki OKA, Aurelio CORTESE
    • Organizer
      「行動変容生物学」第2回国際シンポジウム
    • Related Report
      2024 Annual Research Report
  • [Presentation] Metacognition for adaptive behaviour2024

    • Author(s)
      Aurelio CORTESE
    • Organizer
      「行動変容生物学」第2回国際シンポジウム
    • Related Report
      2024 Annual Research Report
    • Invited
  • [Presentation] Decoded Neurofeedback's potential as psychological inoculation for countering false information2024

    • Author(s)
      Mikihiro KASAHARA, Taiki OKA, Hiroki TANAKURA, Aurelio CORTESE
    • Organizer
      33rd International Congress of Psychology (ICP2024)
    • Related Report
      2024 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Computational framework to study reinforcement learning in the cerebellum2024

    • Author(s)
      HOANG Thien Huu
    • Organizer
      33rd Annual Computational Neuroscience Meeting(CNS2024)
    • Related Report
      2024 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Origins and functions of metacognition2024

    • Author(s)
      Aurelio CORTESE
    • Organizer
      Columbia University's Practicum in Global Neuroscience program
    • Related Report
      2024 Annual Research Report
    • Invited
  • [Presentation] Dopamine-induced relaxation of connectivity diversifies burst patterns in cultured hippocampal networks2024

    • Author(s)
      HOANG Thien Huu, Nobuyoshi MATSUMOTO, Miyuki MIYANO, Yuji IKEGAYA, Aurelio CORTESE
    • Organizer
      第47回日本神経科学大会(Neuro2024)
    • Related Report
      2024 Annual Research Report
  • [Presentation] Metacognition as the detection of internal signals2024

    • Author(s)
      Aurelio CORTESE
    • Organizer
      QB3:Qualia, Brain, Body, Behavior
    • Related Report
      2023 Annual Research Report
    • Invited
  • [Presentation] Human action-outcome inference through weighted evidence accumulation with subjective uncertainty2024

    • Author(s)
      Naoyuki OKAMOTO
    • Organizer
      Computational and Systems Neuroscience (COSYNE) 2024
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Multiple metacognitive information in different time intervals contributes to the arbitration of credit assignment in a goal-driven task2023

    • Author(s)
      Takuya ANZAI
    • Organizer
      The Machine Learning Summer School in Okinawa 2024
    • Related Report
      2023 Annual Research Report
  • [Presentation] Negative reward-prediction errors of climbing fiber inputs for cerebellar reinforcement learning algorithm2023

    • Author(s)
      Huu HOANG
    • Organizer
      第46回日本神経科学大会(Neuro2023)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Dynamic organization of cerebellar climbing fiber response and synchrony in multiple functional modules reduces dimensions for reinforcement learning2023

    • Author(s)
      Huu HOANG
    • Organizer
      2023 Cerebellum Gordon Research Conference
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Metacognition as a mechanism for concurrent monitoring and updating of internal representations2023

    • Author(s)
      Aurelio CORTESE
    • Organizer
      第46回日本神経科学大会(Neuro2023)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Cross-species mechanisms of learning and adaptive behaviour2023

    • Author(s)
      Aurelio CORTESE
    • Organizer
      第46回日本神経科学大会(Neuro2023)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] How can we assess subjective experiences and internal representations in the brain?2023

    • Author(s)
      Aurelio CORTESE
    • Organizer
      The Organization for Human Brain Mapping (OHBM2023)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Metacognition of nonconscious neural representations2023

    • Author(s)
      Aurelio CORTESE
    • Organizer
      The Organization for Human Brain Mapping (OHBM2023)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Metacognition for monitoring and updating of internal abstract representations2023

    • Author(s)
      Aurelio CORTESE
    • Organizer
      Seminar at Ecole normale superieure
    • Related Report
      2023 Annual Research Report
    • Invited
  • [Presentation] Confidence, abstractions and reinforcement learning in humans and machines2023

    • Author(s)
      Aurelio CORTESE
    • Organizer
      the 26th annual meeting of the Korean Society for Brain and Neural Sciences (KSBNS2023)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Confidence, abstractions and reinforcement learning in humans and machines2023

    • Author(s)
      Aurelio CORTESE
    • Organizer
      Seminar at Korea Advanced Institute of Science and Technology (KAIST)
    • Related Report
      2023 Annual Research Report
    • Invited
  • [Presentation] Confidence in hierarchical decision-making2023

    • Author(s)
      Takeru MISAWA
    • Organizer
      脳と心のメカニズム冬のワークショップ2023
    • Related Report
      2022 Annual Research Report
  • [Presentation] Self-organization of cognitive modules in cerebro-cerebellar communication loop2023

    • Author(s)
      Mitsuo KAWATO
    • Organizer
      新学術領域「脳情報動態」第3回国際シンポジウム
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] Metacognition as a mechanism for concurrent monitoring and updating of internal representations2023

    • Author(s)
      Aurelio CORTESE
    • Organizer
      「行動変容生物学」第1回国際シンポジウム
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Remarks] ATR行動変容研究室研究成果

    • URL

      https://bicr.atr.jp/decnef/publications/

    • Related Report
      2023 Annual Research Report 2022 Annual Research Report
  • [Remarks] ATR行動変容研究室Publications

    • URL

      https://bicr.atr.jp/decnef/en/publications-2/

    • Related Report
      2023 Annual Research Report 2022 Annual Research Report
  • [Remarks] ATR計算脳イメージング研究室出版物

    • URL

      https://bicr.atr.jp/cbi/publications/

    • Related Report
      2023 Annual Research Report 2022 Annual Research Report
  • [Remarks] ATR計算脳イメージング研究室Publications

    • URL

      https://bicr.atr.jp/cbi/publications/?lang=en

    • Related Report
      2023 Annual Research Report 2022 Annual Research Report
  • [Remarks] Mitsuo Kawato Publication List English Paper

    • URL

      https://bicr.atr.jp/~kawato/pubep.html

    • Related Report
      2023 Annual Research Report 2022 Annual Research Report

URL: 

Published: 2022-06-20   Modified: 2026-04-10  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi