课题基金 / 基金详情

Corticostriatal mechanisms of causal inference and temporal credit assignment.

Corticostriatal mechanisms of causal inference and temporal credit assignment.
因果推理和时间信用分配的皮质纹状体机制。
批准号:
10700738
负责人:
Hyojung Seo
金额:
$77.89万
依托单位:
依托单位国家:
美国
项目类别:
财政年份:
2020
资助国家:
美国
项目状态:
未结题
起止时间:
2020-09-30 至 2025-06-30

项目摘要

项目成果

Hyojung Seo的其他基金

相似基金

相关文献

中文摘要
翻译
从经验中学习期望的行动需要通过整合的方法来评估可选择的行动
英文摘要
Learning desired actions from experience requires evaluating alternative actions by integrating the consequences assigned to each action over time. In the real world, actions and outcomes occur in complex sequences, and a continuous stream of events must be parsed into appropriate pairs of causative action and outcome before such pairs can be evaluated. However, how the brain solves this problem, known as temporal credit assignment (TCA) is unknown. The goal of the proposed project is to use an innovative paradigm and test novel hypotheses regarding the role of heterogeneous dynamics of memory in the prefrontal cortex in TCA. In our contextual lagged bandit task, monkeys will choose between three options offered in one of two alternating contexts, but feedback for a choice in one context will be temporally delayed and delivered after another choice is made in the other context. Learning optimal choices in this task consists of two parts: causal inference for learning the causal structure or model of the task, and model-based TCA for learning the value of each choice. Learning from delayed outcome requires memory of a chosen action or eligibility trace (ET). Although theories postulate that ET exponentially decays over time (i.e. exp-ET), exp-ET cannot resolve TCA when causative action is separated from the outcome in time and by irrelevant events. We hypothesize the flexible dynamics of ET might be crucial for causal inference and model-based TCA. More specifically, we hypothesize that model-based TCA requires dynamically-modulated ET (dynamic- ET) which is selectively activated at the predicted time of its outcome to obviate receiving credits from intervening events. For causal inference, we hypothesize that memory of past actions might be re-activated by hindsight in search of a new causal link (i.e. hypothetical ET, hyp-ET). We also hypothesize that ET might be strongly sustained until the lagged feedback (i.e. persistent ET, persist-ET) to test the accuracy of new link at the expense of confounding intervening inputs. We will investigate how flexible dynamics of ETs might be supported by heterogeneous dynamics of neural activity across different regions of cortico-striatal network. First, we will assess whether the primate prefrontal cortex (PFC) provides dynamic-ET for model-based TCA, whereas the striatum provides exp-ET for contiguity-based TCA. Second, we will assess whether dorsomedial and dorsolateral PFC provide hyp-ET and persist-ET, respectively. We will take a highly integrative approach and combine multi-scale neural recordings, perturbations and computational modeling to examine whether and how complex patterns and dynamics of neural activity in the prefrontal cortex constitute necessary and sufficient conditions to support model-based TCA. The proposed project will transform the conventional view of memory as storage, recasting memory as an integral part of learning and reasoning with temporal dynamics being its key structure. Causal inference is central to dysfunction in the individuals with psychotic symptoms and our work will contribute to understanding underlying prefrontal pathophysiology.
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
Corticostriatal mechanisms of causal inference and temporal credit assignment.
  • 批准号:
    10053605
  • 项目类别:
  • 资助金额:
    $219.47万
  • 财政年份:
    2020
  • 负责人:
    Hyojung Seo
  • 依托单位:
国内基金
海外基金
Exploring the Intrinsic Mechanisms of CEO Turnover and Market
  • 批准号:
    --
  • 项目类别:
    外国学者研究基金
  • 资助金额:
    --
  • 批准年份:
    2024
  • 负责人:
    HAOFEI Z
  • 依托单位:
Exploring the Intrinsic Mechanisms of CEO Turnover and Market Reaction: An Explanation Based on Information Asymmetry
  • 批准号:
    W2433169
  • 项目类别:
    外国学者研究基金项目
  • 资助金额:
    --
  • 批准年份:
    2024
  • 负责人:
    HAOFEI ZHANG
  • 依托单位:
Erk1/2/CREB/BDNF通路在CSF1R相关性白质脑病致病机制中的作用研究
  • 批准号:
    82371255
  • 项目类别:
    面上项目
  • 资助金额:
    49.00万元
  • 批准年份:
    2023
  • 负责人:
    曹立
  • 依托单位:
Foxc2介导Syap1/Akt信号通路调控破骨/成骨细胞分化促进颞下颌关节骨关节炎的机制研究
  • 批准号:
    82370979
  • 项目类别:
    面上项目
  • 资助金额:
    48.00万元
  • 批准年份:
    2023
  • 负责人:
    张善勇
  • 依托单位: