Frontostriatal Rhythms Underlying Reinforcement Learning.
Frontostriatal Rhythms Underlying Reinforcement Learning.
批准号:
10401263
负责人:
Joni D Wallis
金额:
$37.97万
依托单位国家:
美国
项目类别:
财政年份:
2018
资助国家:
美国
项目状态:
已结题
起止时间:
2018-07-23 至 2024-04-30
关键词:
AdoptedAnimalsAreaArtificial ArmBrainBrain regionChronicClinicalClinical TrialsCodeCommunicationComputersCorpus striatum structureDecision MakingDeep Brain StimulationDiseaseEnvironmentFrequenciesFunctional disorderFutureHumanImpairmentInterventionLearningMeasurementMeasuresMethodsModelingMonkeysMood DisordersMotorMovementMovement DisordersNatureNeuronsNeurosciencesObsessive-Compulsive DisorderOutcomePatternPharmacologic SubstancePhasePredictive ValuePrimatesProcessPsychological reinforcementResearchRodentRodent ModelRoleStimulusStructureSymptomsTestingTheta RhythmTimeTrainingTranslatingWorkaddictionawakebasebrain machine interfacecaudate nucleusclassical conditioningcognitive processcomputer frameworkelectrical microstimulationfrontal lobelearned behaviormicrostimulationneurophysiologyneuropsychiatric disordernovel therapeutic interventionpreventrelating to nervous systemresponsespatiotemporalsuccesstime use
中文摘要
项目总结
英文摘要
Project summary
Many neuropsychiatric disorders, including obsessive-compulsive disorder, mood disorders and addiction,
involve compromised evaluative and decision-making processes, and maladaptive learned associations. A
computational framework that has proven useful in reconciling these different clinical symptoms is
reinforcement learning (RL), which dictates how to optimally interact with the environment to maximize
potential benefits and mitigate negative consequences. Work over the past several decades has revealed that
frontostriatal brain circuits are key mechanistic components of RL. However, the precise nature of the
interaction between the frontal cortex and the striatum, and how this communication is achieved, remains
unclear.
The current proposal focuses on orbitofrontal cortex (OFC) and the caudate nucleus (CN). OFC assigns values
to stimuli in our environment, which enables us to make optimal decisions. However, it contains little
information about potential motor responses. Our hypothesis is that OFC transfers value information to CN,
where it in can be used to select the choice response that will lead to the highest value outcome. We
hypothesize that this communication occurs via a phase reset of the local field potential in the theta band at the
time of the choice.
To test this hypothesis, we will simultaneously record both single neurons and local field potentials from OFC
and CN in awake, behaving animals trained to perform an RL task. We will particularly focus on the
spatiotemporal dynamics in LFPs between regions, and their relationship to local neuronal computations. We
will test the causal role of OFC theta in enabling frontostriatal communication by applying frequency specific
microstimulation to OFC while simultaneously recording neural activity in CN. Finally, we will determine
whether we can manipulate RL processes using `closed-loop' control, in which we use neural measurements of
OFC theta to control the application of microstimulation to CN. Taken together, the results of this proposal will
provide convergent correlative and causal evidence for the role of OFC and CN in RL, as well as determine the
mechanism by which the two areas communicate. In addition, it will lay the groundwork for future BMI
approaches focused on frontolimbic interventions to manipulate maladaptive associations.
期刊论文(5)
专著(0)
科研奖励(0)
会议论文
DOI:
10.1038/s41593-023-01535-w
发表时间:
2024
期刊:
Nature neuroscience
影响因子:
25
作者:
[Muller,TimothyH, Butler,JamesL, Veselic,Sebastijan, Miranda,Bruno, Wallis,JoniD, Dayan,Peter, Behrens,TimothyEJ, Kurth-Nelson,Zeb, Kennerley,StevenW]
通讯作者:
Kennerley,StevenW
Hybrid dedicated and distributed coding in PMd/M1 provides separation and interaction of bilateral arm signals.
在PMD/M1中的混合专用和分布式编码提供了双边臂信号的分离和相互作用。
DOI:
10.1371/journal.pcbi.1009615
发表时间:
2021-11
期刊:
PLoS computational biology
影响因子:
4.3
作者:
[Dixon TC, Merrick CM, Wallis JD, Ivry RB, Carmena JM]
通讯作者:
Carmena JM
DOI:
10.1016/j.tics.2018.09.002
发表时间:
2018-12
期刊:
Trends in cognitive sciences
影响因子:
19.9
作者:
[Wallis JD]
通讯作者:
Wallis JD
Neuronal mechanisms of model-based learning
-
批准号:10722261
-
项目类别:
-
资助金额:$57.79万
-
财政年份:2023
-
负责人:Joni D Wallis
-
依托单位:
Hippocampal-orbitofrontal interactions and reward learning
-
批准号:10297842
-
项目类别:
-
资助金额:$43.26万
-
财政年份:2019
-
负责人:Joni D Wallis
-
依托单位:
Hippocampal-orbitofrontal interactions and reward learning
-
批准号:10380534
-
项目类别:
-
资助金额:$7.88万
-
财政年份:2019
-
负责人:Joni D Wallis
-
依托单位:
Hippocampal-orbitofrontal interactions and reward learning
-
批准号:10064645
-
项目类别:
-
资助金额:$45.5万
-
财政年份:2019
-
负责人:Joni D Wallis
-
依托单位:
Hippocampal-orbitofrontal interactions and reward learning
-
批准号:10516049
-
项目类别:
-
资助金额:$41.77万
-
财政年份:2019
-
负责人:Joni D Wallis
-
依托单位:
Hippocampal-orbitofrontal interactions and reward learning
-
批准号:10724154
-
项目类别:
-
资助金额:$7.88万
-
财政年份:2019
-
负责人:Joni D Wallis
-
依托单位:
The Unlearning of Stimulus-Outcome Associations through Intracortical Microstimulation
-
批准号:9262185
-
项目类别:
-
资助金额:$19.63万
-
财政年份:2016
-
负责人:Joni D Wallis
-
依托单位:
The role of dopamine in anterior cingulate prediction errors
-
批准号:8638633
-
项目类别:
-
资助金额:$24.9万
-
财政年份:2014
-
负责人:Joni D Wallis
-
依托单位:
Functional Architecture of Oribitofrontal Cortex
-
批准号:9036445
-
项目类别:
-
资助金额:$37.97万
-
财政年份:2014
-
负责人:Joni D Wallis
-
依托单位:
Functional Architecture of Oribitofrontal Cortex
-
批准号:8696474
-
项目类别:
-
资助金额:$35.03万
-
财政年份:2014
-
负责人:Joni D Wallis
-
依托单位:
Functional Architecture of Oribitofrontal Cortex
-
批准号:8829341
-
项目类别:
-
资助金额:$37.37万
-
财政年份:2014
-
负责人:Joni D Wallis
-
依托单位:
The Neural Representation of Reward in Working Memory
-
批准号:6966754
-
项目类别:
-
资助金额:$26.12万
-
财政年份:2005
-
负责人:Joni D Wallis
-
依托单位:
Neural representation of reward in frontal cortex
-
批准号:8017427
-
项目类别:
-
资助金额:$47.65万
-
财政年份:2005
-
负责人:Joni D Wallis
-
依托单位:
The Neural Representation of Reward in Working Memory
-
批准号:7651468
-
项目类别:
-
资助金额:$35.68万
-
财政年份:2005
-
负责人:Joni D Wallis
-
依托单位:
Neural representation of reward in frontal cortex
-
批准号:8207413
-
项目类别:
-
资助金额:$3.51万
-
财政年份:2005
-
负责人:Joni D Wallis
-
依托单位:
Neural representation of reward in frontal cortex
-
批准号:8288228
-
项目类别:
-
资助金额:$40.69万
-
财政年份:2005
-
负责人:Joni D Wallis
-
依托单位:
Neural representation of reward in frontal cortex
-
批准号:8101429
-
项目类别:
-
资助金额:$6.45万
-
财政年份:2005
-
负责人:Joni D Wallis
-
依托单位:
Neural representation of reward in frontal cortex
-
批准号:8490320
-
项目类别:
-
资助金额:$34.99万
-
财政年份:2005
-
负责人:Joni D Wallis
-
依托单位:
The Neural Representation of Reward in Working Memory
-
批准号:7122823
-
项目类别:
-
资助金额:$26.23万
-
财政年份:2005
-
负责人:Joni D Wallis
-
依托单位:
The Neural Representation of Reward in Working Memory
-
批准号:7462333
-
项目类别:
-
资助金额:$34.88万
-
财政年份:2005
-
负责人:Joni D Wallis
-
依托单位:
海外基金