Generalization of Stimulus Value in Reinforcement Learning
强化学习中刺激值的推广
基本信息
- 批准号:RGPIN-2014-05069
- 负责人:
- 金额:$ 2.26万
- 依托单位:
- 依托单位国家:加拿大
- 项目类别:Discovery Grants Program - Individual
- 财政年份:2019
- 资助国家:加拿大
- 起止时间:2019-01-01 至 2020-12-31
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
The goal of my research program is to determine how reward learning and motivational processes are encoded in neural activity in the striatum. To accomplish this goal, I am studying different facets of information processing in this brain region, starting with how specific glutamate inputs impact the extent to which animals generalize from past experience. **Stimulus generalization is a process where predictive value is ascribed to novel stimuli that are perceptually similar to previously learned stimuli. This results in animals' actively approaching or avoiding stimuli that they have never previously encountered. The neurobiological mechanisms underlying this phenomenon are of great interest, as there is a wide variability in the extent that humans generalize, and certain neuropsychiatric conditions, such as schizophrenia, generalized anxiety disorder, and post-traumatic stress disorder, are associated with marked abnormalities in this process. The research proposal described here utilizes modern neuroscience techniques to manipulate neural activity at precise moments during reward seeking with the goal of gaining mechanistic insight into the neurobiology of stimulus generalization.**The research focuses on information processing in a part of the ventral striatum called the nucleus accumbens. This area integrates midbrain dopaminergic signals with excitatory input from cortical structures. The principal excitatory afferents to the nucleus accumbens come from the ventral hippocampus, basolateral amygdala, and prefrontal cortex, all regions which are thought to regulate distinct aspects of memory. Recent data from human fMRI research have implicated these glutamate inputs to the nucleus accumbens in regulating the extent to which people generalize during simple reward-seeking tasks. These findings are consistent with data from gain of function experiments in rodents, which demonstrate that enhanced activity in each of these pathways is sufficient to reinforce and motivate instrumental behavior.**The technical approach I am proposing involves inhibiting discrete glutamate inputs to the nucleus accumbens at specific moments during a discriminative cue learning task. Optogenetic techniques will be used to accomplish this, which utilize genetically-encoded, light-sensitive proteins to inhibit neural activity. The spatial and temporal precision afforded by these techniques allow for pathway-specific inhibition of transmitter release at precise moments during learning and choice behaviour. I have extensive experience with this approach, with integrating optogenetic manipulations with clever behavioural assays. My publication record underscores how I am a well-qualified, highly trained, and committed researcher with a passion for studying the neural circuits underlying motivated behaviour. **The overarching goal of the research proposed here is to understand how activity in different glutamate inputs to the nucleus accumbens impacts reward-related learning and choice behaviour. This work will be of wide interest as it touches upon the foundations of motivation, decision making, and reinforcement learning. In addition, the multifaceted nature of this research will provide trainees with extensive technical skills as well as experience collecting, analyzing, and interpreting data. **Ultimately, my research program will further our understanding of specific neuropsychiatric conditions. This will hopefully lead to novel treatments and alleviate some of the social stigma attached to these disorders. A better understanding of mental disease from a neural system prospective is absolutely necessary to promote mental health-related rational drug discovery.
我的研究项目的目标是确定奖励学习和动机过程是如何编码在纹状体的神经活动中的。为了实现这一目标,我正在研究这个大脑区域信息处理的不同方面,从特定的谷氨酸输入如何影响动物从过去经验中概括的程度开始。** 刺激泛化是一个将预测价值归因于与先前学习的刺激在感知上相似的新刺激的过程。这导致动物主动接近或回避它们以前从未遇到过的刺激。这一现象背后的神经生物学机制引起了极大的兴趣,因为人类概括的程度存在很大的差异,某些神经精神疾病,如精神分裂症,广泛性焦虑症和创伤后应激障碍,与这一过程中的显着异常有关。这里描述的研究方案利用现代神经科学技术,在奖赏寻求过程中的精确时刻操纵神经活动,目的是获得对刺激泛化的神经生物学的机械见解。这项研究的重点是腹侧纹状体中一个被称为丘脑核的部分的信息处理。该区域整合中脑多巴胺能信号与来自皮质结构的兴奋性输入。丘脑核的主要兴奋性传入来自腹侧海马、基底外侧杏仁核和前额叶皮层,所有这些区域都被认为调节记忆的不同方面。最近的人类功能磁共振成像研究数据表明,这些谷氨酸输入到丘脑核中,调节人们在简单的奖励寻求任务中概括的程度。这些发现与啮齿动物功能获得实验的数据一致,这些实验表明,这些途径中每一个的活性增强都足以加强和激励工具性行为。我提出的技术方法涉及在辨别性线索学习任务期间的特定时刻抑制离散谷氨酸输入到丘脑核。光遗传学技术将用于实现这一目标,该技术利用遗传编码的光敏蛋白来抑制神经活动。这些技术所提供的空间和时间精度允许在学习和选择行为期间的精确时刻对发射器释放进行通路特异性抑制。我对这种方法有着丰富的经验,将光遗传学操作与聪明的行为分析相结合。我的出版记录强调了我是一个合格的,受过良好训练的,致力于研究动机行为背后的神经回路的研究人员。** 这里提出的研究的首要目标是了解不同谷氨酸输入到丘脑核的活动如何影响奖励相关的学习和选择行为。这项工作将引起广泛的兴趣,因为它涉及动机,决策和强化学习的基础。此外,这项研究的多方面性质将为学员提供广泛的技术技能以及收集,分析和解释数据的经验。** 最终,我的研究计划将进一步加深我们对特定神经精神疾病的理解。这将有望导致新的治疗方法,并减轻与这些疾病有关的一些社会耻辱。从神经系统的角度更好地理解精神疾病是促进精神健康相关的合理药物发现绝对必要的。
项目成果
期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
数据更新时间:{{ journalArticles.updateTime }}
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Britt, Jonathan其他文献
Britt, Jonathan的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Britt, Jonathan', 18)}}的其他基金
The impact of dopamine signaling on cell type-specific striatal neuron activity in vivo
多巴胺信号传导对体内细胞类型特异性纹状体神经元活动的影响
- 批准号:
RGPIN-2020-05100 - 财政年份:2022
- 资助金额:
$ 2.26万 - 项目类别:
Discovery Grants Program - Individual
The impact of dopamine signaling on cell type-specific striatal neuron activity in vivo
多巴胺信号传导对体内细胞类型特异性纹状体神经元活动的影响
- 批准号:
RGPAS-2020-00028 - 财政年份:2022
- 资助金额:
$ 2.26万 - 项目类别:
Discovery Grants Program - Accelerator Supplements
Single cell resolution multiscope recording and manipulation of striatal circuitry during decision making
决策过程中纹状体电路的单细胞分辨率多范围记录和操作
- 批准号:
RTI-2023-00406 - 财政年份:2022
- 资助金额:
$ 2.26万 - 项目类别:
Research Tools and Instruments
The impact of dopamine signaling on cell type-specific striatal neuron activity in vivo
多巴胺信号传导对体内细胞类型特异性纹状体神经元活动的影响
- 批准号:
RGPIN-2020-05100 - 财政年份:2021
- 资助金额:
$ 2.26万 - 项目类别:
Discovery Grants Program - Individual
The impact of dopamine signaling on cell type-specific striatal neuron activity in vivo
多巴胺信号传导对体内细胞类型特异性纹状体神经元活动的影响
- 批准号:
RGPAS-2020-00028 - 财政年份:2021
- 资助金额:
$ 2.26万 - 项目类别:
Discovery Grants Program - Accelerator Supplements
The impact of dopamine signaling on cell type-specific striatal neuron activity in vivo
多巴胺信号传导对体内细胞类型特异性纹状体神经元活动的影响
- 批准号:
RGPIN-2020-05100 - 财政年份:2020
- 资助金额:
$ 2.26万 - 项目类别:
Discovery Grants Program - Individual
The impact of dopamine signaling on cell type-specific striatal neuron activity in vivo
多巴胺信号传导对体内细胞类型特异性纹状体神经元活动的影响
- 批准号:
RGPAS-2020-00028 - 财政年份:2020
- 资助金额:
$ 2.26万 - 项目类别:
Discovery Grants Program - Accelerator Supplements
Generalization of Stimulus Value in Reinforcement Learning
强化学习中刺激值的推广
- 批准号:
RGPIN-2014-05069 - 财政年份:2018
- 资助金额:
$ 2.26万 - 项目类别:
Discovery Grants Program - Individual
Generalization of Stimulus Value in Reinforcement Learning
强化学习中刺激值的推广
- 批准号:
RGPIN-2014-05069 - 财政年份:2017
- 资助金额:
$ 2.26万 - 项目类别:
Discovery Grants Program - Individual
Generalization of Stimulus Value in Reinforcement Learning
强化学习中刺激值的推广
- 批准号:
RGPIN-2014-05069 - 财政年份:2016
- 资助金额:
$ 2.26万 - 项目类别:
Discovery Grants Program - Individual
相似海外基金
Generalization of Stimulus Value in Reinforcement Learning
强化学习中刺激值的推广
- 批准号:
RGPIN-2014-05069 - 财政年份:2018
- 资助金额:
$ 2.26万 - 项目类别:
Discovery Grants Program - Individual
Generalization of Stimulus Value in Reinforcement Learning
强化学习中刺激值的推广
- 批准号:
RGPIN-2014-05069 - 财政年份:2017
- 资助金额:
$ 2.26万 - 项目类别:
Discovery Grants Program - Individual
Generalization of Stimulus Value in Reinforcement Learning
强化学习中刺激值的推广
- 批准号:
RGPIN-2014-05069 - 财政年份:2016
- 资助金额:
$ 2.26万 - 项目类别:
Discovery Grants Program - Individual
The signal value of the unconditioned stimulus in Pavlovian conditioning
巴甫洛夫条件反射中无条件刺激的信号值
- 批准号:
42025-2005 - 财政年份:2015
- 资助金额:
$ 2.26万 - 项目类别:
Discovery Grants Program - Individual
Generalization of Stimulus Value in Reinforcement Learning
强化学习中刺激值的推广
- 批准号:
RGPIN-2014-05069 - 财政年份:2015
- 资助金额:
$ 2.26万 - 项目类别:
Discovery Grants Program - Individual
Generalization of Stimulus Value in Reinforcement Learning
强化学习中刺激值的推广
- 批准号:
RGPIN-2014-05069 - 财政年份:2014
- 资助金额:
$ 2.26万 - 项目类别:
Discovery Grants Program - Individual
The signal value of the unconditioned stimulus in Pavlovian conditioning
巴甫洛夫条件反射中无条件刺激的信号值
- 批准号:
42025-2005 - 财政年份:2012
- 资助金额:
$ 2.26万 - 项目类别:
Discovery Grants Program - Individual
The signal value of the unconditioned stimulus in Pavlovian conditioning
巴甫洛夫条件反射中无条件刺激的信号值
- 批准号:
42025-2005 - 财政年份:2010
- 资助金额:
$ 2.26万 - 项目类别:
Discovery Grants Program - Individual
HOW INHIBITORY CONTROL MODIFIES STIMULUS VALUE AND MOTIVATION
抑制控制如何改变刺激价值和动机
- 批准号:
9270008 - 财政年份:2009
- 资助金额:
$ 2.26万 - 项目类别:
HOW INHIBITORY CONTROL MODIFIES STIMULUS VALUE AND MOTIVATION
抑制控制如何改变刺激价值和动机
- 批准号:
8695731 - 财政年份:2009
- 资助金额:
$ 2.26万 - 项目类别: