Neural mechanisms underlying simple and complex reinforcement learning

简单和复杂强化学习背后的神经机制

基本信息

  • 批准号:
    7330882
  • 负责人:
  • 金额:
    $ 3.51万
  • 依托单位:
  • 依托单位国家:
    美国
  • 项目类别:
  • 财政年份:
    2007
  • 资助国家:
    美国
  • 起止时间:
    2007-09-01 至 2010-08-31
  • 项目状态:
    已结题

项目摘要

DESCRIPTION (provided by applicant): In order to guide motivated behavior, humans and animals need to be able to flexibly evaluate the affective values - positive or negative - of stimuli in the environment. This process may go awry in psychiatric disorders; for example, in post-traumatic stress disorder (PTSD), an overly negative, inflexible value may be assigned to certain stimuli associated a trauma, even in a context where they should be non- threatening. The focus of this proposal is on how the values of stimuli are represented in the brain, and how this representation changes in response to changing environmental context. To investigate this, neural activity will be recorded simultaneously in two brain areas - the amygdala and orbitofrontal cortex (OFC) - while monkeys perform one of two tasks: a simple conditioning task, in which visual stimuli become linked with reward or punishment, and a context-dependent task, in which the meaning of visual stimuli changes from moment to moment depending upon contextual cues. The simpler task will reveal whether and how stimulus value is represented by individual neurons in OFC and amygdala, and will provide information about the relative timing of these "value signals" that may clarify how these two areas interact. The more complex task will reveal whether these signals can change flexibly enough to reflect the value of a stimulus when it can change rapidly depending on context. It may also reveal whether and how contextual information - i.e., the "rule" for interpreting the value of a stimulus - is encoded in OFC and/or amygdala. Together, these experiments may elucidate how value assignments are formed and then modulated by a neural circuit involving limbic areas (such as the amygdala) and areas that may be involved in the executive control of emotional responses (such as OFC). Learning how this circuit functions normally is an important first step in understanding how it may dysfunction in psychiatric disorders like PTSD, clinical depression, and schizophrenia. Relevance: In order to make everyday decisions, people (and animals) need to be able to assign values (such as "good" or "bad") to objects in the environment, and sometimes to change these values depending on the context in which an object occurs. This process is disrupted in many psychiatric disorders, such as depression and post-traumatic stress disorder. The focus of this proposal is on understanding how emotional and cognitive brain areas interact to learn and modify the values of objects - knowledge that may aid our understanding, and eventually treatment, of the causes of psychiatric disorders.
描述(由申请人提供):为了引导动机行为,人类和动物需要能够灵活地评估环境中刺激的情感价值-积极或消极。这一过程在精神疾病中可能会出错;例如,在创伤后应激障碍(PTSD)中,与创伤相关的某些刺激可能被赋予过于消极、不灵活的价值,即使在它们本不应具有威胁性的环境中也是如此。这个建议的重点是刺激的价值是如何在大脑中表现出来的,以及这种表现是如何随着环境的变化而变化的。为了研究这一点,当猴子执行两项任务中的一项时,将同时记录两个大脑区域——杏仁核和眶额皮质(OFC)的神经活动:一项是简单的条件反射任务,其中视觉刺激与奖励或惩罚联系在一起;另一项是情境依赖任务,其中视觉刺激的意义随上下文线索而随时变化。更简单的任务将揭示刺激值是否以及如何由OFC和杏仁核的单个神经元表示,并将提供有关这些“价值信号”的相对时间的信息,从而可能阐明这两个区域如何相互作用。更复杂的任务将揭示这些信号是否能够灵活地变化,以反映刺激的价值,当它可以根据环境快速变化时。它还可能揭示上下文信息——即解释刺激值的“规则”——是否以及如何在OFC和/或杏仁核中编码。总之,这些实验可能阐明了价值分配是如何形成的,然后由一个涉及边缘区域(如杏仁核)和可能涉及情绪反应执行控制的区域(如OFC)的神经回路来调节。了解这个回路如何正常运作是理解它如何在PTSD、临床抑郁症和精神分裂症等精神疾病中起作用的重要的第一步。相关性:为了做出日常决策,人(和动物)需要能够为环境中的对象分配值(例如“好”或“坏”),并且有时需要根据对象发生的上下文更改这些值。这一过程在许多精神疾病中被破坏,比如抑郁症和创伤后应激障碍。这一建议的重点是理解情感和认知大脑区域如何相互作用,以学习和修改对象的价值-这些知识可能有助于我们理解并最终治疗精神疾病的原因。

项目成果

期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ monograph.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ sciAawards.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ conferencePapers.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ patent.updateTime }}

Sara Morrison其他文献

Sara Morrison的其他文献

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

{{ truncateString('Sara Morrison', 18)}}的其他基金

Neural Mechanisms of Habit Formation for Behaviors Motivated by Drugs of Abuse and Natural Reward
滥用药物和自然奖励引起的行为习惯形成的神经机制
  • 批准号:
    10684146
  • 财政年份:
    2020
  • 资助金额:
    $ 3.51万
  • 项目类别:
Neural Mechanisms of Habit Formation for Behaviors Motivated by Drugs of Abuse and Natural Reward
滥用药物和自然奖励引起的行为习惯形成的神经机制
  • 批准号:
    10041029
  • 财政年份:
    2020
  • 资助金额:
    $ 3.51万
  • 项目类别:
Neural Mechanisms of Habit Formation for Behaviors Motivated by Drugs of Abuse and Natural Reward
滥用药物和自然奖励引起的行为习惯形成的神经机制
  • 批准号:
    10475254
  • 财政年份:
    2020
  • 资助金额:
    $ 3.51万
  • 项目类别:
Neural Mechanisms of Habit Formation for Behaviors Motivated by Drugs of Abuse and Natural Reward
滥用药物和自然奖励引起的行为习惯形成的神经机制
  • 批准号:
    10256635
  • 财政年份:
    2020
  • 资助金额:
    $ 3.51万
  • 项目类别:
Role of nucleus accumbens in effort-based decision-making
伏隔核在基于努力的决策中的作用
  • 批准号:
    8532629
  • 财政年份:
    2012
  • 资助金额:
    $ 3.51万
  • 项目类别:
Role of nucleus accumbens in effort-based decision-making
伏隔核在基于努力的决策中的作用
  • 批准号:
    8396980
  • 财政年份:
    2012
  • 资助金额:
    $ 3.51万
  • 项目类别:
Neural mechanisms underlying simple and complex reinforcement learning
简单和复杂强化学习背后的神经机制
  • 批准号:
    7673362
  • 财政年份:
    2007
  • 资助金额:
    $ 3.51万
  • 项目类别:
Neural mechanisms underlying simple and complex reinforcement learning
简单和复杂强化学习背后的神经机制
  • 批准号:
    7489311
  • 财政年份:
    2007
  • 资助金额:
    $ 3.51万
  • 项目类别:

相似国自然基金

湍流和化学交互作用对H2-Air-H2O微混燃烧中NO生成的影响研究
  • 批准号:
    51976048
  • 批准年份:
    2019
  • 资助金额:
    61.0 万元
  • 项目类别:
    面上项目

相似海外基金

COMPAS: co integration of microelectronics and photonics for air and water sensors
COMPAS:微电子学和光子学的共同集成,用于空气和水传感器
  • 批准号:
    10108154
  • 财政年份:
    2024
  • 资助金额:
    $ 3.51万
  • 项目类别:
    EU-Funded
RII Track-4:NSF: From the Ground Up to the Air Above Coastal Dunes: How Groundwater and Evaporation Affect the Mechanism of Wind Erosion
RII Track-4:NSF:从地面到沿海沙丘上方的空气:地下水和蒸发如何影响风蚀机制
  • 批准号:
    2327346
  • 财政年份:
    2024
  • 资助金额:
    $ 3.51万
  • 项目类别:
    Standard Grant
SBIR Phase I: High-Efficiency Liquid Desiccant Regenerator for Desiccant Enhanced Evaporative Air Conditioning
SBIR 第一阶段:用于干燥剂增强蒸发空调的高效液体干燥剂再生器
  • 批准号:
    2335500
  • 财政年份:
    2024
  • 资助金额:
    $ 3.51万
  • 项目类别:
    Standard Grant
Catalyzing Sustainable Air Travel: Unveiling Consumer Willingness to Pay for Sustainable Aviation Fuel through Information Treatment in Choice Experiment and Cross-Country Analysis
促进可持续航空旅行:通过选择实验和跨国分析中的信息处理揭示消费者支付可持续航空燃油的意愿
  • 批准号:
    24K16365
  • 财政年份:
    2024
  • 资助金额:
    $ 3.51万
  • 项目类别:
    Grant-in-Aid for Early-Career Scientists
Collaborative Research: Phenotypic and lineage diversification after key innovation(s): multiple evolutionary pathways to air-breathing in labyrinth fishes and their allies
合作研究:关键创新后的表型和谱系多样化:迷宫鱼及其盟友呼吸空气的多种进化途径
  • 批准号:
    2333683
  • 财政年份:
    2024
  • 资助金额:
    $ 3.51万
  • 项目类别:
    Continuing Grant
Collaborative Research: Phenotypic and lineage diversification after key innovation(s): multiple evolutionary pathways to air-breathing in labyrinth fishes and their allies
合作研究:关键创新后的表型和谱系多样化:迷宫鱼及其盟友呼吸空气的多种进化途径
  • 批准号:
    2333684
  • 财政年份:
    2024
  • 资助金额:
    $ 3.51万
  • 项目类别:
    Continuing Grant
CRII: CSR: Towards an Edge-enabled Software-Defined Vehicle Framework for Dynamic Over-the-Air Updates
CRII:CSR:迈向支持边缘的软件定义车辆框架,用于动态无线更新
  • 批准号:
    2348151
  • 财政年份:
    2024
  • 资助金额:
    $ 3.51万
  • 项目类别:
    Standard Grant
Smoldering coarse woody debris and air quality
阴燃粗木质碎片和空气质量
  • 批准号:
    IM240100016
  • 财政年份:
    2024
  • 资助金额:
    $ 3.51万
  • 项目类别:
    Mid-Career Industry Fellowships
Simulating Urban Air Pollution In The Lab
在实验室模拟城市空气污染
  • 批准号:
    MR/Y020014/1
  • 财政年份:
    2024
  • 资助金额:
    $ 3.51万
  • 项目类别:
    Fellowship
Development of a low-pressure loss air purification device using rotating porous media and a proposal for its use in ventilation systems
使用旋转多孔介质的低压损失空气净化装置的开发及其在通风系统中的使用建议
  • 批准号:
    24K17404
  • 财政年份:
    2024
  • 资助金额:
    $ 3.51万
  • 项目类别:
    Grant-in-Aid for Early-Career Scientists
{{ showInfoDetail.title }}

作者:{{ showInfoDetail.author }}

知道了