权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

fMRI investigations of how we learn what is relevant for a decision

功能磁共振成像研究我们如何了解与决策相关的内容

基本信息

批准号：
8048585
负责人：
Yael Niv
金额：
$ 24.15万
依托单位：
PRINCETON UNIVERSITY
依托单位国家：
美国
项目类别：
财政年份：
2011
资助国家：
美国
起止时间：
2011-03-01 至 2013-02-28
项目状态：
已结题

来源：
https://reporter.nih.gov/project-details/8048585
关键词：
Affect Animals Area Attention Basal Ganglia Behavior Behavioral Brain Choice Behavior Consumption Corpus striatum structure Creativeness Cues Data Decision Making Development Diagnosis Diagnostic Dimensions Disease Dopamine Drug-sensitive Economics Exclusion Faculty Family Foundations Functional Magnetic Resonance Imaging Funding Future Goals Heart Human Impairment Investigation Lateral Lead Learning Letters Literature Mediating Mentors Midbrain structure Modeling Modification Neuromodulator Occupations Pharmaceutical Preparations Population Prefrontal Cortex Process Psychological reinforcement Public Health Research Rewards Role Signal Transduction Stimulus Structure Substance abuse problem System Testing Ventral Striatum Wages base computer framework design directed attention dopamine system drug of abuse drug reward member neural circuit neuromechanism novel programs relating to nervous system research study reward processing sample fixation substance abuse treatment substance abuser success theories tool treatment strategy

项目摘要

DESCRIPTION (provided by applicant): Substance abuse is a disorder that has been associated with a compromise of reward learning and decision making mechanisms in the brain, notably, the midbrain dopamine system and its striatal targets. Prominent theories suggest that drugs of abuse interact with dopamine, "hijacking" normal learning and instead directing behavior towards the procurement and consumption of the drug. In recent years, the computational framework of reinforcement learning has been leveraged to make great strides in understanding the role of dopamine in reward learning and decision making, and how slight modifications of its signals could lead to such detrimental effects. Reinforcement learning models of decision making describe how basal-ganglia structures learn to evaluate different stimuli in terms of their future reward value, and how dopaminergic activity affects such learning processes. But how does the brain identify which, of all the available stimuli, are the relevant ones to represent and evaluate? This "representation learning" problem has been largely ignored in both the experimental and the computational literature, and may lie at the heart of substance abuse disorder. Substance abusers are not wholly irrational decision makers; in fact, research shows that they employ normal economic decision making to the purchase of drugs of abuse. Nevertheless, a clear abnormality is their fixation on stimuli predicting drug rewards (and their sometimes great creativity in learning to manipulate these to obtain drugs) to the exclusion of consideration of predictors of alternative rewards such as salary from holding a job and the support of one's family. This proposal is motivated by the hypothesis that this skewed attention may be the result of an abnormal representation learning process that causes an over-representation of drug-reward predicting cues. The goal of this proposal is to carry out behavioral and fMRI investigations of the computational and neural basis of representation learning and its interaction with reward learning in the human brain. The studies will employ a novel decision making task that has been specifically designed to highlight this interaction. The hypothesis to be tested is that the prefrontal cortex constructs representations of the world, identifying and directing attention to stimulus dimensions that are relevant for the task at hand, and constructing representations that can be used by the basal ganglia in the process of reinforcement learning. Moreover, we hypothesize that dopaminergic circuitry and related prediction error signals mediate the interaction between representation learning in the prefrontal cortex and reinforcement learning in the basal ganglia. The research proposed will provide initial testing of these hypotheses by detecting neural signals related to representation learning and uncovering the computational strategies by which representation learning proceeds in humans. Understanding representation learning processes, their realization in neural circuitry, and how they are influenced by drug-sensitive neuromodulators such as dopamine, will inform theories of what it is that goes awry in drug-influenced decision making, and provide new directions for diagnosis and treatment of substance abuse. PUBLIC HEALTH RELEVANCE: Substance abuse is a serious problem of public health that centers around the brain's decision-making mechanisms for obtaining rewards. While much research has concentrated on how drugs of abuse might alter reward learning mechanisms, little attention has been devoted to the more fundamental (and perhaps more fragile) process of learning which of all the available stimuli are relevant to a decision and should be attended to and learned about. This project proposes to study this "representation learning" process and how it interacts with reward learning, both neurally and computationally. It is hoped that better understanding of representation learning strategies and their neural implementation will allow us to identify how these are affected by drugs of abuse, and will help in developing new treatment strategies targeted at these additional aspects of the disorder.

描述（由申请人提供）：药物滥用是一种与大脑中奖励学习和决策机制（特别是中脑多巴胺系统及其纹状体靶点）的妥协相关的疾病。著名的理论认为，滥用药物与多巴胺相互作用，“劫持”正常的学习，而是将行为导向药物的采购和消费。近年来，强化学习的计算框架在理解多巴胺在奖励学习和决策中的作用以及对其信号的轻微修改如何导致这种有害影响方面取得了很大进展。决策的强化学习模型描述了基底神经节结构如何学习评估不同刺激的未来奖励价值，以及多巴胺能活动如何影响这种学习过程。但是，大脑如何在所有可用的刺激中识别出哪些是要表示和评估的相关刺激呢？这种“表征学习”的问题在实验和计算文献中都被很大程度上忽视了，可能是物质滥用障碍的核心。药物滥用者并不是完全不理性的决策者;事实上，研究表明，他们在购买滥用药物时采用了正常的经济决策。然而，一个明显的反常现象是，他们对预测药物奖励的刺激物的固定（以及他们在学习操纵这些刺激物以获得药物方面有时具有很大的创造力），而不考虑其他奖励的预测因素，如工作的工资和家庭的支持。该提议的动机是假设这种倾斜的注意力可能是异常表征学习过程的结果，导致药物奖励预测线索的过度表现。这项研究的目的是对表征学习的计算和神经基础及其与人脑中奖励学习的相互作用进行行为和功能磁共振成像研究。这些研究将采用一种新的决策任务，该任务专门设计用于突出这种相互作用。要检验的假设是，前额叶皮层构建了世界的表征，识别并将注意力引导到与手头任务相关的刺激维度，并构建可供基底神经节在强化学习过程中使用的表征。此外，我们假设多巴胺能电路和相关的预测误差信号介导的表征学习在前额叶皮层和基底神经节的强化学习之间的相互作用。这项研究将通过检测与表征学习相关的神经信号，并揭示人类表征学习的计算策略，对这些假设进行初步测试。理解表征学习过程，它们在神经回路中的实现，以及它们如何受到药物敏感性神经调节剂（如多巴胺）的影响，将为药物影响决策的理论提供信息，并为药物滥用的诊断和治疗提供新的方向。公共卫生关系：药物滥用是一个严重的公共卫生问题，其中心是大脑获得奖励的决策机制。虽然许多研究都集中在药物滥用如何改变奖赏学习机制，但很少注意到更基本的（也许更脆弱的）学习过程，在所有可用的刺激中，学习过程与决定有关，应该注意和了解。这个项目建议研究这种“表征学习”过程，以及它如何与奖励学习相互作用，包括神经和计算。希望更好地理解表征学习策略及其神经实现将使我们能够确定这些策略如何受到滥用药物的影响，并将有助于开发针对这些额外方面的新治疗策略。