Acute and Chronic Nicotine Modulation of Reinforcement Learning

强化学习的急性和慢性尼古丁调节

• 批准号: 8640906
• 负责人: Merideth A. Addicott
• 金额: $ 15.49万
• 依托单位: DUKE UNIVERSITY
• 依托单位国家: 美国
• 财政年份: 2013
• 资助国家: 美国
• 起止时间: 2013-04-01 至 2018-03-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/8640906
• 关键词: Abstinence; Acute; Affect; Alcohols; Americas; Area; Award; Behavior; Cause of Death; Cessation of life; Chronic; Clinical; Cocaine; Collaborations; Complement; Cues; Data; Decision Making; Dependence; Disease; Dopamine; Drug Addiction; Drug usage; Ensure; Environment; Etiology; Expectancy; Exposure to; Face; Faculty; Foundations; Functional Magnetic Resonance Imaging; Future; Goals; Grant; Heroin; Hour; Human; Incentives; Institution; Investigation; Knowledge; Lead; Learning; Literature; Magnetic Resonance Imaging; Maintenance; Mentors; Methodology; Modeling; Motivation; Nicotine; Nicotine Dependence; Nucleus Accumbens; Outcome; Pathway interactions; Pharmaceutical Preparations; Placebos; Play; Prefrontal Cortex; Principal Investigator; Process; Psychological reinforcement; Psychopharmacology; Reaction Time; Relapse; Research; Research Personnel; Research Training; Rewards; Role; Satiation; Scanning; Shapes; Signal Transduction; Smoker; Smoking; Smoking Behavior; Stimulus; Techniques; Tobacco; Tobacco Dependence; Tobacco use; Training; Training and Education; Uncertainty; United States; Universities; addiction; behavior prediction; cigarette smoking; design; disability; drug of abuse; experience; interest; neuroeconomics; neuroimaging; nicotine craving; non-drug; non-smoker; novel strategies; public health relevance; putamen; reinforcer; relating to nervous system; reward processing; skills

DESCRIPTION (provided by applicant): The purpose of this study is to investigate the modulatory effects of acute and chronic nicotine exposure on reinforcement learning for monetary rewards. Nicotine, the primary addictive component in tobacco, is a weak reinforcer that does not induce robust euphoric effects like other drugs of abuse (e.g., cocaine, alcohol), yet produces a higher rate of dependence among tobacco users than among users of other addictive drugs. A potential explanation of this paradox is that nicotine amplifies the salience of other stimuli that have some incentive value and prolonged exposure could result in dysregulated reward processing. Reinforcement learning is the process of learning what actions to take to maximize reward, and may be the mechanism by which nicotine amplifies the incentive value of other stimuli. A key component of reinforcement learning is the prediction error, which is the difference between the actual and the expected reward outcome. Neuroimaging studies have shown that BOLD activation in the mesocorticolimbic pathway correlates with prediction errors during reinforcement learning paradigms. The overarching aim of this proposal is to use neuroeconomic models of reinforcement learning to study the acute and chronic effects of nicotine on motivational behavior and prediction error-related neural activation using a task with probabilistic outcomes and fMRI. Nonsmokers will be scanned following acute nicotine and placebo administration, and smokers will be scanned following normal smoking behavior and 24-hours of smoking abstinence. This proposal will bridge the gap in the literature between neuroeconomic and addiction research and these results will inform whether the initiation and maintenance of smoking behavior could be facilitated by the effects of nicotine on reinforcement learning. The Principal Investigator (PI) will be mentored and advised by a team of faculty with expertise in nicotine psychopharmacology, fMRI, and neuroeconomics. The institution provides exceptional facilities and departments dedicated to these three fields of research. In addition to learning how to design and conduct clinical nicotine research, this training plan with provide the PI with the opportunity to integrate several distinct, yet overlapping, fields of research in order to explore new approaches to understanding the etiology of nicotine addiction. This proposal builds upon the PI's previous pharmaco-MRI experience, and will allow her to develop new skills while contributing to research on the effects of nicotine on decision-making behavior in humans. The education, training, and research goals described in this proposal will provide the applicant with the research experience necessary to become a successful independent investigator.

描述（由申请人提供）：本研究的目的是研究急性和慢性尼古丁暴露对货币奖励强化学习的调节作用。尼古丁是烟草中的主要成瘾成分，是一种弱成瘾剂，不像其他滥用药物那样引起强烈的欣快效应（例如，可卡因、酒精），但烟草使用者的依赖率高于其他成瘾药物使用者。对这一悖论的一个潜在解释是，尼古丁放大了 其他具有一定激励价值的刺激和长时间的接触可能导致奖励处理失调。强化学习是学习采取什么行动以最大化奖励的过程，并且可能是尼古丁放大其他刺激物的激励价值的机制。强化学习的一个关键组成部分是预测误差，即实际和预期奖励结果之间的差异。神经影像学研究表明，中皮质边缘通路中的BOLD激活与强化学习范式中的预测错误相关。该提案的总体目标是使用强化学习的神经经济学模型来研究尼古丁对动机行为的急性和慢性影响，并使用具有概率结果的任务和功能磁共振成像来预测与错误相关的神经激活。非吸烟者将在急性尼古丁和安慰剂给药后进行扫描，吸烟者将在正常吸烟行为和戒烟24小时后进行扫描。这项建议将弥合神经经济学和成瘾研究之间的文献差距差距，这些结果将告知尼古丁对强化学习的影响是否会促进吸烟行为的开始和维持。主要研究者（PI）将由一组具有尼古丁精神药理学、功能磁共振成像和神经经济学专业知识的教师指导和建议。该机构提供特殊的设施和部门致力于这三个研究领域。除了学习如何设计和进行临床尼古丁研究外，该培训计划还为PI提供了整合几个不同但重叠的研究领域的机会，以探索了解尼古丁成瘾病因的新方法。该提案建立在PI之前的药物MRI经验基础上，将使她能够开发新技能，同时有助于研究尼古丁对人类决策行为的影响。教育，培训和研究目标在本提案中描述的将提供申请人成为一个成功的独立研究者所必需的研究经验。