The role of midbrain dopamine neurons in reward prediction and reward seeking

中脑多巴胺神经元在奖励预测和奖励寻求中的作用

• 批准号: RGPIN-2016-06703
• 负责人: Shizgal, Peter
• 金额: $ 2.55万
• 依托单位: Concordia University
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2020
• 资助国家: 加拿大
• 起止时间: 2020-01-01 至 2021-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=709499
• 关键词: role; midbrain; dopamine; neurons; reward

To succeed in their struggle for survival and reproductive success, animals must make wise choices about which goals to pursue and how much to pay and risk to attain them. How does the brain make such decisions and adjust behaviour accordingly? Neurobiologists, computer scientists, and psychologists have collaborated in developing an influential theory to answer these questions. The theory holds that dopamine cells in the brain adjust the accuracy of predictions about rewards and set the values assigned to reward-seeking actions. The activity of these dopamine neurons is posited to reflect the difference between the consequences that are expected and those that come to pass. This dopamine signal provides feedback to improve predictions of future outcomes and to choose the actions required to achieve them. One line of novel experiments will test the prediction-error theory in rats working for optical activation of dopamine cells. The release of dopamine will be monitored by miniature chemical sensors as the rats' predictions and reward-seeking actions are measured. After encountering a valuable reward, such as a highly nutritious food item, it makes sense for a forager to immediately seek another. The more valuable the reward, the more vigorously the forager should do this. Such adaptively opportunistic behaviour has been documented in rats working for rewarding electrical brain stimulation. Dopamine neurons have been implicated strongly in reward seeking, yet the potentiation of reward seeking following exposure to a strong electrical reward was not reduced by a drug that blocks dopamine action in the brain. We will address this paradox by substituting direct, specific, optical activation of dopamine neurons for the indirect, non-specific activation produced by electrical stimulation. The results will help us understand the role of dopamine neurons in motivation. An animal's assessment of potential benefits, detriments, costs, and risks must depend on its current physiological state. As internal energy stores empty, finding food becomes imperative, and the animal is willing to pursue expensive, risky courses of action to achieve this goal. We have long studied the dependence of reward seeking on energy balance in rats working for rewarding electrical brain stimulation. Recently, we applied a new method that distinguishes the effects of energy depletion on sensitivity to reward (which would make a food item seem more valuable) and on the animal's assessment of the costs involved in procuring the reward (which would make a food item seem cheaper). I now propose to substitute optical stimulation of dopamine neurons for the electrical stimulation we have used previously, which is less specific and activates dopamine neurons indirectly. This work will help us better understand whether and how dopamine neurons link reward pursuit to the state of the internal physiological environment.

为了在生存和繁殖成功的斗争中取得成功，动物必须做出明智的选择，决定追求哪些目标，以及为实现这些目标付出多少代价和承担多少风险。大脑如何做出这样的决定并相应地调整行为？神经生物学家、计算机科学家和心理学家合作开发了一种有影响力的理论来回答这些问题。该理论认为，大脑中的多巴胺细胞调整对奖励的预测的准确性，并设定分配给寻求奖励行为的值。这些多巴胺神经元的活动被认为反映了预期结果和实际结果之间的差异。这种多巴胺信号提供反馈，以改善对未来结果的预测，并选择实现这些结果所需的行动。一系列新颖的实验将在致力于光激活多巴胺细胞的大鼠身上测试预测误差理论。随着老鼠的预测和奖励行为被测量，多巴胺的释放将通过微型化学传感器进行监测。 在遇到有价值的奖励后，例如一种高营养的食物，觅食者立即寻找另一种奖励是有意义的。奖励越有价值，觅食者就应该越积极地这样做。这种适应性机会主义行为已经在为奖励大脑电刺激而工作的大鼠中得到了记录。多巴胺神经元与寻求奖赏有很强的关联，然而，在接触到强大的电子奖赏后，寻求奖赏的增强并没有被一种阻断大脑中多巴胺活动的药物减少。我们将通过用直接的、特定的、光学的多巴胺神经元激活代替由电刺激产生的间接的、非特异的激活来解决这一悖论。这一结果将有助于我们理解多巴胺神经元在动机中的作用。 动物对潜在益处、危害、成本和风险的评估必须取决于其当前的生理状态。当体内的能量储备空空如也时，寻找食物变得势在必行，动物愿意采取昂贵、危险的行动来实现这一目标。长期以来，我们一直在研究大鼠寻求奖赏对能量平衡的依赖，这些大鼠的工作是为了获得奖赏的大脑刺激。最近，我们应用了一种新的方法，区分能量消耗对奖励敏感性(这会让食物看起来更有价值)和动物对获得奖励所涉及成本的评估(让食物看起来更便宜)的影响。我现在建议用光刺激多巴胺神经元来代替我们以前使用的电刺激，这种刺激没有那么特异，间接地激活了多巴胺神经元。这项工作将帮助我们更好地理解多巴胺神经元是否以及如何将追求奖赏与内部生理环境的状态联系起来。