A universal role of the ventral striatum in reward-based learning: evidence from human studies.
A universal role of the ventral striatum in reward-based learning: evidence from human studies.
复制标题
DOI：
10.1016/j.nlm.2014.05.002
复制
发表时间：
2014-10
影响因子：
2.7
通讯作者：
Pollmann, Stefan
中科院分区：
文献类型：
--
作者：
Daniel, Reka;Pollmann, Stefan
强化学习使生物体能够调整其行为以最大化奖励。多巴胺能中脑神经元的电生理记录表明，在许多物种中，它们编码实际奖励和预测奖励之间的差异，即奖励预测误差。这种错误信号被传送到纹状体和皮质区域，并被认为在学习优化行为中发挥着核心作用。然而，在人类日常生活中，奖励是多种多样的，而且往往只能得到间接的反馈。在这里，我们探讨了人类参与者的多巴胺能系统处理的奖励范围，并检查在没有明确奖励的情况下它是否也参与学习。虽然人类电生理记录的结果很少，但有证据表明多巴胺能活动与功能性磁共振成像 (fMRI) 中脑和纹状体记录的代谢信号有关。功能磁共振成像研究的结果表明，人类腹侧纹状体（VS）接收多种奖励刺激的评估信息。这些范围从简单的主要强化物（例如抽象社会奖励的果汁奖励）到内部生成的关于感知正确性的信号，这表明 VS 参与从试错中学习，而不管所提供奖励的具体性质如何。此外，我们总结了证据表明，当通过观察他人进行学习时，以及在超出简单刺激-行动-结果学习的任务中，VS 也可能受到影响，这表明奖励系统也可以在更复杂的学习任务中发挥作用。
Reinforcement learning enables organisms to adjust their behavior in order to maximize rewards. Electrophysiological recordings of dopaminergic midbrain neurons have shown that they code the difference between actual and predicted rewards, i.e., the reward prediction error, in many species. This error signal is conveyed to both the striatum and cortical areas and is thought to play a central role in learning to optimize behavior. However, in human daily life rewards are diverse and often only indirect feedback is available. Here we explore the range of rewards that are processed by the dopaminergic system in human participants, and examine whether it is also involved in learning in the absence of explicit rewards. While results from electrophysiological recordings in humans are sparse, evidence linking dopaminergic activity to the metabolic signal recorded from the midbrain and striatum with functional magnetic resonance imaging (fMRI) is available. Results from fMRI studies suggest that the human ventral striatum (VS) receives valuation information for a diverse set of rewarding stimuli. These range from simple primary reinforcers such as juice rewards over abstract social rewards to internally generated signals on perceived correctness, suggesting that the VS is involved in learning from trial-and-error irrespective of the specific nature of provided rewards. In addition, we summarize evidence that the VS can also be implicated when learning from observing others, and in tasks that go beyond simple stimulus-action-outcome learning, indicating that the reward system is also recruited in more complex learning tasks.
登录
查看更多内容
影响因子：
5.7
作者：
Bartra, Oscar;McGuire, Joseph T.;Kable, Joseph W.
通讯作者：
Kable, Joseph W.
影响因子：
4.3
作者：
Chang SW;Winecoff AA;Platt ML
通讯作者：
Platt ML
影响因子：
5.7
作者：
Abler, Birgit;Walter, Henrik;Spitzer, Manfred
通讯作者：
Spitzer, Manfred
影响因子：
4.2
作者：
Acevedo, Bianca P.;Aron, Arthur;Brown, Lucy L.
通讯作者：
Brown, Lucy L.
影响因子：
2.5
作者：
Aron, AR;Shohamy, D;Poldrack, RA
通讯作者：
Poldrack, RA