Heads for learning, tails for memory: reward, reinforcement and a role of dopamine in determining behavioral relevance across multiple timescales.
Heads for learning, tails for memory: reward, reinforcement and a role of dopamine in determining behavioral relevance across multiple timescales.
复制标题
DOI：
10.3389/fnins.2013.00175
复制
发表时间：
2013-10-11
影响因子：
4.3
通讯作者：
Walton ME
中科院分区：
文献类型：
--
作者：
Baudonnat M;Huber A;David V;Walton ME
长期以来，在指导行为的刺激数量有限且结果范围有限的简单情况下，多巴胺一直与强化学习和动机密切相关。然而，在自然情况下，可以采用许多潜在的线索和觅食策略，并且动物确定在如此复杂的环境中可能与行为相关的内容至关重要。这不仅需要检测与他们最近经历的差异，还需要识别与记忆中存储的过去经历的相似之处。在这里，我们回顾了多巴胺在决定如何以及何时了解世界以及如何制定适合所面临情况的选择政策方面可能发挥的作用。我们讨论多巴胺受动机和记忆影响，进而影响基于奖励的记忆形成的证据。特别是，我们认为海马-纹状体-多巴胺网络可能相互作用，以确定世界有多么令人惊讶，并在行为不确定时抑制或促进行动。
Dopamine has long been tightly associated with aspects of reinforcement learning and motivation in simple situations where there are a limited number of stimuli to guide behavior and constrained range of outcomes. In naturalistic situations, however, there are many potential cues and foraging strategies that could be adopted, and it is critical that animals determine what might be behaviorally relevant in such complex environments. This requires not only detecting discrepancies with what they have recently experienced, but also identifying similarities with past experiences stored in memory. Here, we review what role dopamine might play in determining how and when to learn about the world, and how to develop choice policies appropriate to the situation faced. We discuss evidence that dopamine is shaped by motivation and memory and in turn shapes reward-based memory formation. In particular, we suggest that hippocampal-striatal-dopamine networks may interact to determine how surprising the world is and to either inhibit or promote actions at time of behavioral uncertainty.
登录
查看更多内容
神经元型特异性信号，用于腹侧对段区域的奖励和惩罚。
影响因子：
64.8
作者：
Cohen, Jeremiah Y.;Haesler, Sebastian;Vong, Linh;Lowell, Bradford B.;Uchida, Naoshige
通讯作者：
Uchida, Naoshige
从营养中取消的味道无法维持食物的增强特性。
DOI：
10.1111/j.1460-9568.2012.08167.x
发表时间：
2012-08
期刊：
The European journal of neuroscience
影响因子：
--
作者：
Beeler JA;McCutcheon JE;Cao ZF;Murakami M;Alexander E;Roitman MF;Zhuang X
通讯作者：
Zhuang X
影响因子：
6.1
作者：
Brayda-Bruno, Laurent;Mons, Nicole;Marighetto, Aline
通讯作者：
Marighetto, Aline
影响因子：
16.2
作者：
Bromberg-Martin, Ethan S.;Matsumoto, Masayuki;Hikosaka, Okihide
通讯作者：
Hikosaka, Okihide
DOI：
10.1523/jneurosci.5119-12.2013
发表时间：
2013-02-20
期刊：
The Journal of neuroscience : the official journal of the Society for Neuroscience
影响因子：
--
作者：
Clark JJ;Collins AL;Sanford CA;Phillips PE
通讯作者：
Phillips PE