Go and no-go learning in reward and punishment: interactions between affect and effect.
Go and no-go learning in reward and punishment: interactions between affect and effect.
复制标题
DOI：
10.1016/j.neuroimage.2012.04.024
复制
发表时间：
2012-08-01
期刊：
影响因子：
5.7
通讯作者：
Dolan, Raymond J.
中科院分区：
文献类型：
--
作者：
Guitart-Masip, Marc;Nuys, Quentin J. M.;Fuentemilla, Lluis;Dayan, Peter;Duzel, Emrah;Dolan, Raymond J.
决策涉及两个基本的控制轴：影响或效价，跨越奖励和惩罚，以及效果或行动，跨越激励和抑制。我们研究了健康人类志愿者在一项任务中获得工具性反应的情况，其中我们正交化了行动要求和结果效价。受试者在学习奖励条件下的主动选择和惩罚条件下的被动选择方面更加成功。使用计算强化学习模型，我们区分了假定的工具成分和巴甫洛夫成分在学习过程中观察到的不对称性生成中的贡献。此外，使用基于模型的功能磁共振成像，我们发现纹状体和黑质/腹侧被盖区（SN/VTA）中的 BOLD 信号与仪器学习的动作值相关，但与进行和不进行选择的信号相反。最后，我们表明成功的器乐学习取决于双侧额下回的参与。我们的行为和计算数据表明，工具学习取决于克服固有的和可塑的巴甫洛夫偏见，而我们的神经元数据表明，这种学习与分别与行动和抑制有关的区域的大脑活动的独特模式有关。 ► 效价期望会干扰人类参与者的行动学习。 ► 计算模型消除了仪器系统和巴甫洛夫系统的影响。 ► 纹状体和 SN/VTA 跟踪动作值并将其与活力控制联系起来。 ► 成功的控制与下前额皮质的活动有关。
Decision-making invokes two fundamental axes of control: affect or valence, spanning reward and punishment, and effect or action, spanning invigoration and inhibition. We studied the acquisition of instrumental responding in healthy human volunteers in a task in which we orthogonalized action requirements and outcome valence. Subjects were much more successful in learning active choices in rewarded conditions, and passive choices in punished conditions. Using computational reinforcement-learning models, we teased apart contributions from putatively instrumental and Pavlovian components in the generation of the observed asymmetry during learning. Moreover, using model-based fMRI, we showed that BOLD signals in striatum and substantia nigra/ventral tegmental area (SN/VTA) correlated with instrumentally learnt action values, but with opposite signs for go and no-go choices. Finally, we showed that successful instrumental learning depends on engagement of bilateral inferior frontal gyrus. Our behavioral and computational data showed that instrumental learning is contingent on overcoming inherent and plastic Pavlovian biases, while our neuronal data showed this learning is linked to unique patterns of brain activity in regions implicated in action and inhibition respectively. ► Expectation of valence interferes with action learning in human participants. ► Computational modeling disentangles influences of instrumental and Pavlovian systems. ► Striatum and SN/VTA track action values and bind them to the control of vigor. ► Successful control is associated with activity in the inferior prefrontal cortex.
登录
查看更多内容
影响因子：
4.1
作者：
DEAKIN J F W;GRAEFF F G
通讯作者：
GRAEFF F G
影响因子：
16.2
作者：
Bunzeck, Nico;Duzel, Emrah
通讯作者：
Duzel, Emrah
DOI：
10.1523/jneurosci.2513-09.2009
发表时间：
2009-09-23
期刊：
The Journal of neuroscience : the official journal of the Society for Neuroscience
影响因子：
--
作者：
Crockett MJ;Clark L;Robbins TW
通讯作者：
Robbins TW
影响因子：
5.4
作者：
Denrell, Jerker
通讯作者：
Denrell, Jerker
影响因子：
2.5
作者：
Bayer, Hannah M.;Lau, Brian;Glimcher, Paul W.
通讯作者：
Glimcher, Paul W.