Conflict acts as an implicit cost in reinforcement learning
Conflict acts as an implicit cost in reinforcement learning
复制标题
DOI：
10.1038/ncomms6394
复制
发表时间：
2014-11-01
影响因子：
16.6
通讯作者：
Frank, Michael J.
中科院分区：
文献类型：
--
作者：
Cavanagh, James F.;Masters, Sean E.;Frank, Michael J.
冲突被认为是行为选择的代价，这意味着内侧额叶皮质在适应厌恶事件的过程中具有普遍的功能。在这里，我们通过调节大脑皮层和纹状体系统中的经验奖赏值来研究反应冲突是否在强化学习过程中起到了成本作用。脑电记录显示，冲突削弱了奖赏相关的额前角速度与线索偏好之间的关系，但却增强了惩罚与线索回避之间的关系。个体在奖惩敏感性的冲突代价上的差异也与纹状体d1和d2途径平衡(DARPP-32)相关的基因多态有关。我们用D2试剂卡麦角林操纵这些模式，这导致了一种强烈的偏见，即放大冲突后惩罚结果的厌恶价值。总而言之，这些发现表明，互动的皮质-纹状体系统作为冲突的函数，隐含地调节了经验的奖惩价值。
Conflict has been proposed to act as a cost in action selection, implying a general function of medio-frontal cortex in the adaptation to aversive events. Here we investigate if response conflict acts as a cost during reinforcement learning by modulating experienced reward values in cortical and striatal systems. Electroencephalography recordings show that conflict diminishes the relationship between reward-related frontal theta power and cue preference yet it enhances the relationship between punishment and cue avoidance. Individual differences in the cost of conflict on reward versus punishment sensitivity are also related to a genetic polymorphism associated with striatal D1 versus D2 pathway balance ( DARPP-32). We manipulate these patterns with the D2 agent cabergoline, which induces a strong bias to amplify the aversive value of punishment outcomes following conflict. Collectively, these findings demonstrate that interactive cortico-striatal systems implicitly modulate experienced reward and punishment values as a function of conflict.