Humans perseverate on punishment avoidance goals in multigoal reinforcement learning.
Humans perseverate on punishment avoidance goals in multigoal reinforcement learning.
复制标题
DOI：
10.7554/elife.74402
复制
发表时间：
2022-02-24
期刊：
影响因子：
7.7
通讯作者：
Eldar E
中科院分区：
文献类型：
--
作者：
Sharp PB;Russek EM;Huys QJM;Dolan RJ;Eldar E
管理多个目标对适应至关重要，但我们才刚刚开始理解计算，我们通过计算来导航这样做所带来的资源需求。在这里，我们试图阐明人类如何平衡奖励寻求和惩罚避免目标，并将其与焦虑个体的表达变化联系起来。为此，我们开发了一种新的多目标追求任务，其中包括试验特定的指示目标，以追求奖励（没有惩罚的风险）或避免惩罚（没有奖励的机会）。我们构建了一个多目标追求的计算模型，以量化参与者在被指示时可以脱离追求目标的程度，以及将较少的基于模型的资源投入到不太丰富的目标中。一般来说，参与者（n = 192）在避免惩罚方面的灵活性低于追求奖励。因此，当被要求追求奖励时，参与者通常会坚持避免以前与惩罚有关的特征，即使在决策时这些特征毫无疑问是良性的。同样，当惩罚回避目标在任务中不那么丰富时，参与者的回避没有表现出显著的下调。重要的是，我们展示了初步证据，表明患有慢性焦虑的人在被指示寻求奖励时可能难以摆脱惩罚回避。总的来说，研究结果表明，人们避免惩罚的灵活性低于追求奖励。未来的研究应该在更大的样本中测试是否难以摆脱惩罚逃避会导致长期担忧。
Managing multiple goals is essential to adaptation, yet we are only beginning to understand computations by which we navigate the resource demands entailed in so doing. Here, we sought to elucidate how humans balance reward seeking and punishment avoidance goals, and relate this to variation in its expression within anxious individuals. To do so, we developed a novel multigoal pursuit task that includes trial-specific instructed goals to either pursue reward (without risk of punishment) or avoid punishment (without the opportunity for reward). We constructed a computational model of multigoal pursuit to quantify the degree to which participants could disengage from the pursuit goals when instructed to, as well as devote less model-based resources toward goals that were less abundant. In general, participants (n = 192) were less flexible in avoiding punishment than in pursuing reward. Thus, when instructed to pursue reward, participants often persisted in avoiding features that had previously been associated with punishment, even though at decision time these features were unambiguously benign. In a similar vein, participants showed no significant downregulation of avoidance when punishment avoidance goals were less abundant in the task. Importantly, we show preliminary evidence that individuals with chronic worry may have difficulty disengaging from punishment avoidance when instructed to seek reward. Taken together, the findings demonstrate that people avoid punishment less flexibly than they pursue reward. Future studies should test in larger samples whether a difficulty to disengage from punishment avoidance contributes to chronic worry.