Executive Function Assigns Value to Novel Goal-Congruent Outcomes.
Executive Function Assigns Value to Novel Goal-Congruent Outcomes.
复制标题
DOI：
10.1093/cercor/bhab205
复制
发表时间：
2021-07
期刊：
影响因子：
3.7
通讯作者：
Samuel Mcdougle;Ian C. Ballard;Beth Baribault;S. Bishop;A. Collins
中科院分区：
文献类型：
--
作者：
Samuel Mcdougle;Ian C. Ballard;Beth Baribault;S. Bishop;A. Collins
人们经常从自己行为的结果中学习，即使这些结果不涉及物质奖励或惩罚。我们的大脑如何提供这种灵活性？我们结合了行为、计算模型和功能神经影像来探讨从抽象的新颖结果中学习是否利用了支持从熟悉的二级强化物中学习的相同电路。行为和神经影像学表明，新颖的图像可以作为工具学习过程中奖励的替代品，在多巴胺能回路中产生可靠的类似奖励的信号。此外，我们发现证据表明，执行控制的前额叶相关性可能在形成奖励回路的灵活反应中发挥作用。这些结果表明，从新结果中学习是由前额叶皮层的高级表征和皮层下奖励回路的低级反应之间的相互作用支持的。这种交互可能允许人类对任意抽象奖励函数进行强化学习。
People often learn from the outcomes of their actions, even when these outcomes do not involve material rewards or punishments. How does our brain provide this flexibility? We combined behavior, computational modeling, and functional neuroimaging to probe whether learning from abstract novel outcomes harnesses the same circuitry that supports learning from familiar secondary reinforcers. Behavior and neuroimaging revealed that novel images can act as a substitute for rewards during instrumental learning, producing reliable reward-like signals in dopaminergic circuits. Moreover, we found evidence that prefrontal correlates of executive control may play a role in shaping flexible responses in reward circuits. These results suggest that learning from novel outcomes is supported by an interplay between high-level representations in prefrontal cortex and low-level responses in subcortical reward circuits. This interaction may allow for human reinforcement learning over arbitrarily abstract reward functions.