Reward-Guided Learning with and without Causal Attribution
Reward-Guided Learning with and without Causal Attribution
复制标题
DOI：
10.1016/j.neuron.2016.02.018
复制
发表时间：
2016-04-06
期刊：
影响因子：
16.2
通讯作者：
Behrens, Timothy E. J.
中科院分区：
文献类型：
--
作者：
Jocham, Gerhard;Brodersen, Kay H.;Behrens, Timothy E. J.
当一个有机体获得奖励时，关键是要知道许多候选行为中的哪一个导致了这种奖励。然而，最近的研究表明，即使不满足这个最基本的假设，学习也是可能的。我们在两项功能磁共振成像研究中使用了新颖的奖励引导学习范式，以表明人类部署了并行操作的可分离学习机制。虽然行为是由精确的权变学习主导的，但它也揭示了非权变学习策略的特征。这些学习机制在行为上和神经上是可分离的。外侧眶额皮层支持偶然学习，并反映结果和因果选择之间的偶然性。杏仁核反应奖励时间相关的统计模式的学习。基于时间的启发式机制与感觉运动皮质纹状体回路的活动有关。我们的数据表明，人类大脑中存在几种学习机制，其中只有一种依赖于应用有关任务因果结构的已知规则。
When an organism receives a reward, it is crucial to know which of many candidate actions caused this reward. However, recent work suggests that learning is possible even when this most fundamental assumption is not met. We used novel reward-guided learning paradigms in two fMRI studies to show that humans deploy separable learning mechanisms that operate in parallel. While behavior was dominated by precise contingent learning, it also revealed hallmarks of noncontingent learning strategies. These learning mechanisms were separable behaviorally and neurally. Lateral orbitofrontal cortex supported contingent learning and reflected contingencies between outcomes and their causal choices. Amygdala responses around reward times related to statistical patterns of learning. Time-based heuristic mechanisms were related to activity in sensorimotor corticostriatal circuitry. Our data point to the existence of several learning mechanisms in the human brain, of which only one relies on applying known rules about the causal structure of the task.