Goal -oriented and habitual decisions: Neural signatures of model -based and model -free learning

Goal -oriented and habitual decisions: Neural signatures of model -based and model -free learning
复制标题

DOI:
10.1016/j.neuroimage.2020.116834
复制
发表时间:
2020-07-15
期刊:
影响因子:
5.7
通讯作者:
Yu, Rongjun
Yu, Rongjun
中科院分区:
医学1区
文献类型:
--
作者:
Huang, Yi;Yaple, Zachary A.;Yu, Rongjun

文献摘要

被引文献

相似文献

人类决策主要由两个基本学习过程驱动:一个缓慢的、深思熟虑的、基于目标的基于模型的过程,它绘制出所有选项的潜在结果;另一个是快速的习惯性无模型过程,可以反射性地重复以前的成功选择。尽管许多基于模型的神经影像学研究已经检查了基于模型和无模型学习的神经相关性,但这两个过程之间的一致活动仍不清楚。我们使用功能磁共振成像实验的定量荟萃分析来识别一系列奖励相关范式中与基于模型和无模型学习相关的一致活动。我们发现:1)两个过程都产生了一致的腹侧纹状体活动,2)基于模型的学习激活了内侧前额皮质和眶额皮质,3)无模型学习专门激活了左侧苍白球和右侧尾状头。我们的研究结果表明,无模型和基于模型的决策涉及重叠但不同的神经区域。这些立体定位图提高了我们对大脑如何实现审慎目标导向和反射性习惯学习的理解。
Human decision-making is mainly driven by two fundamental learning processes: a slow, deliberative, goal-directed model-based process that maps out the potential outcomes of all options and a rapid habitual model-free process that enables reflexive repetition of previously successful choices. Although many model-informed neuroimaging studies have examined the neural correlates of model-based and model-free learning, the concordant activity among these two processes remains unclear. We used quantitative meta-analyses of functional magnetic resonance imaging experiments to identify the concordant activity pertaining to model-based and model-free learning over a range of reward-related paradigms. We found that: 1) both processes yielded concordant ventral striatum activity, 2) model-based learning activated the medial prefrontal cortex and orbital frontal cortex, and 3) model-free learning specifically activated the left globus pallidus and right caudate head. Our findings suggest that model-free and model-based decision making engage overlapping yet distinct neural regions. These stereotaxic maps improve our understanding of how deliberative goal-directed and reflexive habitual learning are implemented in the brain.