Model-based choices involve prospective neural activity
Model-based choices involve prospective neural activity
复制标题
DOI：
10.1038/nn.3981
复制
发表时间：
2015-05-01
影响因子：
25
通讯作者：
Daw, Nathaniel D.
中科院分区：
文献类型：
--
作者：
Doll, Bradley B.;Duncan, Katherine D.;Daw, Nathaniel D.
决策可能通过“无模型”重复先前强化的行动或通过“基于模型”的评估产生，这被广泛认为是使用学习的地图或模型对行动后果进行前瞻性预测。虽然选择和决策变量的神经相关性有时反映了对其后果的了解，但目前尚不清楚这是否实际上来自前瞻性评估。使用功能性磁共振成像和顺序奖励学习任务，其中路径包含可解码的对象类别，我们发现人类基于模型的选择与决策时观察到的未来路径的神经签名相关，这表明了一种前瞻性的选择机制。预测还与基于模型的决策变量对神经相关性的影响程度相关，并且与被认为是无模型学习基础的预测误差信号呈负相关。这些结果分离基于模型和无模型评估的独立机制，并支持基于模型的选择和神经决策变量的影响来自前瞻性的假设。
Decisions may arise via 'model-free' repetition of previously reinforced actions or by 'model-based' evaluation, which is widely thought to follow from prospective anticipation of action consequences using a learned map or model. While choices and neural correlates of decision variables sometimes reflect knowledge of their consequences, it remains unclear whether this actually arises from prospective evaluation. Using functional magnetic resonance imaging and a sequential reward-learning task in which paths contained decodable object categories, we found that humans' model-based choices were associated with neural signatures of future paths observed at decision time, suggesting a prospective mechanism for choice. Prospection also covaried with the degree of model-based influences on neural correlates of decision variables and was inversely related to prediction error signals thought to underlie model-free learning. These results dissociate separate mechanisms underlying model-based and model-free evaluation and support the hypothesis that model-based influences on choices and neural decision variables result from prospection.