Neural computations underlying arbitration between model-based and model-free learning.
Neural computations underlying arbitration between model-based and model-free learning.
复制标题
基于模型和无模型学习之间仲裁的基础神经计算。
DOI：
10.1016/j.neuron.2013.11.028
复制
发表时间：
2014-02-05
期刊：
影响因子：
16.2
通讯作者：
O'Doherty JP
中科院分区：
文献类型：
--
作者：
Lee SW;Shimojo S;O'Doherty JP
越来越多的神经学证据支持在大脑中存在两种不同的指导行动选择的系统，一种是审慎的“基于模型”系统，另一种是反射的“无模型”系统。然而，对于大脑如何决定这些系统中的哪一个在某一时刻控制行为，我们知之甚少。我们为仲裁机制提供了证据，该仲裁机制将基于模型和无模型的系统对行为的控制程度分配为其各自预测可靠性的函数。我们发现，下外侧前额叶和额极皮层编码可靠性信号和这些信号之间比较的输出，暗示这些区域在仲裁过程中。此外，这些区域和无模型估值区域之间的连通性受到仲裁员基于模型的控制程度的负面调节，这表明，当仲裁员认为基于模型的系统应该驱动行为时，仲裁可以通过调制无模型估值系统来发挥作用。
There is accumulating neural evidence to support the existence of two distinct systems for guiding action-selection in the brain, a deliberative “model-based” and a reflexive “model-free” system. However, little is known about how the brain determines which of these systems controls behavior at one moment in time. We provide evidence for an arbitration mechanism that allocates the degree of control over behavior by model-based and model-free systems as a function of the reliability of their respective predictions. We show that inferior lateral prefrontal and frontopolar cortex encode both reliability signals and the output of a comparison between those signals, implicating these regions in the arbitration process. Moreover, connectivity between these regions and model-free valuation areas is negatively modulated by the degree of model-based control in the arbitrator, suggesting that arbitration may work through modulation of the model-free valuation system when the arbitrator deems that the model-based system should drive behavior.
登录
查看更多内容
人类对食物图片的目标导向和习惯行为对腹内侧前额叶皮层的差异性参与。
DOI：
10.1523/jneurosci.1639-09.2009
发表时间：
2009-09-09
期刊：
The Journal of neuroscience : the official journal of the Society for Neuroscience
影响因子：
--
作者：
de Wit S;Corlett PR;Aitken MR;Dickinson A;Fletcher PC
通讯作者：
Fletcher PC
影响因子：
56.9
作者：
Hare, Todd A.;Camerer, Colin F.;Rangel, Antonio
通讯作者：
Rangel, Antonio
影响因子：
16.2
作者：
Beck JM;Ma WJ;Kiani R;Hanks T;Churchland AK;Roitman J;Shadlen MN;Latham PE;Pouget A
通讯作者：
Pouget A
DOI：
10.1073/pnas.96.14.8301
发表时间：
1999-07-06
影响因子：
11.1
作者：
Garavan, H;Ross, TJ;Stein, EA
通讯作者：
Stein, EA
影响因子：
16.2
作者：
Daw ND;Gershman SJ;Seymour B;Dayan P;Dolan RJ
通讯作者：
Dolan RJ