Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control
Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control
复制标题
DOI：
10.1038/nn1560
复制
发表时间：
2005-12-01
影响因子：
25
通讯作者：
Dayan, P
中科院分区：
文献类型：
--
作者：
Daw, ND;Niv, Y;Dayan, P
广泛的神经和行为数据表明，大脑包含多个用于行为选择的系统，其中一个与前额皮质相关，另一个与背外侧纹状体相关。然而，这种过度的控制引发了额外的选择问题：当系统不一致时如何在系统之间进行仲裁。在这里，我们使用强化学习的计算理论，从规范的角度考虑双动作选择系统。我们确定了一个关键的权衡，即计算的简单性与经验的灵活和统计上的高效利用之间的矛盾。这种权衡是在背外侧纹状体和前额叶系统之间的竞争中实现的。我们建议根据不确定性在它们之间采用贝叶斯仲裁原则，因此每个控制器都在最准确的时候部署。这为有关有利于任一系统占据主导地位的因素的大量实验证据提供了统一的解释。
A broad range of neural and behavioral data suggests that the brain contains multiple systems for behavioral choice, including one associated with prefrontal cortex and another with dorsolateral striatum. However, such a surfeit of control raises an additional choice problem: how to arbitrate between the systems when they disagree. Here, we consider dual-action choice systems from a normative perspective, using the computational theory of reinforcement learning. We identify a key trade-off pitting computational simplicity against the flexible and statistically efficient use of experience. The trade-off is realized in a competition between the dorsolateral striatal and prefrontal systems. We suggest a Bayesian principle of arbitration between them according to uncertainty, so each controller is deployed when it should be most accurate. This provides a unifying account of a wealth of experimental evidence about the factors favoring dominance by either system.