Cortical substrates for exploratory decisions in humans.
Cortical substrates for exploratory decisions in humans.
复制标题
DOI：
10.1038/nature04766
复制
发表时间：
2006-06-15
期刊：
影响因子：
64.8
通讯作者：
Dolan, Raymond J.
中科院分区：
文献类型：
--
作者：
Daw, Nathaniel D.;O'Doherty, John P.;Dayan, Peter;Seymour, Ben;Dolan, Raymond J.
在不确定的环境中进行决策会在收集和利用信息的对立需求之间产生冲突。在这种“探索-剥削”困境的一个经典例子中，赌徒在多个老虎机之间进行选择，平衡了基于积累的经验选择似乎最富有的选项的愿望，以及选择可能更有利的不太熟悉的选项的愿望（从而为改善未来决策提供信息）。这种探索远不是无聊的好奇心，而是生物体发现如何最好地收获食物和水等资源的关键。在食欲选择中，以计算强化学习（RL）理论为基础的大量实验证据表明，多巴胺能，纹状体和内侧前额叶网络介导了学习利用。相比之下，尽管探索已经从理论和行为学的角度进行了很好的研究，但其神经基础却不太清楚。在这里，我们表明，在一个赌博任务，人类受试者的选择可以通过计算的特点，以及考虑解决探索/利用困境的战略。此外，使用这种特性来分类决策为探索性或剥削性，我们采用功能磁共振成像显示，额极皮层和顶内沟在探索性决策过程中优先活跃。相反，纹状体和腹内侧前额叶皮质区域表现出参与基于价值的剥削性决策的活动特征。研究结果表明，在不确定性下的行动选择模型，涉及探索和剥削行为模式之间的切换，并提供了一个计算精确的特征的关键决策相关的大脑系统的贡献，这些功能。
Decision making in an uncertain environment poses a conflict between the opposing demands of gathering and exploiting information. In a classic illustration of this ‘exploration–exploitation‘ dilemma, a gambler choosing between multiple slot machines balances the desire to select what seems, on the basis of accumulated experience, the richest option, against the desire to choose a less familiar option that might turn out more advantageous (and thereby provide information for improving future decisions). Far from representing idle curiosity, such exploration is often critical for organisms to discover how best to harvest resources such as food and water. In appetitive choice, substantial experimental evidence, underpinned by computational reinforcement learning (RL) theory, indicates that a dopaminergic, striatal and medial prefrontal network mediates learning to exploit. In contrast, although exploration has been well studied from both theoretical and ethological perspectives, its neural substrates are much less clear. Here we show, in a gambling task, that human subjects' choices can be characterized by a computationally well-regarded strategy for addressing the explore/exploit dilemma. Furthermore, using this characterization to classify decisions as exploratory or exploitative, we employ functional magnetic resonance imaging to show that the frontopolar cortex and intraparietal sulcus are preferentially active during exploratory decisions. In contrast, regions of striatum and ventromedial prefrontal cortex exhibit activity characteristic of an involvement in value-based exploitative decision making. The results suggest a model of action selection under uncertainty that involves switching between exploratory and exploitative behavioural modes, and provide a computationally precise characterization of the contribution of key decision-related brain systems to each of these functions.
登录
查看更多内容
影响因子：
25
作者：
O'Doherty, J;Kringelbach, ML;Andrews, C
通讯作者：
Andrews, C
影响因子：
64.8
作者：
Platt, ML;Glimcher, PW
通讯作者：
Glimcher, PW
影响因子：
16.2
作者：
Dorris, MC;Glimcher, PW
通讯作者：
Glimcher, PW
影响因子：
16.2
作者：
McClure, SM;Berns, GS;Montague, PR
通讯作者：
Montague, PR
影响因子：
5.7
作者：
Knutson, B;Westdorp, A;Hommer, D
通讯作者：
Hommer, D