Goal-directed decision making as probabilistic inference: a computational framework and potential neural correlates.
Goal-directed decision making as probabilistic inference: a computational framework and potential neural correlates.
复制标题
DOI：
10.1037/a0026435
复制
发表时间：
2012-01
影响因子：
5.4
通讯作者：
Botvinick, Matthew M.
中科院分区：
文献类型：
--
作者：
Solway, Alec;Botvinick, Matthew M.
最近的研究提出了一种观点，即基于奖励的决策是由两个关键控制器控制的：一个是习惯系统，它存储由过去奖励形成的刺激-反应关联，另一个是目标导向系统，它根据预期结果选择行动。目前的文献提供了丰富的计算理论解决习惯的形成，集中在时间差异学习机制。在使目标导向的决策所涉及的过程正式化方面进展较少。我们借鉴了认知神经科学、动物条件反射、认知和发展心理学以及机器学习方面的最新研究成果，概述了目标导向决策的新理论。我们的基本建议是，在一个可识别的皮层和皮层下结构网络中，大脑实现了一个奖励的概率生成模型，目标导向的决策是通过该模型的贝叶斯反转来实现的。我们提出了一组模拟实现帐户，解决基准行为和神经科学的发现，并产生了一组可测试的预测。我们还讨论了所提出的框架和其他决策模型之间的关系，包括最近的感知选择模型，我们的理论与之直接相关。
Recent work has given rise to the view that reward-based decision making is governed by two key controllers: a habit system, which stores stimulus-response associations shaped by past reward, and a goal-oriented system that selects actions based on their anticipated outcomes. The current literature provides a rich body of computational theory addressing habit formation, centering on temporal-difference learning mechanisms. Less progress has been made toward formalizing the processes involved in goal-directed decision making. We draw on recent work in cognitive neuroscience, animal conditioning, cognitive and developmental psychology and machine learning, to outline a new theory of goal-directed decision making. Our basic proposal is that the brain, within an identifiable network of cortical and subcortical structures, implements a probabilistic generative model of reward, and that goal-directed decision making is effected through Bayesian inversion of this model. We present a set of simulations implementing the account, which address benchmark behavioral and neuroscientific findings, and which give rise to a set of testable predictions. We also discuss the relationship between the proposed framework and other models of decision making, including recent models of perceptual choice, to which our theory bears a direct connection.
登录
查看更多内容
DOI：
10.1080/14640748108400816
发表时间：
1981-01-01
期刊：
QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY SECTION B-COMPARATIVE AND PHYSIOLOGICAL PSYCHOLOGY
影响因子：
--
作者：
ADAMS, CD;DICKINSON, A
通讯作者：
DICKINSON, A
影响因子：
3.4
作者：
Baker, Chris L.;Saxe, Rebecca;Tenenbaum, Joshua B.
通讯作者：
Tenenbaum, Joshua B.
DOI：
10.1080/14640748208400878
发表时间：
1982-01-01
期刊：
QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY SECTION B-COMPARATIVE AND PHYSIOLOGICAL PSYCHOLOGY
影响因子：
--
作者：
ADAMS, CD
通讯作者：
ADAMS, CD
DOI：
10.1111/j.1749-6632.1969.tb14019.x
发表时间：
1969-01-01
影响因子：
5.2
作者：
BARLOW, HB
通讯作者：
BARLOW, HB
DOI：
10.1037/0097-7403.18.3.236
发表时间：
1992-07-01
期刊：
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-ANIMAL BEHAVIOR PROCESSES
影响因子：
--
作者：
BALLEINE, B
通讯作者：
BALLEINE, B