A model of reward- and effort-based optimal decision making and motor control.

A model of reward- and effort-based optimal decision making and motor control.
复制标题

DOI:
10.1371/journal.pcbi.1002716
复制
发表时间:
2012
影响因子:
4.3
通讯作者:
Guigon E
Guigon E
中科院分区:
生物学2区
文献类型:
--
作者:
Rigoux L;Guigon E

文献摘要

参考文献

被引文献

相似文献

成本(如能量支出)和收益(如食物)是行为的核心决定因素。在生态学和经济学中,它们结合起来形成一个效用函数,该函数被最大化以指导选择。这一原则在神经科学中被广泛用作决策和行动的规范模型,但该模型的当前版本未能考虑决策实际上如何转化为行动(即轨迹的形成)。在这里,我们描述了一种方法,其中决策和电机控制是最佳的,迭代过程来自最大化的折扣,加权预期奖励和可预见的电机努力之间的差异。该模型考虑了成本/效益情况下的决策,以及现实运动任务中控制和目标跟踪的详细特征。作为一个规范的建设,该模型是相关的,以解决神经基础和病理方面的决策和运动控制。行为是由决定和行动组成的。这些决定是基于潜在行动的成本和收益,并通过适当的控制身体部分执行所选择的行动。相应的过程通常在决策和运动控制的单独理论中被考虑,这不能解释所选择的行为的实际成本和收益如何与决策阶段所涉及的预期成本和收益相一致。在这里,我们提出了一个总体的决策和电机控制的基础上最大化的成本和效益的混合函数的最优模型。该模型提供了一个统一的帐户的成本/效益的情况下的决定(例如,小奖励/低努力和大奖励/高努力的选项之间的选择),和电机控制在现实的电机任务。该模型似乎适合于促进我们对决策和运动控制的神经基础和病理方面的理解。
Costs (e.g. energetic expenditure) and benefits (e.g. food) are central determinants of behavior. In ecology and economics, they are combined to form a utility function which is maximized to guide choices. This principle is widely used in neuroscience as a normative model of decision and action, but current versions of this model fail to consider how decisions are actually converted into actions (i.e. the formation of trajectories). Here, we describe an approach where decision making and motor control are optimal, iterative processes derived from the maximization of the discounted, weighted difference between expected rewards and foreseeable motor efforts. The model accounts for decision making in cost/benefit situations, and detailed characteristics of control and goal tracking in realistic motor tasks. As a normative construction, the model is relevant to address the neural bases and pathological aspects of decision making and motor control. Behavior is made of decisions and actions. The decisions are based on the costs and benefits of potential actions, and the chosen actions are executed through the proper control of body segments. The corresponding processes are generally considered in separate theories of decision making and motor control, which cannot explain how the actual costs and benefits of a chosen action can be consistent with the expected costs and benefits involved at the decision stage. Here, we propose an overarching optimal model of decision and motor control based on the maximization of a mixed function of costs and benefits. The model provides a unified account of decision in cost/benefit situations (e.g. choice between small reward/low effort and large reward/high effort options), and motor control in realistic motor tasks. The model appears suitable to advance our understanding of the neural bases and pathological aspects of decision making and motor control.
DOI: 10.1007/s00221-001-0904-9
发表时间: 2002-01-01
影响因子: 2
作者:
Corcos, DM;Jiang, HY;Gottlieb, GL
通讯作者: Gottlieb, GL
DOI: 10.1002/mds.20987
发表时间: 2006-09-01
期刊: MOVEMENT DISORDERS
影响因子: 8.6
作者:
Ballanger, Benedicte;Thobois, Stephane;Desmurget, Michel
通讯作者: Desmurget, Michel
DOI: 10.1016/s0166-4328(89)80088-9
发表时间: 1989-08-01
影响因子: 2.7
作者:
DECETY, J;JEANNEROD, M;PRABLANC, C
通讯作者: PRABLANC, C
DOI: 10.1016/0166-4328(90)90106-o
发表时间: 1990-12-21
影响因子: 2.7
作者:
BOCK, O
通讯作者: BOCK, O
中断多巴胺对未来奖励编码的可取消成本和利益编码。
DOI: 10.1038/nn.2460
发表时间: 2010-01
影响因子: 25
作者:
Gan JO;Walton ME;Phillips PE
通讯作者: Phillips PE