Midbrain dopamine neurons encode decisions for future action
Midbrain dopamine neurons encode decisions for future action
复制标题
DOI：
10.1038/nn1743
复制
发表时间：
2006-08-01
影响因子：
25
通讯作者：
Bergman, Hagai
中科院分区：
文献类型：
--
作者：
Morris, Genela;Nevet, Alon;Bergman, Hagai
目前的基底神经节和多巴胺神经元模型强调了它们在强化学习中的作用。然而，多巴胺神经元在决策中的作用仍然不清楚。我们记录了猴子的多巴胺神经元参与两种类型的试验：参考试验中的一个选择任务和决策试验中的双臂强盗决策任务。我们发现，多巴胺神经元的活动在决策设置调制根据即将到来的行动的价值。此外，对决策试验中概率匹配策略的分析表明，多巴胺群体活动而不是参考试验中的奖励决定了选择行为。由于多巴胺神经元不具有空间或运动特性，我们得出结论，即时决策很可能是在其他地方产生的，并传达给多巴胺神经元，发挥了作用，通过动态调制的基底神经节突触的功效，形成长期的决策政策。
Current models of the basal ganglia and dopamine neurons emphasize their role in reinforcement learning. However, the role of dopamine neurons in decision making is still unclear. We recorded from dopamine neurons in monkeys engaged in two types of trial: reference trials in an instructed-choice task and decision trials in a two-armed bandit decision task. We show that the activity of dopamine neurons in the decision setting is modulated according to the value of the upcoming action. Moreover, analysis of the probability matching strategy in the decision trials revealed that the dopamine population activity and not the reward during reference trials determines choice behavior. Because dopamine neurons do not have spatial or motor properties, we conclude that immediate decisions are likely to be generated elsewhere and conveyed to the dopamine neurons, which play a role in shaping long-term decision policy through dynamic modulation of the efficacy of basal ganglia synapses.