The cost of obtaining rewards enhances the reward prediction error signal of midbrain dopamine neurons
The cost of obtaining rewards enhances the reward prediction error signal of midbrain dopamine neurons
复制标题
获得奖励的成本增强了中脑多巴胺神经元的奖励预测误差信号
DOI：
10.1038/s41467-019-11334-2
复制
发表时间：
2019
影响因子：
16.6
通讯作者：
Sakagami Masamichi
中科院分区：
文献类型：
--
作者：
Tanaka Shingo;O’Doherty John P.;Sakagami Masamichi
众所周知，中脑多巴胺神经元会编码用于更新价值预测的奖励预测误差（RPE）。在这里，我们通过记录清醒行为猴子在执行努力的扫视任务期间的多巴胺神经元来检查中脑多巴胺神经元编码的 RPE 信号是否受到获得奖励所付出的成本的调节。与成本较低的行动相比，在执行昂贵的行动后，多巴胺神经元对预测奖励的线索和奖励传递的反应增加，这表明在执行昂贵的行动后，RPE 得到增强。在行为层面，与成本较低的行动相比，执行成本较高的行动后，刺激-奖励关联的学习速度更快。因此，有关行动成本的信息在多巴胺奖励系统中以放大随后的多巴胺 RPE 信号的方式进行处理，从而促进在高成本情况下更快速的学习。
Midbrain dopamine neurons are known to encode reward prediction errors (RPE) used to update value predictions. Here, we examine whether RPE signals coded by midbrain dopamine neurons are modulated by the cost paid to obtain rewards, by recording from dopamine neurons in awake behaving monkeys during performance of an effortful saccade task. Dopamine neuron responses to cues predicting reward and to the delivery of rewards were increased after the performance of a costly action compared to a less costly action, suggesting that RPEs are enhanced following the performance of a costly action. At the behavioral level, stimulus-reward associations are learned faster after performing a costly action compared to a less costly action. Thus, information about action cost is processed in the dopamine reward system in a manner that amplifies the following dopamine RPE signal, which in turn promotes more rapid learning under situations of high cost.