Midbrain dopamine neurons signal phasic and ramping reward prediction error during goal-directed navigation.
Midbrain dopamine neurons signal phasic and ramping reward prediction error during goal-directed navigation.
复制标题
DOI：
10.1016/j.celrep.2022.111470
复制
发表时间：
2022-10-11
期刊：
影响因子：
8.8
通讯作者：
Saleem, Aman B.
中科院分区：
文献类型：
--
作者：
Farrell, Karolina;Lak, Armin;Saleem, Aman B.
目标导向导航需要学习准确估计位置并在每个位置选择最佳动作。中脑多巴胺神经元参与奖励价值学习，并与奖励位置学习有关。因此，它们是为目标导向导航提供教学信号的理想场所。通过成像多巴胺神经活动的小鼠学会主动导航一个闭环虚拟现实走廊，以获得奖励，我们观察阶段性和奖励前斜坡多巴胺活动，这是由学习阶段和任务参与调制。结合位置推断的Q学习模型概括了我们的结果，显示了类似于阶段性和斜坡多巴胺神经活动的预测误差。该模型预测，斜坡其次是提高任务性能，我们在我们的实验数据中证实，表明多巴胺斜坡可能有教学效果。我们的研究结果表明，中脑多巴胺神经元编码相位和斜坡奖励预测错误信号，以提高目标导向的导航。腹侧被盖区多巴胺神经元在目标导向的导航过程中具有阶段性和斜坡活动预奖赏斜坡是由学习和任务参与调制的Q学习模型模拟TD错误中的阶段性和斜坡多巴胺神经元活动预奖赏斜坡多巴胺神经元活动和TD错误改善任务表现多巴胺神经元信号奖赏预测错误在其阶段性活动中，但斜坡活动及其潜在功能的报告仍然存在争议。使用实验和计算方法，法雷尔等人。显示多巴胺神经元显示阶段性和斜坡活动，两者都作为奖励预测错误信号，以改善目标导向导航。
Goal-directed navigation requires learning to accurately estimate location and select optimal actions in each location. Midbrain dopamine neurons are involved in reward value learning and have been linked to reward location learning. They are therefore ideally placed to provide teaching signals for goal-directed navigation. By imaging dopamine neural activity as mice learned to actively navigate a closed-loop virtual reality corridor to obtain reward, we observe phasic and pre-reward ramping dopamine activity, which are modulated by learning stage and task engagement. A Q-learning model incorporating position inference recapitulates our results, displaying prediction errors resembling phasic and ramping dopamine neural activity. The model predicts that ramping is followed by improved task performance, which we confirm in our experimental data, indicating that the dopamine ramp may have a teaching effect. Our results suggest that midbrain dopamine neurons encode phasic and ramping reward prediction error signals to improve goal-directed navigation. VTA dopamine neurons have phasic and ramping activity during goal-directed navigation Pre-reward ramping is modulated by learning and task engagement A Q-learning model emulates phasic and ramping dopamine neuron activity in TD error Pre-reward ramps in dopamine neuron activity and TD error improve task performance Dopamine neurons signal reward prediction error in their phasic activity, but reports of ramping activity and its potential function remain controversial. Using experimental and computational methods, Farrell et al. show that dopamine neurons display phasic and ramping activity and both act as reward prediction error signals for improving goal-directed navigation.
登录
查看更多内容
影响因子：
3.7
作者：
Kim KM;Baratta MV;Yang A;Lee D;Boyden ES;Fiorillo CD
通讯作者：
Fiorillo CD
神经元型特异性信号，用于腹侧对段区域的奖励和惩罚。
影响因子：
64.8
作者：
Cohen, Jeremiah Y.;Haesler, Sebastian;Vong, Linh;Lowell, Bradford B.;Uchida, Naoshige
通讯作者：
Uchida, Naoshige
影响因子：
7.7
作者：
Hamilos AE;Spedicato G;Hong Y;Sun F;Li Y;Assad JA
通讯作者：
Assad JA
影响因子：
4.3
作者：
Lloyd K;Dayan P
通讯作者：
Dayan P
影响因子：
64.5
作者：
Kim HR;Malik AN;Mikhael JG;Bech P;Tsutsui-Kimura I;Sun F;Zhang Y;Li Y;Watabe-Uchida M;Gershman SJ;Uchida N
通讯作者：
Uchida N