Neural Correlates of Reinforcement Learning in Mid-lateral Cerebellum.
Neural Correlates of Reinforcement Learning in Mid-lateral Cerebellum.
复制标题
DOI：
10.1016/j.neuron.2019.12.032
复制
发表时间：
2020-04-08
期刊：
影响因子：
16.2
通讯作者：
Ipata AE
中科院分区：
文献类型：
--
作者：
Sendhilnathan N;Semework M;Goldberg ME;Ipata AE
小脑在非运动学习中的作用尚不清楚。在这里，我们研究了猴子在学习将一个任意符号与左手的运动联系起来，以及将另一个符号与右手的运动联系起来时，小脑中外侧浦肯野细胞（p细胞）的活性。在猴子学习过程中，p细胞的简单脉冲反应报告了动物最近决定的结果，而没有伴随其他感觉运动参数的变化，如手部运动、舔舐或眼球运动。在群体水平上，整个试验过程中，p细胞集体保持了对最近决定的记忆。当猴子学会这种联系时，这种与奖励相关的错误信号的大小接近于零。我们的研究结果与目前对小脑加工的理解有很大的不同，并对小脑在认知加工中的作用具有重要意义。小脑通常与纠正运动错误以优化运动表现有关。在这里，Sendhilnathan等人表明，小脑中外侧浦肯野细胞在其简单的尖峰中携带用于强化学习的错误信号，与运动运动学或感觉事件无关。
The role of the cerebellum in non-motor learning is poorly understood. Here, we investigated the activity of Purkinje cells (P-cells) in the mid-lateral cerebellum as the monkey learned to associate one arbitrary symbol with the movement of the left hand, and another with the movement of the right hand. During learning, but not when the monkey had learned the association, the simple spike responses of P-cells reported the outcome of the animal’s most recent decision without concomitant changes in other sensorimotor parameters such as hand movement, licking, or eye movement. At the population level, P-cells collectively maintained a memory of the most recent decision throughout the entire trial. As the monkeys learned the association, the magnitude of this reward-related error signal approached zero. Our results provide a major departure from the current understanding of cerebellar processing, and has critical implications for cerebellum’s role in cognitive processing. The cerebellum has been classically linked to correcting motor errors to optimize motor performance. Here, Sendhilnathan et al. show that mid-lateral cerebellar Purkinje cells carry error signals for reinforcement learning in their simple spikes, unrelated to movement kinematics or sensory events.
登录
查看更多内容
影响因子：
16.2
作者：
Histed, Mark H.;Pasupathy, Anitha;Miller, Earl K.
通讯作者：
Miller, Earl K.
影响因子：
25
作者：
Heffley W;Song EY;Xu Z;Taylor BN;Hughes MA;McKinney A;Joshua M;Hull C
通讯作者：
Hull C
影响因子：
7.7
作者：
Larry, Noga;Yarkoni, Merav;Joshua, Mati
通讯作者：
Joshua, Mati
影响因子：
16.2
作者：
Chabrol, Francois P.;Blot, Antonin;Mrsic-Flogel, Thomas D.
通讯作者：
Mrsic-Flogel, Thomas D.
影响因子：
7.7
作者：
Heffley, William;Hull, Court
通讯作者：
Hull, Court