Serotonin neurons modulate learning rate through uncertainty.
Serotonin neurons modulate learning rate through uncertainty.
复制标题
DOI：
10.1016/j.cub.2021.12.006
复制
发表时间：
2022-02-07
期刊：
影响因子：
--
通讯作者：
Cohen JY
中科院分区：
文献类型：
--
作者：
Grossman CD;Bari BA;Cohen JY
调节学习的速度对于灵活的行为至关重要。在稳定的环境中，学习行为的后果应该是缓慢的，但当环境发生变化时，学习应该加速。在行动和结果之间存在嘈杂关系的环境中，识别稳定性和检测变化是困难的。在这些条件下，理论提出，不确定性可以用来调节学习率（“元学习”）。我们发现，小鼠在动态觅食任务中表现出的选择行为，根据元学习模型估计的两种形式的不确定性而变化。中缝背核5-羟色胺神经元的活动追踪了觅食任务和动态巴甫洛夫任务中两种类型的不确定性。在觅食任务中对5-羟色胺神经元的可逆抑制再现了模型中模拟元学习损伤所预测的学习变化。因此，我们提供了5-羟色胺神经元活动，学习和决策之间的定量联系。了解行动及其结果不是一个静态的过程，应加以调整，以补充环境。Grossman等人证明了小鼠学习率的变化，其特征在于不确定性驱动的元学习，并证明了5-羟色胺神经元活动在跟踪不确定性以调节学习中的作用。
Regulating how fast to learn is critical for flexible behavior. Learning about the consequences of actions should be slow in stable environments, but accelerate when that environment changes. Recognizing stability and detecting change are difficult in environments with noisy relationships between actions and outcomes. Under these conditions, theories propose that uncertainty can be used to modulate learning rates (“meta-learning”). We show that mice behaving in a dynamic foraging task exhibit choice behavior that varied as a function of two forms of uncertainty estimated from a meta-learning model. The activity of dorsal raphe serotonin neurons tracked both types of uncertainty in the foraging task as well as in a dynamic Pavlovian task. Reversible inhibition of serotonin neurons in the foraging task reproduced changes in learning predicted by a simulated lesion of meta-learning in the model. We thus provide a quantitative link between serotonin neuron activity, learning, and decision making. Learning about actions and their outcomes is not a static process and should be adapted to complement the environment. Grossman et al. show evidence of variable learning rates in mice that can be characterized by uncertainty-driven meta-learning and demonstrate a role for serotonin neuron activity in tracking uncertainty to modulate learning.
登录
查看更多内容
神经元型特异性信号，用于腹侧对段区域的奖励和惩罚。
影响因子：
64.8
作者：
Cohen, Jeremiah Y.;Haesler, Sebastian;Vong, Linh;Lowell, Bradford B.;Uchida, Naoshige
通讯作者：
Uchida, Naoshige
影响因子：
5
作者：
Chen X;Choo H;Huang XP;Yang X;Stone O;Roth BL;Jin J
通讯作者：
Jin J
影响因子：
5
作者：
Andrade R;Huereca D;Lyons JG;Andrade EM;McGregor KM
通讯作者：
McGregor KM
影响因子：
3.2
作者：
Balasubramani PP;Chakravarthy VS;Ravindran B;Moustafa AA
通讯作者：
Moustafa AA
影响因子：
2.5
作者：
Bengtson, CP;Lee, DJ;Osborne, PB
通讯作者：
Osborne, PB