Mesolimbic confidence signals guide perceptual learning in the absence of external feedback
Mesolimbic confidence signals guide perceptual learning in the absence of external feedback
复制标题
DOI：
10.7554/elife.13388
复制
发表时间：
2016-03-29
期刊：
影响因子：
7.7
通讯作者：
Sterzer, Philipp
中科院分区：
文献类型：
--
作者：
Guggenmos, Matthias;Wilbertz, Gregor;Sterzer, Philipp
众所周知，学习可以在没有外部反馈的情况下发生，但规范的强化学习理论很难解释这种学习情况。在这里，我们建议人类观察员能够通过监控内部决策变量来生成自己的反馈信号。我们调查了这一假设在视觉知觉学习任务中使用功能磁共振成像和信心报告作为衡量这个监测过程。采用一种新的计算模型，在该模型中，学习是由基于信心的强化信号引导的，我们发现，中脑边缘脑区编码的预期和预测误差的信心在显着的相似性，以前的研究结果为外部奖励为基础的反馈。我们证明，该模型占选择和信心的报告，并表明，通过模型预测个人学习成功的中脑边缘系统的信心预测误差调制。这些结果提供了一个机械神经生物学的解释，学习没有外部反馈增强模型与信心为基础的反馈。
It is well established that learning can occur without external feedback, yet normative reinforcement learning theories have difficulties explaining such instances of learning. Here, we propose that human observers are capable of generating their own feedback signals by monitoring internal decision variables. We investigated this hypothesis in a visual perceptual learning task using fMRI and confidence reports as a measure for this monitoring process. Employing a novel computational model in which learning is guided by confidence-based reinforcement signals, we found that mesolimbic brain areas encoded both anticipation and prediction error of confidence in remarkable similarity to previous findings for external reward-based feedback. We demonstrate that the model accounts for choice and confidence reports and show that the mesolimbic confidence prediction error modulation derived through the model predicts individual learning success. These results provide a mechanistic neurobiological explanation for learning without external feedback by augmenting reinforcement models with confidence-based feedback.