The Role of the Anterior Cingulate Cortex in Prediction Error and Signaling Surprise
The Role of the Anterior Cingulate Cortex in Prediction Error and Signaling Surprise
复制标题
DOI：
10.1111/tops.12307
复制
发表时间：
2019-01-01
影响因子：
3
通讯作者：
Brown, Joshua W.
中科院分区：
文献类型：
--
作者：
Alexander, William H.;Brown, Joshua W.
在过去的二十年里，强化学习(RL)已经成为了解大脑功能的一个流行框架。预测误差是RL模型的一个关键组成部分，它与整个大脑的神经信号有关，包括皮质下核团、初级感觉皮质和前额叶皮质。根据观察到活动的位置，对预测误差的功能解释可能会发生变化：预测误差可能反映奖励的预期价值和实际价值之间的差异，指示刺激的突出程度或新颖性的信号，以及许多其他解释。前扣带回皮质(ACC)长期以来一直被认为是一个参与处理行为错误的区域，最近对该区域的计算模型扩展了这种解释，包括该区域在预测可能事件(广义上)以及预期事件和观察事件之间的信号偏差方面的更一般作用。正在进行的研究ACC和其他参与认知控制的区域之间相互作用的建模工作表明，扣带回在计算对学习环境模型至关重要的分层结构的意外信号方面发挥着更广泛的作用。结果是额叶的预测编码模型，这表明预测编码可能是跨新皮质的统一计算原理。本文回顾了导致惊讶的大脑机制；重点关注前扣带回皮质(ACC)，长期以来一直被认为在行为错误中发挥作用，最近在预测可能的事件和预期事件与观察事件之间的信号偏差方面发挥了更大的作用。它根据最近的模特工作，论证了ACC在《惊奇与学习》中的角色。因此，这篇论文为本书中其他论文的心理学和计算建议提供了神经科学的补充。
In the past two decades, reinforcement learning (RL) has become a popular framework for understanding brain function. A key component of RL models, prediction error, has been associated with neural signals throughout the brain, including subcortical nuclei, primary sensory cortices, and prefrontal cortex. Depending on the location in which activity is observed, the functional interpretation of prediction error may change: Prediction errors may reflect a discrepancy in the anticipated and actual value of reward, a signal indicating the salience or novelty of a stimulus, and many other interpretations. Anterior cingulate cortex (ACC) has long been recognized as a region involved in processing behavioral error, and recent computational models of the region have expanded this interpretation to include a more general role for the region in predicting likely events, broadly construed, and signaling deviations between expected and observed events. Ongoing modeling work investigating the interaction between ACC and additional regions involved in cognitive control suggests an even broader role for cingulate in computing a hierarchically structured surprise signal critical for learning models of the environment. The result is a predictive coding model of the frontal lobes, suggesting that predictive coding may be a unifying computational principle across the neocortex.This paper reviews the brain mechanisms responsible for surprise; focusing on the Anterior Cingulate Cortex (ACC), long-known to play a role in behavioral-error, with a recently-expanded role in predicting likely' events and signaling deviations between expected and observed events. It argues for ACC's role in in surprise and learning, based on recent modelling work. As such, the paper provides the neuroscience complement to the psychological and computational proposals of other papers in the volume.