Frontal theta links prediction errors to behavioral adaptation in reinforcement learning.
Frontal theta links prediction errors to behavioral adaptation in reinforcement learning.
复制标题
DOI：
10.1016/j.neuroimage.2009.11.080
复制
发表时间：
2010-02-15
期刊：
影响因子：
5.7
通讯作者：
Allen JJ
中科院分区：
文献类型：
--
作者：
Cavanagh JF;Frank MJ;Klein TJ;Allen JJ
对动作监测的研究一直详细描述了事件相关电位（ERP）中出现负价反馈后的额叶中央电压偏转，有时称为反馈相关负性（FRN）。FRN被提出来反映强化学习过程中对预测错误的神经反应，但神经活动与预期违背量之间的单次试验关系尚未得到验证。虽然ERP方法不太适合单次试验分析，FRN已与θ波段振荡扰动内侧前额叶皮层。内侧额叶θ振荡以前与期望违背和行为适应有关，非常适合单次试验分析。在这里，我们记录了概率强化学习任务期间的EEG活动，并将性能数据拟合到抽象计算模型（Q学习）中，以计算单次试验奖励预测误差。在期望（预测误差）和适应（随后的反应时间变化）的背景下研究了反馈后的单次试验theta振荡活动。结果表明，互动的内侧和外侧额叶θ活动反映了在行为适应服务的负面和积极的奖励预测错误的程度。这些不同的大脑区域使用预测误差计算不同的行为适应：内侧额叶θ反映了利用预测误差减缓反应时间（特别是以下错误），但外侧额叶θ反映了预测误差导致工作记忆相关的反应时间加快正确的选择。
Investigations into action monitoring have consistently detailed a fronto-central voltage deflection in the Event-Related Potential (ERP) following the presentation of negatively valenced feedback, sometimes termed the Feedback Related Negativity (FRN). The FRN has been proposed to reflect a neural response to prediction errors during reinforcement learning, yet the single trial relationship between neural activity and the quanta of expectation violation remains untested. Although ERP methods are not well suited to single trial analyses, the FRN has been associated with theta band oscillatory perturbations in the medial prefrontal cortex. Medio-frontal theta oscillations have been previously associated with expectation violation and behavioral adaptation and are well suited to single trial analysis. Here, we recorded EEG activity during a probabilistic reinforcement learning task and fit the performance data to an abstract computational model (Q-learning) for calculation of single-trial reward prediction errors. Single-trial theta oscillatory activities following feedback were investigated within the context of expectation (prediction error) and adaptation (subsequent reaction time change). Results indicate that interactive medial and lateral frontal theta activities reflect the degree of negative and positive reward prediction error in the service of behavioral adaptation. These different brain areas use prediction error calculations for different behavioral adaptations: with medial frontal theta reflecting the utilization of prediction errors for reaction time slowing (specifically following errors), but lateral frontal theta reflecting prediction errors leading to working memory-related reaction time speeding for the correct choice.
登录
查看更多内容
影响因子：
5.3
作者：
Cohen, Michael X.;Ranganath, Charan
通讯作者：
Ranganath, Charan
影响因子：
3.2
作者：
Fell, J;Dietl, T;Fernández, G
通讯作者：
Fernández, G
DOI：
10.1098/rstb.2005.1622
发表时间：
2005-04-29
影响因子：
6.3
作者：
Friston, KJ
通讯作者：
Friston, KJ
影响因子：
56.9
作者：
Gehring, WJ;Willoughby, AR
通讯作者：
Willoughby, AR
影响因子：
2.5
作者：
Donkers, FCL;van Boxtel, GJM
通讯作者：
van Boxtel, GJM