Electrophysiological correlates reflect the integration of model-based and model-free decision information
Electrophysiological correlates reflect the integration of model-based and model-free decision information
复制标题
DOI：
10.3758/s13415-016-0487-3
复制
发表时间：
2017-04-01
影响因子：
2.9
通讯作者：
Li, Shu-Chen
中科院分区：
文献类型：
--
作者：
Eppinger, Ben;Walter, Maik;Li, Shu-Chen
在这项研究中，我们使用两阶段马尔可夫决策任务，结合事件相关电位(ERPs)和计算模型，研究了习惯性(无模型)和目标导向(基于模型)决策过程的相互作用。为了操纵基于模型的决策的需求，我们应用了两种不同概率的实验条件，从任务的第一阶段转换到第二阶段。正如我们预期的那样，当阶段转换更可预测时，参与者表现出更多基于模型的(规划)行为。与这一结果一致，我们发现刺激诱发的顶叶(P300)活动在任务的第二阶段随着状态转换的可预测性而增加。然而，顶叶活动也反映了关于刺激期望值的无模型信息，表明在任务的这个阶段，两种类型的信息都被整合起来，以指导决策。结果相关的事件相关电位成分只反映了与奖励相关的过程：具体地说，内侧前额叶事件相关电位成分(反馈相关的负性)对负面结果敏感，而由奖励引起的成分(反馈相关的积极情绪)随着积极预测误差的增加而增加。综上所述，我们的数据表明，刺激锁定的顶叶活动反映了决策过程中基于模型的信息和非模型信息的整合，而反馈相关的内侧前额叶信号主要反映了与奖励相关的决策过程。
In this study, we investigated the interplay of habitual (model-free) and goal-directed (model-based) decision processes by using a two-stage Markov decision task in combination with event-related potentials (ERPs) and computational modeling. To manipulate the demands on model-based decision making, we applied two experimental conditions with different probabilities of transitioning from the first to the second stage of the task. As we expected, when the stage transitions were more predictable, participants showed greater model-based (planning) behavior. Consistent with this result, we found that stimulus-evoked parietal (P300) activity at the second stage of the task increased with the predictability of the state transitions. However, the parietal activity also reflected model-free information about the expected values of the stimuli, indicating that at this stage of the task both types of information are integrated to guide decision making. Outcome-related ERP components only reflected reward-related processes: Specifically, a medial prefrontal ERP component (the feedback-related negativity) was sensitive to negative outcomes, whereas a component that is elicited by reward (the feedback-related positivity) increased as a function of positive prediction errors. Taken together, our data indicate that stimulus-locked parietal activity reflects the integration of model-based and model-free information during decision making, whereas feedback-related medial prefrontal signals primarily reflect reward-related decision processes.