How instructed knowledge modulates the neural systems of reward learning
How instructed knowledge modulates the neural systems of reward learning
复制标题
DOI：
10.1073/pnas.1014938108
复制
发表时间：
2011-01-04
影响因子：
11.1
通讯作者：
Phelps, Elizabeth A.
中科院分区：
文献类型：
--
作者：
Li, Jian;Delgado, Mauricio R.;Phelps, Elizabeth A.
神经经济学的最新研究表明，奖励学习的强化学习模型捕捉到了一系列经济决策任务中行为表现和神经反应的模式。然而，这一强大的理论模型也有其局限性。试错只是个人学习与不同决策选项相关的价值的方法之一。人类还开发了有效的、象征性的学习交流方式，而不需要在试验中犯下多个错误。在本研究中，我们观察到，提示-奖励概率的指导知识改善了行为表现，并减少了伏隔核、腹内侧前额叶皮质和海马复合体中与强化学习相关的血氧水平依赖(BOLD)反馈反应。这些脑区对奖励反馈信号的BOLD反应的减少与背外侧前额叶皮质(DLPFC)的激活在功能上相关。这些结果表明，在学习行动价值时，参与者使用DLPFC根据行动结果信息的有用性来动态调整评估区域的结果反应。
Recent research in neuroeconomics has demonstrated that the reinforcement learning model of reward learning captures the patterns of both behavioral performance and neural responses during a range of economic decision-making tasks. However, this powerful theoretical model has its limits. Trial-and-error is only one of the means by which individuals can learn the value associated with different decision options. Humans have also developed efficient, symbolic means of communication for learning without the necessity for committing multiple errors across trials. In the present study, we observed that instructed knowledge of cue-reward probabilities improves behavioral performance and diminishes reinforcement learning-related blood-oxygen level-dependent (BOLD) responses to feedback in the nucleus accumbens, ventromedial prefrontal cortex, and hippocampal complex. The decrease in BOLD responses in these brain regions to reward-feedback signals was functionally correlated with activation of the dorsolateral prefrontal cortex (DLPFC). These results suggest that when learning action values, participants use the DLPFC to dynamically adjust outcome responses in valuation regions depending on the usefulness of action-outcome information.