Learning the value of information in an uncertain world
Learning the value of information in an uncertain world
复制标题
DOI：
10.1038/nn1954
复制
发表时间：
2007-09-01
影响因子：
25
通讯作者：
Rushworth, Matthew F. S.
中科院分区：
文献类型：
--
作者：
Behrens, Timothy E. J.;Woolrich, Mark W.;Rushworth, Matthew F. S.
我们的决策是由与过去决策相关的结果所指导的。然而，过去的每一个结果对我们下一个决定的影响程度仍然不清楚。为确保最佳决策，决策结果的权重应反映其在预测未来结果方面的显著性，而这种显著性应受到奖励环境波动性的调节。我们表明，人类受试者以最佳方式评估波动性，并相应地调整决策。这种波动性的最佳估计反映在前扣带皮层（ACC）的fMRI信号时，每个试验结果进行观察。当一条新的信息被目击时，活动水平反映了它对预测未来结果的重要性。此外，ACC信号在整个人群中的变化预测了受试者学习率的变化。我们的研究结果提供了一个正式的帐户，我们如何权衡我们的不同经验，指导我们未来的行动。
Our decisions are guided by outcomes that are associated with decisions made in the past. However, the amount of influence each past outcome has on our next decision remains unclear. To ensure optimal decision-making, the weight given to decision outcomes should reflect their salience in predicting future outcomes, and this salience should be modulated by the volatility of the reward environment. We show that human subjects assess volatility in an optimal manner and adjust decision-making accordingly. This optimal estimate of volatility is reflected in the fMRI signal in the anterior cingulate cortex ( ACC) when each trial outcome is observed. When a new piece of information is witnessed, activity levels reflect its salience for predicting future outcomes. Furthermore, variations in this ACC signal across the population predict variations in subject learning rates. Our results provide a formal account of how we weigh our different experiences in guiding our future actions.