From Creatures of Habit to Goal-Directed Learners
From Creatures of Habit to Goal-Directed Learners
复制标题
从习惯的产物到目标导向的学习者
DOI：
--
复制
发表时间：
2016
期刊：
影响因子：
--
通讯作者：
Catherine A. Hartley
中科院分区：
文献类型：
--
作者：
J. H. Decker;A. R. Otto;N. Daw;Catherine A. Hartley
理论模型区分了在强化学习理论中已经形式化的两种决策策略。基于模型的策略利用对潜在行动及其后果的认知模型来做出目标导向的选择，而非模型策略仅根据行动的奖励历史来评估行动。对成年人的研究已经开始阐明这些学习过程背后的心理机制和神经基础，以及影响他们相对招募的因素。然而，这些评价战略的发展轨迹并没有得到很好的描述。在这项研究中，儿童、青少年和成年人执行了一项连续的强化学习任务，这使得能够估计基于模型和非模型对选择的贡献。虽然无模型策略在所有年龄段的选择行为中都很明显，但基于模型的策略在儿童中缺失，在青少年中变得明显，并在成年人中得到加强。这些结果表明，基于模型的评估系统的招募代表了目标导向行为逐渐成熟的关键认知成分。
Theoretical models distinguish two decision-making strategies that have been formalized in reinforcement-learning theory. A model-based strategy leverages a cognitive model of potential actions and their consequences to make goal-directed choices, whereas a model-free strategy evaluates actions based solely on their reward history. Research in adults has begun to elucidate the psychological mechanisms and neural substrates underlying these learning processes and factors that influence their relative recruitment. However, the developmental trajectory of these evaluative strategies has not been well characterized. In this study, children, adolescents, and adults performed a sequential reinforcement-learning task that enabled estimation of model-based and model-free contributions to choice. Whereas a model-free strategy was apparent in choice behavior across all age groups, a model-based strategy was absent in children, became evident in adolescents, and strengthened in adults. These results suggest that recruitment of model-based valuation systems represents a critical cognitive component underlying the gradual maturation of goal-directed behavior.
影响因子：
4.1
作者：
Shohamy, Daphna;Turk-Browne, Nicholas B.
通讯作者：
Turk-Browne, Nicholas B.
影响因子：
3.7
作者：
van den Bos, Wouter;Cohen, Michael X.;Crone, Eveline A.
通讯作者：
Crone, Eveline A.
DOI：
10.1073/pnas.1417219112
发表时间：
2015-02-03
影响因子：
11.1
作者：
Deserno, Lorenz;Huys, Quentin J. M.;Schlagenhauf, Florian
通讯作者：
Schlagenhauf, Florian