Age affects reinforcement learning through dopamine-based learning imbalance and high decision noise-not through Parkinsonian mechanisms.
Age affects reinforcement learning through dopamine-based learning imbalance and high decision noise-not through Parkinsonian mechanisms.
复制标题
年龄通过基于多巴胺的学习不平衡和高决策噪声影响强化学习，而不是通过帕金森机制。
DOI：
10.1016/j.neurobiolaging.2018.04.006
复制
发表时间：
2018
影响因子：
4.2
通讯作者：
Gluck,MarkA
中科院分区：
文献类型：
--
作者：
Sojitra,RaviB;Lerner,Itamar;Petok,JessicaR;Gluck,MarkA
强化学习在健康的认知老化中可能会下降。虽然一些研究结果表明，在从奖励中学习时，损伤尤其明显，类似于帕金森氏病的缺陷，但其他研究也表明在从惩罚中学习时也存在损伤。为了调和这些发现，我们对来自3个年龄组的252名成年人进行了概率强化学习任务测试，用Q强化学习模型分析了试验性能，并将拟合的模型参数和行为与多巴胺相关基因的多态性相关联。分析表明，从积极和消极反馈中学习随着年龄的增长而下降，但通过不同的机制：当从消极反馈中学习时，老年人由于嘈杂的决策而较慢;当从积极反馈中学习时，由于从积极和消极预测错误中学习的不平衡，他们倾向于解决非最佳解决方案。这种不平衡与DARPP-32基因的多态性有关，并且似乎是由与先前归因于帕金森病的机制不同的机制引起的。此外，这种不平衡预测了以前使用概率选择任务的衰老结果，这些结果被错误地归因于帕金森机制。
Probabilistic reinforcement learning declines in healthy cognitive aging. While some findings suggest impairments are especially conspicuous in learning from rewards, resembling deficits in Parkinson's disease, others also show impairments in learning from punishments. To reconcile these findings, we tested 252 adults from 3 age groups on a probabilistic reinforcement learning task, analyzed trial-by-trial performance with a Q-reinforcement learning model, and correlated both fitted model parameters and behavior to polymorphisms in dopamine-related genes. Analyses revealed that learning from both positive and negative feedback declines with age but through different mechanisms: when learning from negative feedback, older adults were slower due to noisy decision-making; when learning from positive feedback, they tended to settle for a nonoptimal solution due to an imbalance in learning from positive and negative prediction errors. The imbalance was associated with polymorphisms in the DARPP-32 gene and appeared to arise from mechanisms different from those previously attributed to Parkinson's disease. Moreover, this imbalance predicted previous findings on aging using the Probabilistic Selection Task, which were misattributed to Parkinsonian mechanisms.