Spontaneous eye blink rate predicts individual differences in exploration and exploitation during reinforcement learning
Spontaneous eye blink rate predicts individual differences in exploration and exploitation during reinforcement learning
复制标题
自发眨眼率预测强化学习期间探索和利用的个体差异
作者：
J. V. Van Slooten;Sara Jahfari;J. Theeuwes
自发眨眼率（sEBR）与纹状体多巴胺功能以及个体在强化学习（RL）后如何做出基于价值的选择有关。虽然sEBR被认为反映了个人如何从他们选择的负面结果中学习，但这一想法尚未得到明确的验证。本研究通过关注驱动RL的认知过程来评估sEBR的个体差异与学习的关系。使用贝叶斯潜在混合模型来量化RL行为及其潜在认知过程之间的映射，我们能够在这些认知过程的水平上区分低和高sEBR个体。对这些认知过程的进一步检查表明，sEBR唯一索引探索-利用倾向在RL：较低的sEBR预测剥削的选择高价值的选项，而较高的sEBR预测探索较低的价值选项。这种关系还得到了网络分析的支持，值得注意的是，在sEBR和个人如何从负面结果中学习之间没有观察到任何联系。我们的研究结果挑战了sEBR预测RL过程中从负面结果中学习的概念，并表明sEBR预测了个体的探索-利用倾向。这些影响价值的敏感性，在选择，以支持成功的业绩时，面对不确定的回报。
Spontaneous eye blink rate (sEBR) has been linked to striatal dopamine function and to how individuals make value-based choices after a period of reinforcement learning (RL). While sEBR is thought to reflect how individuals learn from the negative outcomes of their choices, this idea has not been tested explicitly. This study assessed how individual differences in sEBR relate to learning by focusing on the cognitive processes that drive RL. Using Bayesian latent mixture modelling to quantify the mapping between RL behaviour and its underlying cognitive processes, we were able to differentiate low and high sEBR individuals at the level of these cognitive processes. Further inspection of these cognitive processes indicated that sEBR uniquely indexed explore-exploit tendencies during RL: lower sEBR predicted exploitative choices for high valued options, whereas higher sEBR predicted exploration of lower value options. This relationship was additionally supported by a network analysis where, notably, no link was observed between sEBR and how individuals learned from negative outcomes. Our findings challenge the notion that sEBR predicts learning from negative outcomes during RL, and suggest that sEBR predicts individual explore-exploit tendencies. These then influence value sensitivity during choices to support successful performance when facing uncertain reward.
登录
查看更多内容
通过贝叶斯分层模型揭示社会信息收集的个体差异。
影响因子：
4.3
作者：
Pearson,JohnM;Watson,KarliK;Klein,JeffreyT;Ebitz,RBecket;Platt,MichaelL
通讯作者：
Platt,MichaelL
影响因子：
25
作者：
Frank, Michael J.;Doll, Bradley B.;Oas-Terpstra, Jen;Moreno, Francisco
通讯作者：
Moreno, Francisco
D1 和 D2 多巴胺受体独立调节黑长尾猴的自发眨眼率。
DOI：
--
发表时间：
1991
期刊：
The Journal of pharmacology and experimental therapeutics
影响因子：
--
作者：
Elsworth,JD;Lawrence,MS;Roth,RH;Taylor,JR;Mailman,RB;Nichols,DE;Lewis,MH;RedmondJr,DE
通讯作者：
RedmondJr,DE
影响因子：
25
作者：
Berke JD
通讯作者：
Berke JD