A model of mood as integrated advantage.
A model of mood as integrated advantage.
复制标题
DOI：
10.1037/rev0000294
复制
发表时间：
2022-04
影响因子：
5.4
通讯作者：
Niv Y
中科院分区：
文献类型：
--
作者：
Bennett D;Davidson G;Niv Y
情绪是一种整合的、扩散的情感状态，被认为对认知和行为产生广泛的影响。与此同时，情绪本身被认为是与环境互动反馈的产物，波动缓慢。在这里，我们提出了一个新的计算理论的情绪价的综合优势模型，试图解释这种双向互动。采用强化学习的理论形式主义，我们建议将情绪的效价概念化为代理对其行为优势的评估的漏积分。该模型概括和扩展了以往的情绪模型，其中情感效价被概念化为奖励预测误差的移动平均值。我们给出了一个完整的理论推导的综合优势模型，并提供了一个功能的解释如何整合优势变量可以部署自适应的生物制剂，以加速学习在复杂和/或随机环境。具体来说，借鉴随机优化理论，我们提出，代理可以利用我们假设的形式的情绪近似的动量为基础的更新其行为政策，从而促进快速学习的最佳行动。然后，我们展示了这种模式的情绪提供了一个原则性的和吝啬的解释，从情感科学文献的情绪，包括预期和过度相关的影响，反事实的影响，从信息有关的替代品，行动典型性的影响，和行动/不作为的不对称性。
Mood is an integrative and diffuse affective state that is thought to exert a pervasive effect on cognition and behavior. At the same time, mood itself is thought to fluctuate slowly as a product of feedback from interactions with the environment. Here we present a new computational theory of the valence of mood—the Integrated Advantage model—that seeks to account for this bidirectional interaction. Adopting theoretical formalisms from reinforcement learning, we propose to conceptualize the valence of mood as a leaky integral of an agent’s appraisals of the Advantage of its actions. This model generalizes and extends previous models of mood wherein affective valence was conceptualized as a moving average of reward prediction errors. We give a full theoretical derivation of the Integrated Advantage model and provide a functional explanation of how an integrated-Advantage variable could be deployed adaptively by a biological agent to accelerate learning in complex and/or stochastic environments. Specifically, drawing on stochastic optimization theory, we propose that an agent can utilize our hypothesized form of mood to approximate a momentum-based update to its behavioral policy, thereby facilitating rapid learning of optimal actions. We then show how this model of mood provides a principled and parsimonious explanation for a number of contextual effects on mood from the affective science literature, including expectation- and surprise-related effects, counterfactual effects from information about foregone alternatives, action-typicality effects, and action/inaction asymmetry.
登录
查看更多内容
影响因子：
3.5
作者：
Bar-Eli, Michael;Azar, Ofer H.;Schein, Galit
通讯作者：
Schein, Galit
影响因子：
2.6
作者：
Beedie, CJ;Terry, PC;Lane, AM
通讯作者：
Lane, AM
影响因子：
16.4
作者：
BOWER, GH
通讯作者：
BOWER, GH
影响因子：
2.7
作者：
BELL, DE
通讯作者：
BELL, DE
影响因子：
25
作者：
Bromberg-Martin ES;Hikosaka O
通讯作者：
Hikosaka O