Policies and Priors
Policies and Priors
复制标题
DOI：
10.1007/978-1-4614-0751-5_9
复制
发表时间：
2012-01-01
期刊：
影响因子：
--
通讯作者：
Friston, Karl J.
中科院分区：
文献类型：
--
作者：
Friston, Karl J.
本章从纯理论的角度来考虑成瘾。它试图证实成瘾行为是异常感知学习的自然结果。简而言之，成瘾行为出现时，行为混淆自己的收购。具体来说，我们考虑如果行为干扰了负责优化关于世界因果结构的条件确定性或推理精度的神经递质系统，会发生什么。我们将在一个相当抽象的框架内探讨这一点，这个框架由行动和感知的自由能量公式提供。虽然这种治疗方法没有触及成瘾研究中的许多神经生物学或心理社会学问题，但它提供了一个原则性的框架，在此框架内可以理解与环境的交流以及它们如何受到干扰。我们的重点将是作为主动推理的行为和先前预期的关键作用。这些先验知识在强化学习中扮演着策略的角色，并对感知推理和后续行动施加了至关重要的约束。这些政策的动态处理表明，导致一个单一的有吸引力的国家和巡回政策，支持流浪的行为轨道之间的吸引力的国家集的不动点政策之间的根本区别。巡回政策可以为许多形式的行为，特别是成瘾提供一个有用的比喻。在这些政策下，神经调节（例如，多巴胺能）干扰可导致错误推断和随之而来的学习，这产生成瘾和防腐行为。
This chapter considers addiction from a purely theoretical point of view. It tries to substantiate the idea that addictive behaviour is a natural consequence of abnormal perceptual learning. In short, addictive behaviours emerge when behaviour confounds its own acquisition. Specifically, we consider what would happen if behaviour interfered with the neurotransmitter systems responsible for optimising the conditional certainty or precision of inferences about causal structure in the world. We will pursue this within a rather abstract framework provided by free-energy formulations of action and perception. Although this treatment does not touch upon many of the neurobiological or psychosocial issues in addiction research, it provides a principled framework within which to understand exchanges with the environment and how they can be disturbed. Our focus will be on behaviour as active inference and the key role of prior expectations. These priors play the role of policies in reinforcement learning and place crucial constraints on perceptual inference and subsequent action. A dynamical treatment of these policies suggests a fundamental distinction between fixed-point policies that lead to a single attractive state and itinerant policies that support wandering behavioural orbits among sets of attractive states. Itinerant policies may provide a useful metaphor for many forms of behaviour and, in particular, addiction. Under these sorts of policies, neuromodulatory (e.g., dopaminergic) perturbations can lead to false inference and consequent learning, which produce addictive and preservative behaviour.