Orbitofrontal Circuits Control Multiple Reinforcement-Learning Processes
Orbitofrontal Circuits Control Multiple Reinforcement-Learning Processes
复制标题
DOI：
10.1016/j.neuron.2019.05.042
复制
发表时间：
2019-08-21
期刊：
影响因子：
16.2
通讯作者：
Taylor, Jane R.
中科院分区：
文献类型：
--
作者：
Groman, Stephanie M.;Keistler, Colby;Taylor, Jane R.
动态环境中的自适应决策需要多个重复学习步骤，这些步骤可以通过可分离的神经回路来实现。在这里，我们使用了一种新的定向特异性病毒消融方法来研究几个解剖学定义的眶额皮质（OFC）电路在适应性，灵活的决策过程中的功能，在大鼠训练的概率逆转学习任务。消融投射到丘脑背核的眶额皮层神经元，通过破坏负面结果的使用来指导随后的选择，选择性地破坏了逆转后的表现。消融杏仁核神经元投射到眶额皮层也损害了逆转性能，但由于中断使用积极的结果，以指导随后的选择。相比之下，消融OFC神经元投射到杏仁核，增强逆转性能不稳定的行动值。我们的数据与OFC在决策中的单一功能不一致。相反，不同的OFC-杏仁核-纹状体回路介导了不同的动作组件-决策所需的价值更新和维护。
Adaptive decision making in dynamic environments requires multiple reinforcement-learning steps that may be implemented by dissociable neural circuits. Here, we used a novel directionally specific viral ablation approach to investigate the function of several anatomically defined orbitofrontal cortex (OFC) circuits during adaptive, flexible decision making in rats trained on a probabilistic reversal learning task. Ablation of OFC neurons projecting to the nucleus accumbens selectively disrupted performance following a reversal, by disrupting the use of negative outcomes to guide subsequent choices. Ablation of amygdala neurons projecting to the OFC also impaired reversal performance, but due to disruptions in the use of positive outcomes to guide subsequent choices. Ablation of OFC neurons projecting to the amygdala, by contrast, enhanced reversal performance by destabilizing action values. Our data are inconsistent with a unitary function of the OFC in decision making. Rather, distinct OFC-amygdala-striatal circuits mediate distinct components of the action- value updating and maintenance necessary for decision making.