Neuronal representation of a working memory-based decision strategy in the motor and prefrontal cortico-basal ganglia loops
Neuronal representation of a working memory-based decision strategy in the motor and prefrontal cortico-basal ganglia loops
复制标题
运动和前额叶皮质基底神经节环路中基于工作记忆的决策策略的神经元表示
DOI：
10.1101/2022.09.07.506894
复制
发表时间：
2022
期刊：
影响因子：
--
通讯作者：
Doya Kenji
中科院分区：
文献类型：
--
作者：
Yoshizawa Tomohiko;Ito Makoto;Doya Kenji
虽然动物和人类的决策策略通常由无模型和基于模型的强化学习（RL）来解释，但它们的选择序列通常遵循基于过去行为和奖励的工作记忆（WM）的简单程序。在这里，我们通过同时记录背内侧纹状体（DMS）、背外侧纹状体（DLS）、内侧前额叶皮层（mPFC）和初级运动皮层（M1）的神经元活动，探讨了基于工作记忆的选择策略，如赢-留-输-开关（WSLS），是如何在前额叶和运动皮质-基底节区环路中表现出来的。为了比较大鼠使用基于工作记忆的策略时的神经元表征，我们开发了一种新的任务范式，即连续/间歇选择任务，包括选择和无选择试验。在连续条件（CC）中，只有选择试验，而在间歇条件（IC）中，在每个选择试验之后插入一个无选择试验，以破坏前一个选择和奖励的工作记忆。CC行为表现出高比例的“赢-留”和“输-换”选择，这可以被视为“一种嘈杂的WSLS策略”。神经峰值泊松回归揭示了在动作选择前对先前动作和奖励的CC编码以及在动作执行时对WSLS动作的预期编码。一个惊人的发现是，运动皮质-基底神经节环路中的DLS和M1除了当前的动作编码外，还携带大量关于先前选择、奖励及其相互作用的WM信息。
While animal and human decision strategies are typically explained by model-free and model-based reinforcement learning (RL), their choice sequences often follow simple procedures based on working memory (WM) of past actions and rewards. Here, we address how working memory-based choice strategies, such as win-stay-lose-switch (WSLS), are represented in the prefrontal and motor cortico-basal ganglia loops by simultaneous recording of neuronal activities in the dorsomedial striatum (DMS), the dorsolateral striatum (DLS), the medial prefrontal cortex (mPFC), and the primary motor cortex (M1). In order to compare neuronal representations when rats employ working memory-based strategies, we developed a new task paradigm, a continuous/intermittent choice task, consisting of choice and no-choice trials. While the continuous condition (CC) consisted of only choice trials, in the intermittent condition (IC), a no-choice trial was inserted after each choice trial to disrupt working memory of the previous choice and reward. Behaviors in CC showed high proportions of win-stay and lose-switch choices, which could be regarded as “a noisy WSLS strategy.” Poisson regression of neural spikes revealed encoding specifically in CC of the previous action and reward before action choice and prospective coding of WSLS action during action execution. A striking finding was that the DLS and M1 in the motor cortico-basal ganglia loop carry substantial WM information about previous choices, rewards, and their interactions, in addition to current action coding.