Neural circuits for learning under perceptual uncertainty

大脑如何学会在不确定的世界中做出有效的决策？生物学习的一个标志是策略发现：在很长一段时间内，动物可以通过一系列行为从幼稚转变为专家表现。几十年的研究已经强调了中脑多巴胺（DA）神经元以及主要的DA接收大脑区域，纹状体和额叶皮质在学习中的作用。然而，以前的研究并没有从任务的第一次试验中探索这些神经回路，而动物则在感知不确定性下测试和选择获得奖励的可能策略。此外，过去的研究往往在小规模和孤立的情况下检查这些神经回路，无法系统地研究这些大脑区域的神经信号如何成为学习的基础。因此，我们对神经计算的理解与不确定性下策略发现的长期过程之间存在很大的差距。这项提议将联合收割机结合新颖的行为任务和先进的神经回路工具来填补这一空白。我们将纵向测量和操纵神经信号，从幼稚到专家的表现在小鼠学习视觉决策任务，承认多种行为策略，并将使用计算工具，以形式化神经活动和学习动力学之间的关系。这项工作将解决这些问题：1。在不确定性的学习过程中，DA神经信号如何发展，它们与行为策略有何关系？2.在学习过程中，纹状体和额叶皮层释放的DA编码了什么？不同脑区的DA在学习中是否扮演着不同的因果角色？3.纹状体和额叶皮层的神经信号是如何发展的，以及如何与学习过程中的行为策略相关？这项工作将纠正学习的神经基础数据的缺乏，在我们对感知不确定性下调节学习的神经回路的理解中产生一个步骤的变化。

How does the brain learn to make efficient decisions in an uncertain world? A hallmark of biological learning is strategy discovery: over long periods of time, animals can transition through a range of behaviors on their way from naïve to expert performance. Decades of research have highlighted the role of midbrain dopamine (DA) neurons as well as major DA-receiving brain regions, striatum and frontal cortex, in learning. However, previous studies did not probe these neural circuits from the very first trial of the task, while animals test and select among possible strategies for gaining reward under perceptual uncertainty. Moreover, past studies often examined these neural circuits at a small scale and in isolation, and could not systematically investigate how neural signals across these brain regions underlie learning. A large gap thus remains between our understanding of neural computations and the long-term process of strategy discovery under uncertainty. This proposal will combine novel behavioral tasks and advanced neural circuit tools to fill this gap. We will longitudinally measure and manipulate neural signals from naïve to expert performance in mice learning a visual decision task that admits multiple behavioral strategies, and will use computational tools to formalize the relation between neural activity and learning dynamics. The work will address these questions:1. How do DA neural signals develop during learning under uncertainty, and how do they relate to behavioral strategies?2. What does DA release across striatum and frontal cortex encode during learning, and does DA in different brain regions play distinct causal roles in learning?3. How do neural signals across striatum and frontal cortex develop and relate to behavioral strategies during learning?This work will rectify the paucity of data on the neural bases of learning, generating a step change in our understanding of neural circuits regulating learning under perceptual uncertainty.