CAREER: Neural circuit mechanisms of inference: how brains learn and use hidden structure

值得注意的是，动物可以在新的环境中表现出复杂的行为，尽管对它们的经验有限。大脑如何对环境的潜在统计数据和生成结构做出推断，并使用这些推断来指导行为？虽然特定的大脑区域与这种能力有关，但这些区域的神经连接和活动模式如何调节推理和复杂的推理尚不清楚。这个项目描绘了横跨多个大脑区域的神经回路机制，动物通过这些机制进行推理，并使用这些推理来指导它们的行为。这项研究的研究小组最近开发了一种高通量的大鼠行为训练设施，每天可以训练数十只大鼠(~60只)复杂的认知行为。该小组利用这种高通量的方法，将大鼠策略的个体差异与行为过程中记录的神经连接和神经活动的差异联系起来。与此同时，首席调查员为纽约市的高中生开发了一个研讨会，应用神经科学、心理学和经济学的课程来提高金融知识和决策能力。金融知识提供了一个独特的外展机会，以提高对神经科学研究的认识，并在一个高度突出和相关的主题：个人金融的背景下，向更广泛的公众传播尖端神经科学成果。虽然该研究项目试图了解大脑做出推理以指导决策的神经机制，但教育活动协同寻求教育学生关于他们经济选择背后的神经科学，并使他们能够做出更好的选择。该项目研究并阐明外侧眼眶前皮质(LOFC)中的神经元如何与背内侧纹状体(DMS)中遗传定义的细胞类型建立突触联系，以服务于基于模型的强化学习。大鼠接受了一项具有隐藏结构的新任务的训练，如果进行推断，它将为基于模型的推理提供清晰的行为读数。部署了病毒跟踪、行为过程中的多区域配对记录以及特定于投影的记录和停用，以识别LOFC内生成基于模型的推理的子电路的动态和连通性。这些实验在数十只大鼠身上进行，并利用个体行为差异来识别为基于模型的强化学习提供辅助的投影特定的前额叶子网络。该项目提供了对核心计算的电路和突触水平的理解，即根据根据任务的内部模型推断参考点的大鼠的结果被评估、比较和选择的经济参考点的理解。这项工作的结果将对神经科学、心理学和机器学习领域产生广泛的影响。这一奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

Remarkably, animals can exhibit sophisticated behaviors in novel environments, despite having limited experience with them. How does the brain make inferences about the underlying statistics and generative structure of environments, and use those inferences to guide behavior? While specific brain regions have been implicated in this capacity, it is unclear how patterns of neural connections and activity in these regions mediate inference and sophisticated reasoning. This project delineates the neural circuit mechanisms spanning multiple brain regions by which animals make inferences and use those inferences to guide their behavior. The research group of this study has recently developed a high-throughput behavioral training facility for rats that trains dozens of rats (~60) per day on sophisticated cognitive behaviors. The group leverages this high-throughput approach to relate individual differences in rats’ strategies to differences in neural connectivity and neural activity recorded during behavior. In parallel, the principal investigator develops a workshop for high school students in New York City that applies lessons from neuroscience, psychology, and economics to improve financial literacy and decision-making. Financial literacy provides a unique outreach opportunity for increasing awareness of neuroscience research and communicating cutting edge neuroscientific results to the broader public, in the context of a highly salient and relatable topic: personal finance. While the research project seeks to understand the neural mechanisms by which brains make inferences to guide decision-making, the educational activities synergistically seek to educate students about the neuroscience behind their economic choices, and empower them to make better ones.This project examines whether and elucidates how neurons in the lateral orbitofrontal cortex (lOFC) make synaptic connections with genetically-defined cell types in the dorsomedial striatum (DMS) in service of model-based reinforcement learning. Rats are trained on a novel task with hidden structure that, if inferred, provides a clear behavioral read-out of model-based reasoning. Viral tracing, multi-regional paired recordings during behavior, and projection-specific recordings and inactivations are deployed to identify the dynamics and connectivity of subcircuits within the lOFC that generate model-based inferences. These experiments are performed in dozens of rats, and leverage individual differences in behavior to identify projection-specific prefrontal subnetworks that subserve model-based reinforcement learning. The project provides a circuit- and synaptic-level understanding of a core computation, that of an economic reference point against which outcomes are evaluated, compared, and chosen, in rats that infer reference points according to an internal model of the task. The results of this work will have broad implications for the fields of neuroscience, psychology, and machine learning.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.