Neural signatures of learning complex environments in the amygdala-prefrontal network

联系PD/PI：贝拉克，L 学习和思考复杂情况的能力是人类一系列认知活动的核心 功能，包括导航、推理和决策。关于这些问题的众多理论 域依赖于这些外部和内部环境的状态表示，但如何 他们获得了这样的陈述，目前尚不清楚。我的总体目标是了解 动物，包括人类，可以在如此复杂的环境中推理和学习。在这个项目中， 我们打算调查动物是如何在复杂的环境中学习这些表征的 猴子的顺序决策任务。使用一种受董事会启发的新颖行为任务 游戏战舰，猴子在屏幕上寻找隐藏的形状。有数以百万计的可能 形状，但猴子是有能力的学习者，远远超过经典的强化 学习算法。猴子如何能如此快速地学习这些形状仍然是个谜。在……里面 除了这些未知的学习计算基础外，神经机制 支持这一行为也是未被探索的。最近的研究包括电生理学和损伤 研究发现杏仁核(AMYG)和 眶前叶皮质(OFC)。然而，这些研究只使用了极少数的州，只有 需要协会来学习。此外，区域的相互作用和计算作用 还没有被描述出来。鉴于我们对复杂学习的理解上的这些差距 任务，我们将使用战舰任务来阐明1)驱动环境的各个方面 复杂状态的学习表示，2)这种学习的计算基础 使用行为模型拟合和深度神经网络，以及3)神经机制 在AMYG-OFC电路中承保此容量。我们假设OFC代表隐藏的 任务状态，不能根据可感知的刺激和结果完全定义的状态。我们 进一步假设AMYG在学习和更新这些表示中起核心作用 通过使用来自OFC的输入来构建当前环境的在线表示 来自感觉处理和记忆区域，代表当前刺激、结果和 联想。我们假设观察者-批评者体系结构是学习表示的基础 复杂的任务，AMYG活动计算并向学习的OFC发送教学信号 并更新任务状态表示。作为这项计划研究的一部分，我将接受 高级建模和神经分析技术，并完成一个学习过程中的使用 深度神经网络。这次培训将在Stefano Fusi博士和Dr。 C丹尼尔·萨尔兹曼，哥伦比亚大学扎克曼大脑行为研究所的研究员。 项目摘要/摘要第6页

Contact PD/PI: BARACK, DAVID L The ability to learn and think about complex situations is central to a range of human cognitive functions, including navigation, reasoning, and decision making. Numerous theories across these domains rely on representations of states of these external and internal environments, but how they acquire such representations remains unknown. My overall goal is to understand how animals, including humans, can reason and learn in such complex environments. In this project, we propose to investigate how animals are able to learn these representations in a complex sequential decision making task in monkeys. Using a novel behavioral task inspired by the board game battleship, monkeys search for hidden shapes on a screen. There are millions of possible shapes, and yet monkeys are capable learners, vastly outperforming classic reinforcement learning algorithms. How monkeys can learn the shapes so quickly remains mysterious. In addition to these unknown computational foundations for learning, the neural mechanisms that support this behavior are also unexplored. Recent studies including electrophysiology and lesion research have found signatures of state representations in the amygdala (AMYG) and the orbitofrontal cortex (OFC). However, these studies have only used very few states that only require associations to learn. Moreover, the interactions and computational roles of the regions have not been characterized. In light of these gaps in our understanding of learning in complex tasks, we will use the battleship task to elucidate 1) the aspects of the environment that drive learning representations of complex states, 2) the computational foundations of this learning using behavioral model fitting and deep neural networks, and 3) the neural mechanisms that underwrite this capacity in the AMYG-OFC circuit. We hypothesize that OFC represents hidden task states, those that cannot be fully defined in terms of perceptible stimuli and outcomes. We further hypothesize that AMYG plays a central role in learning and updating these representations by constructing an online representation of the current environment using input from OFC as well as from sensory processing and memory regions, representing current stimuli, outcomes, and associations. We posit an observer-critic architecture underlies learning representations of complex tasks, with AMYG activity computing and sending a teaching signal to OFC that learns and updates task state representations. As part of this planned research, I will be trained in advanced modeling and neural analysis techniques, and complete a course of study on the use of deep neural networks. This training will take place under the guidance of Dr. Stefano Fusi and Dr. C Daniel Salzman in the Zuckerman Mind Brain Behavior Institute at Columbia University. Project Summary/Abstract Page 6