Hierarchies of spatiotemporal anticipation in the human brain

人脑中时空预期的层次结构

• 批准号: 10558919
• 负责人: Mariam Aly
• 金额: $ 40.61万
• 依托单位: COLUMBIA UNIV NEW YORK MORNINGSIDE
• 依托单位国家: 美国
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-03-01 至 2028-02-29
• 项目状态: 未结题
• 来源: https://reporter.nih.gov/project-details/10558919
• 关键词: Affect; Area; Behavior; Behavioral; Brain; Brain region; Cities; Computer Models; Creativeness; Data; Destinations; Development; Distant; Environment; Episodic memory; Event; Functional Magnetic Resonance Imaging; Future; Generations; Goals; Hour; Human; Impairment; Individual; Knowledge; Laboratory Study; Learning; Lesion; Link; Memory; Methods; Modeling; Movement; Natural Language Processing; Neuropsychology; Organ; Participant; Patients; Pattern; Play; Poetry; Role; Route; Semantic memory; Semantics; Signal Transduction; Stimulus; Structure; System; Testing; Update; Visual; Visual Cortex; Visual System; Walking; Work; expectation; experience; extrastriate visual cortex; flexibility; insight; movie; novel; predictive modeling; prospective; recurrent neural network; simulation; spatiotemporal; theories; tool; virtual reality environment; visual tracking

PROJECT SUMMARY Everyday experience requires humans to make plans in a hierarchical fashion, so they can anticipate visual events that might occur seconds, minutes, hours, or longer in the future. For example, when walking through a city, individuals must track their immediate surroundings (e.g., the movement of pedestrians around them), intermediate sub-goals (e.g., landmarks along their route), and long-timescale goals (e.g., their final destination). Despite the ubiquity of such hierarchical anticipation in behavior, it is unclear how the brain can simultaneously anticipate events at multiple timescales. Our aim is to uncover the mechanisms underlying hierarchical anticipatory signals in the brain’s visual system, by determining how these signals form, what they represent, how they are updated, and how they guide future-oriented behavior. This will be accomplished with functional magnetic resonance imaging (fMRI), neuropsychological studies, naturalistic stimuli, computational models, and sophisticated analytic approaches for characterizing the dynamics of brain activity. These methods will determine the conditions under which the visual system generates hierarchical anticipatory signals, the content and flexibility of those signals, how they arise, and their consequences for behavior. Aim 1 will establish how hierarchical anticipatory signals form and what they represent. We hypothesize that such hierarchical anticipation depends on input from memory systems, is informed by pre-existing schema, and is flexible in the visual features and timescales represented. Aim 2 will determine how hierarchical anticipatory signals may be affected by top- down goals to simulate the future, and how these signals relate to future-oriented visual behavior at a range of timescales. We hypothesize that the visual hierarchy differentially updates its anticipatory signals when the environment or goals change, and generates predictive signals in novel situations by linking separate episodic memories. Finally, Aim 3 will test competing theories of the structure of anticipatory representations. We hypothesize that anticipatory representations are influenced by both temporal and semantic relationships within an event sequence, and propose a computational model for predicting anticipatory event representations learned from a temporally-structured stimulus. Together, the findings will elucidate the mechanisms by which the visual system forms and flexibly updates anticipatory representations at multiple timescales, and how these representations relate to anticipatory behavior in naturalistic conditions. Such insights are important because expectations are instrumental in allowing individuals to behave adaptively, and disruption of visual anticipation might broadly impair goal-directed behavior. This work will therefore shed light on how the capacity to anticipate upcoming events to adaptively guide behavior might be impaired following damage to different parts of the visual system, including higher-order areas whose damage is not associated with primary visual deficits. Together, the results will provide empirical tests of the structure and development of anticipatory signals across the visual hierarchy, informing theories that consider the brain to be a fundamentally predictive organ.

项目总结 日常体验要求人类以分层的方式制定计划，这样他们就可以预测视觉 未来几秒钟、几分钟、几小时或更长时间内可能发生的事件。例如，当穿过一个 在城市，个人必须跟踪他们周围的环境(例如，周围行人的移动)， 中间子目标(例如，路线沿线的地标)和长期目标(例如，其最终目的地)。 尽管这种分级预期在行为中无处不在，但目前还不清楚大脑如何同时 预测多个时间尺度上的事件。我们的目标是揭示等级制度背后的机制 大脑视觉系统中的预期信号，通过确定这些信号是如何形成的，它们代表什么， 它们是如何更新的，以及它们如何指导面向未来的行为。这将通过函数实现 磁共振成像(FMRI)、神经心理学研究、自然刺激、计算模型和 用于描述大脑活动动态的复杂分析方法。这些方法将确定 视觉系统产生分层预期信号的条件、内容和 这些信号的灵活性，它们是如何产生的，以及它们对行为的影响。目标1将确定如何 层次化的预期信号的形成及其所代表的意义。我们假设这种分等级的预期 依赖于来自存储系统的输入，由预先存在的图式通知，并且在视觉特征上是灵活的 以及所代表的时间尺度。目标2将确定分层预期信号可能如何受顶部- 向下模拟未来的目标，以及这些信号与一系列面向未来的视觉行为的关系 时间尺度。我们假设，当视觉层次结构的预期信号 环境或目标发生变化，并通过将不同的情节联系起来，在新的情况下产生预测信号 回忆。最后，目标3将测试预期表征结构的相互竞争的理论。我们 假设预期表征同时受时间和语义关系的影响 事件序列，并提出了一种预测学习的预期事件表征的计算模型 从时间结构的刺激。总而言之，这些发现将阐明视觉 系统在多个时间尺度上形成并灵活地更新预期表示，以及这些 表征与自然主义条件下的预期行为有关。这样的洞察力很重要，因为 期望有助于允许个人的适应性行为，并破坏视觉预期 可能在很大程度上损害目标导向行为。因此，这项工作将阐明如何预测的能力 在视觉不同部分受损后，即将到来的自适应引导行为的事件可能会受到损害 系统，包括其损害与初级视觉缺陷无关的更高阶区。团结在一起， 研究结果将为预期信号在视觉上的结构和发展提供经验测试 层级结构，为那些认为大脑从根本上是预测器官的理论提供了信息。