Hierarchies of spatiotemporal anticipation in the human brain

人脑中时空预期的层次结构

• 批准号: 10558919
• 负责人: Mariam Aly
• 金额: $ 40.61万
• 依托单位: COLUMBIA UNIV NEW YORK MORNINGSIDE
• 依托单位国家: 美国
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-03-01 至 2028-02-29
• 项目状态: 未结题
• 来源: https://reporter.nih.gov/project-details/10558919
• 关键词: Affect; Area; Behavior; Behavioral; Brain; Brain region; Cities; Computer Models; Creativeness; Data; Destinations; Development; Distant; Environment; Episodic memory; Event; Functional Magnetic Resonance Imaging; Future; Generations; Goals; Hour; Human; Impairment; Individual; Knowledge; Laboratory Study; Learning; Lesion; Link; Memory; Methods; Modeling; Movement; Natural Language Processing; Neuropsychology; Organ; Participant; Patients; Pattern; Play; Poetry; Role; Route; Semantic memory; Semantics; Signal Transduction; Stimulus; Structure; System; Testing; Update; Visual; Visual Cortex; Visual System; Walking; Work; expectation; experience; extrastriate visual cortex; flexibility; insight; movie; novel; predictive modeling; prospective; recurrent neural network; simulation; spatiotemporal; theories; tool; virtual reality environment; visual tracking

PROJECT SUMMARY Everyday experience requires humans to make plans in a hierarchical fashion, so they can anticipate visual events that might occur seconds, minutes, hours, or longer in the future. For example, when walking through a city, individuals must track their immediate surroundings (e.g., the movement of pedestrians around them), intermediate sub-goals (e.g., landmarks along their route), and long-timescale goals (e.g., their final destination). Despite the ubiquity of such hierarchical anticipation in behavior, it is unclear how the brain can simultaneously anticipate events at multiple timescales. Our aim is to uncover the mechanisms underlying hierarchical anticipatory signals in the brain’s visual system, by determining how these signals form, what they represent, how they are updated, and how they guide future-oriented behavior. This will be accomplished with functional magnetic resonance imaging (fMRI), neuropsychological studies, naturalistic stimuli, computational models, and sophisticated analytic approaches for characterizing the dynamics of brain activity. These methods will determine the conditions under which the visual system generates hierarchical anticipatory signals, the content and flexibility of those signals, how they arise, and their consequences for behavior. Aim 1 will establish how hierarchical anticipatory signals form and what they represent. We hypothesize that such hierarchical anticipation depends on input from memory systems, is informed by pre-existing schema, and is flexible in the visual features and timescales represented. Aim 2 will determine how hierarchical anticipatory signals may be affected by top- down goals to simulate the future, and how these signals relate to future-oriented visual behavior at a range of timescales. We hypothesize that the visual hierarchy differentially updates its anticipatory signals when the environment or goals change, and generates predictive signals in novel situations by linking separate episodic memories. Finally, Aim 3 will test competing theories of the structure of anticipatory representations. We hypothesize that anticipatory representations are influenced by both temporal and semantic relationships within an event sequence, and propose a computational model for predicting anticipatory event representations learned from a temporally-structured stimulus. Together, the findings will elucidate the mechanisms by which the visual system forms and flexibly updates anticipatory representations at multiple timescales, and how these representations relate to anticipatory behavior in naturalistic conditions. Such insights are important because expectations are instrumental in allowing individuals to behave adaptively, and disruption of visual anticipation might broadly impair goal-directed behavior. This work will therefore shed light on how the capacity to anticipate upcoming events to adaptively guide behavior might be impaired following damage to different parts of the visual system, including higher-order areas whose damage is not associated with primary visual deficits. Together, the results will provide empirical tests of the structure and development of anticipatory signals across the visual hierarchy, informing theories that consider the brain to be a fundamentally predictive organ.

项目概要 日常经验要求人类以分层方式制定计划，以便他们能够预测视觉 未来可能发生的几秒、几分钟、几小时或更长时间的事件。例如，当走过一个 在城市中，个人必须跟踪他们周围的环境（例如，他们周围行人的移动）， 中间子目标（例如，沿途的地标）和长期目标（例如，最终目的地）。 尽管行为中这种分层预期无处不在，但尚不清楚大脑如何同时 预测多个时间尺度的事件。我们的目标是揭示层次结构背后的机制 大脑视觉系统中的预期信号，通过确定这些信号如何形成、它们代表什么， 它们如何更新，以及如何指导面向未来的行为。这将通过功能来完成 磁共振成像 (fMRI)、神经心理学研究、自然刺激、计算模型和 用于表征大脑活动动态的复杂分析方法。这些方法将决定 视觉系统产生分层预期信号的条件、内容和 这些信号的灵活性、它们如何产生以及它们对行为的影响。目标 1 将确定如何 分层预期信号的形式及其代表的内容。我们假设这种分层预期 取决于记忆系统的输入，由预先存在的模式通知，并且视觉特征灵活 和代表的时间尺度。目标 2 将确定分层预期信号如何受到顶层影响 确定模拟未来的目标，以及这些信号如何与一系列面向未来的视觉行为相关 时间尺度。我们假设，当 环境或目标发生变化，并通过链接单独的情景在新情况下生成预测信号 回忆。最后，目标 3 将测试预期表征结构的竞争理论。我们 假设预期表征受到时间和语义关系的影响 事件序列，并提出一个计算模型来预测学习到的预期事件表示 来自时间结构的刺激。总之，这些发现将阐明视觉的机制 系统在多个时间尺度上形成并灵活地更新预期表示，以及这些如何 表征与自然条件下的预期行为有关。这些见解很重要，因为 期望有助于个体做出适应性行为，并破坏视觉预期 可能会广泛损害目标导向的行为。因此，这项工作将揭示如何预测能力 由于视觉的不同部分受损，即将发生的事件可能会损害适应性地引导行为 系统，包括其损伤与初级视觉缺陷无关的高阶区域。在一起， 结果将为跨视觉的预期信号的结构和发展提供实证测试 层次结构，为认为大脑是一个根本上的预测器官的理论提供了信息。