The neural and behavioral causes underlying differences between visual perception and memory

神经和行为导致视觉感知和记忆之间的潜在差异

• 批准号: 10556562
• 负责人: Wilma A. Bainbridge
• 金额: $ 36.9万
• 依托单位: UNIVERSITY OF CHICAGO
• 依托单位国家: 美国
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-03-01 至 2028-02-29
• 项目状态: 未结题
• 来源: https://reporter.nih.gov/project-details/10556562
• 关键词: Address; Alzheimer' s Disease; Anterior; Behavioral; Big Data; Big Data Methods; Brain; Brain region; Computer Models; Development; Dissociation; Eye; Functional Magnetic Resonance Imaging; Goals; Human; Image; Imagery; Impairment; Individual; Knock-out; Knowledge; Laboratories; Memory; Memory Disorders; Memory impairment; Methods; Mind; Nature; Neurodegenerative Disorders; Neurons; Participant; Patients; Pattern; Perception; Population; Prevalence; Process; Psyche structure; Research; Risk; Role; Running; Semantic memory; Semantics; Sensory; Steel; Structure; Temporal Lobe; Testing; Vision; Vision Disorders; Visual; Visual Perception; Visualization; Work; blind; crowdsourcing; diagnostic tool; experience; innovation; member; memory process; mental representation; neural; neural patterning; neuroimaging; neuromechanism; regional difference; visual imagery; visual information; visual memory

PROJECT SUMMARY Until recently, it was thought that our memories occur as a reactivation of perception – reconjuring the same visual information and neural patterns (dubbed the sensory reinstatement hypothesis; e.g., Buckner & Wheeler, 2001). However, in recent work, we observed surprising differences between perception and memory, with separate brain voxels and patterns involved in each process (Bainbridge et al., 2021b). We observed that memory representations in the brain lose rich high-level visual information, and that the neurons sensitive to memory are anterior to those sensitive to perception. Here, we hypothesize that memories become more semanticized representations of perception, resulting in an anterior neural shift towards more semantic regions (Popham et al., 2021); we dub this the semantic transformation hypothesis. This hypothesis runs counter to a recent proposal that memory and perception are supported by two separate yet adjacent networks (the separate networks hypothesis, Steel et al., 2021). By testing these three hypotheses in conjunction, we will be able to identify the specific neural mechanisms that support visual memory and its relation to visual perception. Crucially, this project has critical importance for understanding memory disorders such as Alzheimer’s Disease, for which recent work has shown that visual and semantic information in an image can predict its eventual memory fate in a patient (Bainbridge et al., 2019a; Grande et al., 2021). Towards this question, we utilize innovative methods pioneered by our laboratory, including a direct read-out of a participant’s perception and memory through drawings that are quantified through online crowd- sourcing (Bainbridge et al., 2019a; Bainbridge, 2021). In Aim 1, we use drawings to identify the direct influences of visual and semantic information on visual memory representations. In Aim 2, we use representational similarity analyses (Bainbridge et al., 2021b) combined with functional magnetic resonance imaging to test the roles of visual and semantic information on memory patterns in the brain. Importantly, in addition to testing typical individuals, we also study the newly characterized phenomenon of congenital aphantasia (2-5% prevalence), which describes individuals with no visual memory yet intact visual perception and semantic memory (Zeman et al., 2015; Keogh & Pearson, 2018). Aphantasia serves as natural “knock- out” case to observe behavioral and neural differences between perception and memory, and our laboratory is the only laboratory in the U.S. to have studied the condition thus far (Bainbridge et al., 2021a). Armed with this unique population, in Aim 3, we will identify the neural substrates that underlie their dissociation of visual memory and vision, and test the role of semantic vs. visual content on memory. In sum, this study promises to resolve our understanding of how what we see becomes what we remember, by identifying the causes of these striking differences observed in the brain between perception and memory.

项目摘要 直到最近，人们认为我们的记忆是作为感知重新激活的 - 重新赋予了同样的事物 视觉信息和神经模式（称为感觉恢复假设；例如Buckner＆ 惠勒，2001）。但是，在最近的工作中，我们观察到感知和 记忆，每个过程中涉及单独的脑体素和模式（Bainbridge等，2021b）。我们 观察到大脑中的记忆表示失去了丰富的高级视觉信息，并且神经元 对记忆敏感的是对感知敏感的前方。在这里，我们假设记忆 成为感知的更具语义的表示，导致前部神经转移 更多语义区域（Popham等，2021）；我们将其称为语义转化假设。这 假设与最近的提议相反，即记忆和感知得到了两个单独的支持 相邻网络（单独的网络假设，Steel等，2021）。通过检验这三个假设 结合使用，我们将能够识别支持视觉记忆的特定神经机制 及其与视觉感知的关系。至关重要的是，该项目对于理解记忆至关重要 阿尔茨海默氏病等疾病，最近的工作表明了视觉和语义信息 在图像中，可以预测患者最终的记忆命运（Bainbridge等，2019a； Grande等，2021）。 关于这个问题，我们利用了我们实验室率先开创的创新方法，包括直接读取 参与者通过在线人群量化的图纸的看法和记忆 - 采购（Bainbridge等，2019a； Bainbridge，2021）。在AIM 1中，我们使用图纸来识别直接 视觉和语义信息对视觉记忆表示的影响。在AIM 2中，我们使用 代表性相似性分析（Bainbridge等，2021b）与功能磁共振结合 成像以测试有关大脑记忆模式的视觉和语义信息的作用。重要的是，在 除了测试典型个体，我们还研究了先天性的新特征现象 厌食症（2-5％的患病率），它描述了没有视觉记忆但视觉感知的个体 和语义记忆（Zeman等，2015； Keogh＆Pearson，2018）。厌食症是自然的“敲门声 - 案例观察感知和记忆之间的行为和神经差异，我们 实验室是美国唯一迄今已研究该病的实验室（Bainbridge等，，。 2021a）。在这个独特的人群中，在AIM 3中，我们将确定其基于其基础的神经基质 视觉记忆和视觉的解离，并测试语义与视觉内容在记忆中的作用。 总而言之，这项研究有望解决我们对我们所看到的事物的理解， 通过确定感知和记忆之间在大脑中观察到的这些引人注目的差异的原因。