Transsaccadic Memory and Scene Representation

扫视记忆和场景表征

• 批准号: 0094433
• 负责人: John Henderson
• 金额: $ 33.35万
• 依托单位: Michigan State University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2001
• 资助国家: 美国
• 起止时间: 2001-08-01 至 2005-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0094433&HistoricalAwards=false
• 关键词: Transsaccadic; Memory; Scene; Representation

We experience the visual world subjectively as a full-color panorama of visual detail. This experience naturally leads to the belief that the human visual system generates a complete and truthful internal copy of the outside scene, similar to a detailed color photograph. Consistent with this intuition, past research has demonstrated that human visual memory for scenes can be exceptionally good. At the same time, it is well known that visual detail and rich color are only available where the eyes are directly pointed. To compensate for this constraint, our eyes flit from place to place over a scene in a series of very fast eye movements called saccades. Interspersed among these saccades are brief pauses, called fixations, and it is only during these fixational pauses that visual information is actually acquired from the scene. Therefore, if our visual system does in fact create a complete internal representation of the external world, as experience suggests, then this representation must be stitched together from the individual snapshots taken during each fixation. In contrast to this intuitively appealing view, there is a good deal of recent evidence that the human visual system does not construct such a high-fidelity copy of the world. For example, a remarkable recent discovery is that human viewers are often very insensitive to dramatic changes in the visual world that take place from one moment to the next. This finding suggests that despite experience and intuition, a photographic image of the entire scene is not concurrently available for comparison to the current state of the world. What, then, is the nature of the internal representation that is generated and retained over time by the human visual system?The main objective of this research is to understand the visual representations that arise as the human viewer examines the world dynamically over extended time. The research will be directed toward discovering the principles that underlie human visual perception, visual cognition, and visual memory. The research will use sophisticated methods that combine fast and powerful graphics manipulation and presentation systems with a highly accurate eyetracking system. Using these instruments, complex scenes will be changed in real time contingent on a specific eye movement within the scene, and the sensitivity of the visual system to such changes will be measured under a variety of conditions. The results of this work will expand our understanding of how the human brain gives rise to perceptual experience and visually guided performance and will help guide the design of new human-computer interfaces. The results will also help guide scientists in building the next generation of artificial vision systems.

我们主观上体验到的视觉世界是视觉细节的全彩全景。这种经历自然会让人相信，人类的视觉系统会对外部场景产生完整而真实的内部复制，类似于一张详细的彩色照片。与这种直觉一致的是，过去的研究表明，人类对场景的视觉记忆可能非常好。同时，众所周知，视觉细节和丰富的色彩只有在眼睛直视的地方才能看到。为了弥补这种限制，我们的眼睛在一个场景中以一系列非常快速的眼球运动（称为扫视）从一个地方飞到另一个地方。在这些扫视中穿插着短暂的停顿，称为注视，只有在这些注视的停顿中，视觉信息才真正从场景中获得。因此，如果我们的视觉系统确实像经验所暗示的那样，创造了外部世界的完整的内部表征，那么这种表征必须由每次注视时拍摄的单个快照拼接在一起。与这种直觉上吸引人的观点相反，最近有大量证据表明，人类的视觉系统并没有构建这样一个高保真的世界副本。例如，最近一项引人注目的发现是，人类观众通常对视觉世界从一个时刻到下一个时刻发生的戏剧性变化非常不敏感。这一发现表明，尽管有经验和直觉，但整个场景的照片图像并不能同时用于与世界现状进行比较。那么，随着时间的推移，人类视觉系统产生并保留的内部表征的本质是什么呢？本研究的主要目的是了解人类观众在长时间内动态观察世界时所产生的视觉表现。这项研究将致力于发现人类视觉感知、视觉认知和视觉记忆的基本原理。这项研究将使用复杂的方法，将快速而强大的图形处理和演示系统与高度精确的眼球追踪系统相结合。使用这些仪器，复杂的场景将根据场景中特定的眼球运动实时改变，并且在各种条件下测量视觉系统对这种变化的敏感性。这项工作的结果将扩大我们对人类大脑如何产生感知体验和视觉引导表现的理解，并将有助于指导新的人机界面的设计。研究结果还将有助于指导科学家构建下一代人工视觉系统。