Attentional Guidance in Real-World Scenes: The Role of Meaning

现实世界场景中的注意力引导：意义的作用

• 批准号: 2019445
• 负责人: John Henderson
• 金额: $ 56.28万
• 依托单位: University of California-Davis
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-07-15 至 2024-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2019445&HistoricalAwards=false
• 关键词: Attentional; Guidance; Real; World; Scenes

Real-world scenes comprise a blooming, buzzing confusion of information. Yet at any given moment, we can only perceive and understand a small portion of that information. What we see and understand is quite literally determined by where we look. But what determines where we look? This project seeks to answer this important question. The project investigates the idea that the meaning of a scene plays the key role in guiding our eyes. If our hypothesis is correct, then we should find that meaning predicts where people look. Such a result will advance scientific knowledge of how our brains and minds work. The results will also be useful to applied areas of computer science and engineering, contributing to increased US economic competitiveness. High-tech applications include virtual and augmented reality, artificial vision and gaze-based input systems, baggage screening, medical image assessment, satellite image analysis, and other computer-based vision systems. The project will also contribute to training of culture- and gender-diverse students and researchers in these high-tech and scientific fields, advancing the development of a diverse, globally competitive workforce. Attentional guidance during scene viewing draws on both the visual properties of the scene and its semantic content. Although the role of visual properties (e.g., physical salience) on attentional guidance has been extensively studied, far less is known about how the semantic content of a scene guides attention. Recent work in my lab indicates that the influence of physical saliency is reduced or even eliminated when semantic content is available to guide attention. These findings have opened up important new questions about how and when meaning guides attention in scenes. The central idea behind the current work is to address these questions with a set of targeted experiments. The proposed experiments will integrate new methods for representing the meaning of local objects and scene regions with high-resolution eyetracking to measure the influence of knowledge on attentional guidance in real-world scenes. The research includes experiments motivated by four goals: (1) To compare the roles of contextualized versus context-free local scene meaning in attentional guidance. (2) To evaluate the causal relationship between local scene meaning and attentional guidance. (3) To test the generality of guidance by scene meaning across tasks and viewing time. (4) To compare the roles of physical versus semantic features in scenes using search target templates. The research will establish the foundation for a new theoretical approach to the representation of scene meaning and attentional guidance in scenes. The ultimate objective is to develop a theory of attentional guidance in scenes based on guidance by meaning.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

现实世界的场景包含了纷繁复杂的信息。然而，在任何给定的时刻，我们只能感知和理解这些信息的一小部分。我们所看到和理解的东西实际上是由我们看的地方决定的。但是是什么决定了我们的视线呢？这个项目试图回答这个重要的问题。该项目调查了一个观点，即场景的意义在引导我们的眼睛方面起着关键作用。如果我们的假设是正确的，那么我们应该会发现，意义可以预测人们看向哪里。这样的结果将推进我们的大脑和思想如何工作的科学知识。研究结果也将对计算机科学和工程的应用领域有用，有助于提高美国的经济竞争力。高科技应用包括虚拟和增强现实、人工视觉和基于注视的输入系统、行李检查、医学图像评估、卫星图像分析和其他基于计算机的视觉系统。该项目还将有助于在这些高科技和科学领域培训不同文化和性别的学生和研究人员，促进发展具有全球竞争力的多元化劳动力队伍。观看场景时的注意力引导既利用了场景的视觉特性，也利用了场景的语义内容。尽管视觉特性（例如，物理显著性）在注意力引导中的作用已被广泛研究，但对场景的语义内容如何引导注意力的了解甚少。我的实验室最近的工作表明，当语义内容可用来引导注意力时，物理显著性的影响会减少甚至消除。这些发现揭示了重要的新问题，即意义如何以及何时引导人们在场景中的注意力。当前工作背后的中心思想是通过一系列有针对性的实验来解决这些问题。本文提出的实验将整合新的方法来表示局部物体和场景区域的意义，并结合高分辨率眼动追踪来测量知识对现实场景中注意力引导的影响。本研究的实验动机主要有四个方面：(1)比较情境化和无情境化的局部场景意义在注意引导中的作用。(2)评价局部场景意义与注意引导之间的因果关系。(3)检验场景意义引导在任务和观看时间上的通用性。(4)利用搜索目标模板比较物理特征和语义特征在场景中的作用。该研究将为场景意义表征和场景注意引导的理论研究奠定基础。最终目的是建立一个基于意义引导的场景注意引导理论。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Look at what I can do: Object affordances guide visual attention while speakers describe potential actions.

• DOI: 10.3758/s13414-022-02467-6
• 发表时间: 2022-07
• 期刊: ATTENTION PERCEPTION & PSYCHOPHYSICS
• 影响因子: 1.7
• 作者: Rehrig, Gwendolyn;Barker, Madison;Peacock, Candace E.;Hayes, Taylor R.;Henderson, John M.;Ferreira, Fernanda
• 通讯作者: Ferreira, Fernanda