Objects predict fixations better than early saliency
Objects predict fixations better than early saliency
复制标题
DOI：
10.1167/8.14.18
复制
发表时间：
2008-01-01
影响因子：
1.8
通讯作者：
Perona, Pietro
中科院分区：
文献类型：
--
作者：
Einhaeuser, Wolfgang;Spain, Merrielle;Perona, Pietro
人类在观看场景和图片时会移动眼睛。眼球运动与注意力转移相关，被认为是视觉识别等高级任务的最佳资源分配的结果。注意力模型，如“显着图”，通常建立在“早期”特征（颜色，对比度，方向，运动等）直接驱动注意力的假设之上。我们探索一个替代假设：观察者参加“有趣”的对象。为了验证这一假设，我们测量了人类观察者在检查常见自然场景照片时的眼睛位置。我们的观察员执行不同的任务：艺术评估，内容分析和搜索。在每次演示之后，我们的观察者被要求说出他们看到的物体的名称。加权召回频率，这些对象预测固定在个别图像比早期显着，无论任务。此外，显着性结合对象位置预测哪些对象经常被命名。这表明，早期的显着性对注意力只有间接的影响，通过识别的对象。因此，而不是把注意力仅仅作为对象识别的预处理步骤，两者的模型需要整合。
Humans move their eyes while looking at scenes and pictures. Eye movements correlate with shifts in attention and are thought to be a consequence of optimal resource allocation for high-level tasks such as visual recognition. Models of attention, such as "saliency maps," are often built on the assumption that "early" features (color, contrast, orientation, motion, and so forth) drive attention directly. We explore an alternative hypothesis: Observers attend to "interesting" objects. To test this hypothesis, we measure the eye position of human observers while they inspect photographs of common natural scenes. Our observers perform different tasks: artistic evaluation, analysis of content, and search. Immediately after each presentation, our observers are asked to name objects they saw. Weighted with recall frequency, these objects predict fixations in individual images better than early saliency, irrespective of task. Also, saliency combined with object positions predicts which objects are frequently named. This suggests that early saliency has only an indirect effect on attention, acting through recognized objects. Consequently, rather than treating attention as mere preprocessing step for object recognition, models of both need to be integrated.