Real and predicted influence of image manipulations on eye movements during scene recognition
Real and predicted influence of image manipulations on eye movements during scene recognition
复制标题
DOI：
10.1167/10.2.8
复制
发表时间：
2010-01-01
影响因子：
1.8
通讯作者：
Bloj, Marina
中科院分区：
文献类型：
--
作者：
Harding, Glen;Bloj, Marina
在本文中，我们研究了图像属性和方向的控制变化如何影响眼球运动，以重复观看自然场景的图像。我们通过操纵低级图像内容（如亮度或色度）和/或反转图像来更改图像。我们测量了这些操作对人类扫描路径（注视的空间和时间路径）的影响，并将这些影响与广泛使用的显著性模型预测的结果进行了比较（L. Itti & C. Koch, 2000）。首先，我们发现对自然图像的重复观察不会显著改变先前已知的扫描路径的可重复性（S. a . Brandt & L. W. Stark, 1997； D. Noton & L. Stark, 1971）。其次，我们发现操纵图像特征并不一定改变扫描路径的可重复性，但亮度信息的去除具有可测量的效果。我们还发现，图像反转似乎会影响场景感知和识别，并可能改变注视选择（尽管我们只发现对扫描路径的影响与额外的亮度信息的去除）。此外，我们确认，由L. Itti和C. Koch（2000）模型定义的视觉显着性是真实观察者扫描路径的糟糕预测器，并且不能预测我们的图像处理对扫描路径的小影响。关键词：扫描路径，眼动追踪，自然场景，视觉显著性，视觉注意，图像反转，色调映射
In this paper, we investigate how controlled changes to image properties and orientation affect eye movements for repeated viewings of images of natural scenes. We make changes to images by manipulating low-level image content (such as luminance or chromaticity) and/or inverting the image. We measure the effects of these manipulations on human scanpaths (the spatial and chronological path of fixations), additionally comparing these effects to those predicted by a widely used saliency model (L. Itti & C. Koch, 2000). Firstly we find that repeated viewing of a natural image does not significantly modify the previously known repeatability (S. A. Brandt & L. W. Stark, 1997; D. Noton & L. Stark, 1971) of scanpaths. Secondly we find that manipulating image features does not necessarily change the repeatability of scanpaths, but the removal of luminance information has a measurable effect. We also find that image inversion appears to affect scene perception and recognition and may alter fixation selection (although we only find an effect on scanpaths with the additional removal of luminance information). Additionally we confirm that visual saliency as defined by L. Itti and C. Koch's (2000) model is a poor predictor of real observer scanpaths and does not predict the small effects of our image manipulations on scanpaths. Keywords: scanpaths, eye tracking, natural scenes, visual saliency, visual attention, image inversion, tone mapping