Semantic guidance of eye movements in real-world scenes
Semantic guidance of eye movements in real-world scenes
复制标题
DOI：
10.1016/j.visres.2011.03.010
复制
发表时间：
2011-05-25
期刊：
影响因子：
1.8
通讯作者：
Pomplun, Marc
中科院分区：
文献类型：
--
作者：
Hwang, Alex D.;Wang, Hsueh-Cheng;Pomplun, Marc
物体在视觉世界中的感知不仅受其形状、颜色等低层视觉特征的影响，而且还受其高层特征如意义和语义关系的影响。虽然已有研究表明，现实世界场景中的低层特征在场景检查和搜索过程中指导眼动，但在这种情况下，场景对象之间的语义相似性对眼动的影响尚未被研究。本文研究了在真实场景检测和搜索过程中，通过物体间的语义相似度来指导眼动的方法。通过从LabelMe对象标注图像数据库中选择场景，并对对象标签进行潜在语义分析(LSA)，基于场景对象与当前注视对象或搜索目标的语义相似度生成真实世界场景的语义显著图。对这些图的ROC分析表明，在场景检查过程中，受试者在对象之间的凝视转换是预测的，这表明他们倾向于转换到语义上与当前检查对象相似的对象。此外，在场景搜索的过程中，受试者的眼球运动被逐渐引导到语义上与搜索目标相似的对象。这些发现证明了真实世界场景中眼动的大量语义指导，并表明了它对理解真实世界注意控制的重要性。(C)2011爱思唯尔有限公司。保留所有权利。
The perception of objects in our visual world is influenced by not only their low-level visual features such as shape and color, but also their high-level features such as meaning and semantic relations among them. While it has been shown that low-level features in real-world scenes guide eye movements during scene inspection and search, the influence of semantic similarity among scene objects on eye movements in such situations has not been investigated. Here we study guidance of eye movements by semantic similarity among objects during real-world scene inspection and search. By selecting scenes from the LabelMe object-annotated image database and applying latent semantic analysis (LSA) to the object labels, we generated semantic saliency maps of real-world scenes based on the semantic similarity of scene objects to the currently fixated object or the search target. An ROC analysis of these maps as predictors of subjects' gaze transitions between objects during scene inspection revealed a preference for transitions to objects that were semantically similar to the currently inspected one. Furthermore, during the course of a scene search, subjects' eye movements were progressively guided toward objects that were semantically similar to the search target. These findings demonstrate substantial semantic guidance of eye movements in real-world scenes and show its importance for understanding real-world attentional control. (C) 2011 Elsevier Ltd. All rights reserved.