The effect of linguistic and visual salience in visual world studies.
The effect of linguistic and visual salience in visual world studies.
复制标题
DOI：
10.3389/fpsyg.2014.00176
复制
发表时间：
2014
影响因子：
3.8
通讯作者：
Poesio M
中科院分区：
文献类型：
--
作者：
Cavicchio F;Melcher D;Poesio M
使用视觉世界范式的研究表明，视觉输入对语言解释任务有快速的影响，如参考分辨率，相反，语言材料，包括动词，介词和形容词，可以影响固定到潜在的指称。最近的研究已经开始探索这种效果的语言输入的注视是如何介导的视觉刺激的属性，特别是视觉显着性。在本研究中，我们进一步探讨了显着性在视觉世界范式中的作用，操纵语言驱动的显着性和视觉显着。具体来说，我们测试了语言显著性（即，语言引入的实体的更大可及性）和视觉显着性（自下而上的吸引注意力的视觉方面）相互作用。我们记录了参与者在MapTask过程中的眼球运动，要求他们在听到指示方向的同时从地图上显示的地标看到地标。这些地标的大小和颜色相当，除了在视觉显著性条件下，其中一个地标在视觉上更加突出。在语言显著性条件下，指示包括对地图上没有的对象的引用。反应时间和固定记录。视觉显著性影响的时间过程中的固定在开始和结束的审判，但没有表现出显着的影响反应时间。当地标与地图上不存在的语言显著性实体相关联时，语言显著性减少了响应时间并增加了对地标的注视。当目标地标是视觉和语言上的显着，它是固定更长的时间，但固定更快时，目标项目是语言上的显着。我们的研究结果表明，这两种类型的显着性平行工作，语言显着性影响固定，即使当实体是不是视觉上存在。
Research using the visual world paradigm has demonstrated that visual input has a rapid effect on language interpretation tasks such as reference resolution and, conversely, that linguistic material—including verbs, prepositions and adjectives—can influence fixations to potential referents. More recent research has started to explore how this effect of linguistic input on fixations is mediated by properties of the visual stimulus, in particular by visual salience. In the present study we further explored the role of salience in the visual world paradigm manipulating language-driven salience and visual salience. Specifically, we tested how linguistic salience (i.e., the greater accessibility of linguistically introduced entities) and visual salience (bottom-up attention grabbing visual aspects) interact. We recorded participants' eye-movements during a MapTask, asking them to look from landmark to landmark displayed upon a map while hearing direction-giving instructions. The landmarks were of comparable size and color, except in the Visual Salience condition, in which one landmark had been made more visually salient. In the Linguistic Salience conditions, the instructions included references to an object not on the map. Response times and fixations were recorded. Visual Salience influenced the time course of fixations at both the beginning and the end of the trial but did not show a significant effect on response times. Linguistic Salience reduced response times and increased fixations to landmarks when they were associated to a Linguistic Salient entity not present itself on the map. When the target landmark was both visually and linguistically salient, it was fixated longer, but fixations were quicker when the target item was linguistically salient only. Our results suggest that the two types of salience work in parallel and that linguistic salience affects fixations even when the entity is not visually present.
登录
查看更多内容
影响因子：
4.3
作者：
Barr, Dale J.
通讯作者：
Barr, Dale J.
影响因子：
3.4
作者：
Altmann, GTM;Kamide, Y
通讯作者：
Kamide, Y
影响因子：
1.8
作者：
ANDERSON, AH;BADER, M;WEINERT, R
通讯作者：
WEINERT, R
DOI：
10.1109/34.730558
发表时间：
1998-11-01
影响因子：
23.6
作者：
Itti, L;Koch, C;Niebur, E
通讯作者：
Niebur, E
影响因子：
64.8
作者：
Gottlieb, JP;Kusunoki, M;Goldberg, ME
通讯作者：
Goldberg, ME