Word meaning and the control of eye fixation: semantic competitor effects and the visual world paradigm
Word meaning and the control of eye fixation: semantic competitor effects and the visual world paradigm
复制标题
DOI：
10.1016/j.cognition.2004.10.003
复制
发表时间：
2005-05-01
期刊：
影响因子：
3.4
通讯作者：
Altmann, GTM
中科院分区：
文献类型：
--
作者：
Huettig, F;Altmann, GTM
当参与者同时被呈现口头语言和描述该语言所指对象的视觉显示时，参与者自发地注视所听到的单词的视觉指示物[库珀，R。M.（1974年）。通过口语的意义控制眼睛注视：一种实时调查语音感知，记忆和语言处理的新方法。Cognitive Psychology，6（1），84-107; Tanenhaus，M. K.，Spivey-Knowlton，M. J.，Eberhard，K. M.，& Sedivy，J. C.（1995年）。视觉与语言信息在口语理解中的整合。Science，268（5217），1632-1634].我们在这里证明，这种自发的固定可以驱动部分语义重叠之间的一个词和一个视觉对象。当（a）钢琴被描绘在不相关的干扰物中时，参与者听到了“钢琴”这个词;（B）小号被描绘在这些相同的干扰物中;（c）钢琴和小号都被描绘了。随着“钢琴”这个词的展开，在前两种情况下固定钢琴和小号的可能性上升。在最后一种情况下，只有对钢琴的注视上升，尽管小号比干扰物更容易被注视。我们的结论是，眼动是由匹配程度驱动的，沿着超越简单视觉形式的各个维度，在一个词和并发视野中的对象的心理表征之间。(c)2004 Elsevier B. V.保留所有权利。
When participants are presented simultaneously with spoken language and a visual display depicting objects to which that language refers, participants spontaneously fixate the visual referents of the words being heard [Cooper, R. M. (1974). The control of eye fixation by the meaning of spoken language: A new methodology for the real-time investigation of speech perception, memory, and language processing. Cognitive Psychology, 6(1), 84-107; Tanenhaus, M. K., Spivey-Knowlton, M. J., Eberhard, K. M., & Sedivy, J. C. (1995). Integration of visual and linguistic information in spoken language comprehension. Science, 268(5217), 1632-1634]. We demonstrate here that such spontaneous fixation can be driven by partial semantic overlap between a word and a visual object. Participants heard the word `piano' when (a) a piano was depicted amongst unrelated distractors; (b) a trumpet was depicted amongst those same distractors; and (c), both the piano and trumpet were depicted. The probability of fixating the piano and the trumpet in the first two conditions rose as the word `piano' unfolded. In the final condition, only fixations to the piano rose, although the trumpet was fixated more than the distractors. We conclude that eye movements are driven by the degree of match, along various dimensions that go beyond simple visual form, between a word and the mental representations of objects in the concurrent visual field. (c) 2004 Elsevier B.V. All rights reserved.