Event processing in the visual world: Projected motion paths during spoken sentence comprehension.
Event processing in the visual world: Projected motion paths during spoken sentence comprehension.
复制标题
DOI：
10.1037/xlm0000199
复制
发表时间：
2016-05
期刊：
影响因子：
--
通讯作者：
Kukona A
中科院分区：
文献类型：
--
作者：
Kamide Y;Lindsay S;Scheepers C;Kukona A
语言中的运动事件描述了实体沿着路径移动到另一个位置的过程。在两个眼球跟踪实验中，我们发现对运动事件的理解涉及到在线构建一个将语言与视觉世界整合在一起的空间心理模型。在实验1中，参与者听描述主体向目标移动的句子，同时观看描述主体、目标和其间空白的视觉场景。关键是，动词表示向上(例如，跳跃)或向下(例如，爬行)路径。我们发现，在罕见的注视代理和目标之间的空白空间的事件中，视觉注意力与动词一致地向上或向下偏向。在实验2中，视觉场景描绘了一个中央障碍，这对路径施加了进一步的限制，并增加了注视代理人和目标之间空白空间的可能性。这项实验的结果证实并完善了先前的发现。具体地说，眼动效应在听到动词后立即开始，并与另一项鼠标跟踪任务的数据一致，该任务鼓励对运动事件进行更明确的空间再现。在揭示事件理解是如何在视觉世界中运作的过程中，这些发现提出了一种心理模拟过程，通过视觉注意将运动事件的空间细节映射到世界上。在公开的眼动中，这种效果的强度和可察觉能力受到视觉世界和感知者很少注视空白区域的事实的限制。
Motion events in language describe the movement of an entity to another location along a path. In 2 eye-tracking experiments, we found that comprehension of motion events involves the online construction of a spatial mental model that integrates language with the visual world. In Experiment 1, participants listened to sentences describing the movement of an agent to a goal while viewing visual scenes depicting the agent, goal, and empty space in between. Crucially, verbs suggested either upward (e.g., jump) or downward (e.g., crawl) paths. We found that in the rare event of fixating the empty space between the agent and goal, visual attention was biased upward or downward in line with the verb. In Experiment 2, visual scenes depicted a central obstruction, which imposed further constraints on the paths and increased the likelihood of fixating the empty space between the agent and goal. The results from this experiment corroborated and refined the previous findings. Specifically, eye-movement effects started immediately after hearing the verb and were in line with data from an additional mouse-tracking task that encouraged a more explicit spatial reenactment of the motion event. In revealing how event comprehension operates in the visual world, these findings suggest a mental simulation process whereby spatial details of motion events are mapped onto the world through visual attention. The strength and detectability of such effects in overt eye-movements is constrained by the visual world and the fact that perceivers rarely fixate regions of empty space.