Two Sides of the Same Coin: Speech and Gesture Mutually Interact to Enhance Comprehension
Two Sides of the Same Coin: Speech and Gesture Mutually Interact to Enhance Comprehension
复制标题
DOI：
10.1177/0956797609357327
复制
发表时间：
2010-02-01
影响因子：
8.2
通讯作者：
Maris, Eric
中科院分区：
文献类型：
--
作者：
Kelly, Spencer D.;Ozyurek, Asli;Maris, Eric
手势和言语在语言产生过程中是一个完整的系统。基于这一观点，我们提出了整合系统假说，它解释了手势和言语在语言理解中的两种整合方式--通过相互的和强制性的互动。实验1为参与者提供了行动启动（例如。例如，在一个实施例中，有人切菜）和双峰语音和手势目标。当目标包含一致的信息时（语音：“砍”;手势：砍），参与者比当目标包含不一致的信息时（语音：“砍”;手势：扭）更快更准确地将启动与目标联系起来。此外，强度的不一致影响处理，与较弱的不一致（语音：“印章”;手势：削减）比强烈的不一致（语音：“印章”;手势：扭曲）的错误较少。对于整合系统假说来说，这种影响是双向的。实验二证明手势对言语的影响是强制性的。结果证实了整合系统假说，并证明手势和言语形成了语言理解的整合系统。
Gesture and speech are assumed to form an integrated system during language production. Based on this view, we propose the integrated-systems hypothesis, which explains two ways in which gesture and speech are integrated-through mutual and obligatory interactions-in language comprehension. Experiment 1 presented participants with action primes (e. g., someone chopping vegetables) and bimodal speech and gesture targets. Participants related primes to targets more quickly and accurately when they contained congruent information (speech: "chop"; gesture: chop) than when they contained incongruent information (speech: "chop"; gesture: twist). Moreover, the strength of the incongruence affected processing, with fewer errors for weak incongruities (speech: "chop"; gesture: cut) than for strong incongruities (speech: "chop"; gesture: twist). Crucial for the integrated-systems hypothesis, this influence was bidirectional. Experiment 2 demonstrated that gesture's influence on speech was obligatory. The results confirm the integrated-systems hypothesis and demonstrate that gesture and speech form an integrated system in language comprehension.