Audiovisual integration of speech falters under high attention demands
Audiovisual integration of speech falters under high attention demands
复制标题
DOI：
10.1016/j.cub.2005.03.046
复制
发表时间：
2005-05-10
期刊：
影响因子：
9.2
通讯作者：
Soto-Faraco, S
中科院分区：
文献类型：
--
作者：
Alsius, A;Navarra, J;Soto-Faraco, S
人类多感官整合最常被引用的例子之一发生在暴露于自然语言的过程中，当信号的声音和视觉方面被整合在一个单一的感知中时。在非人类灵长类动物[1]和语言前儿童[2]中已经证明了面部姿势和声音的视听联系，这为这种能力提供了一般基础。然而，一个关键的问题是注意力在这种多感觉整合中的作用。虽然行为和神经生理学研究都集中在视听语音整合的前注意概念化上[3-8]，但当观察者的注意力资源耗尽时，很少在高注意力负荷条件下测量这种机制[9]。我们通过测量观察者在双任务范式[10]中对经典McGurk错觉[3]的易感性，测试了视听整合受可用注意力资源量调节的程度。如果参与者同时执行不相关的视觉或听觉任务，视觉影响反应的比例严重，并选择性地减少。与跨模态语音整合是自动的假设相反，我们的研究结果表明，这些多感官绑定过程受到注意力的需求。
One of the most commonly cited examples of human multisensory integration occurs during exposure to natural speech, when the vocal and the visual aspects of the signal are integrated in a unitary percept. Audiovisual association of facial gestures and vocal sounds has been demonstrated in nonhuman primates [1] and in prelinguistic children [2], arguing for a general basis for this capacity. One critical question, however, concerns the role of attention in such multisensory integration. Although both behavioral and neurophysiological studies have converged on a preattentive conceptualization of audiovisual speech integration [3-8], this mechanism has rarely been measured under conditions of high attentional load, when the observers' attention resources are depleted [9]. We tested the extent to which audiovisual integration was modulated by the amount of available attentional resources by measuring the observers' susceptibility to the classic McGurk illusion [3] in a dual-task paradigm [10]. The proportion of visually influenced responses was severely, and selectively, reduced if participants were concurrently performing an unrelated visual or auditory task. In contrast with the assumption that crossmodal speech integration is automatic, our results suggest that these multisensory binding processes are subject to attentional demands.