Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading

Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading
复制标题

DOI:
10.1038/381066a0
复制
发表时间:
1996-05-02
期刊:
影响因子:
64.8
通讯作者:
Driver, J
Driver, J
中科院分区:
综合性期刊1区
文献类型:
--
作者:
Driver, J

文献摘要

被引文献

相似文献

人类的注意力机制允许我们在大量刺激中选择性地处理相关事件(1)。大多数实验室研究只在一种感觉中检查注意力,但在现实世界中,许多重要事件都是多模态的,比如口头交流。语言包括视觉嘴唇运动和声音,唇读有助于语言感知。即使对于听力良好的听众,也要通过视听整合的过程(2)。这样的例子提出了一个问题,即我们如何协调我们的空间注意力,从一个共同的来源中选择视觉和声音进行进一步的处理。在这里,我们表明在注意力选择完成之前允许一些跨模态匹配可以缓解这个问题。交叉模态匹配可能导致一种错觉,即声音在其明显的视觉来源处定位错误(3);这种跨通道错觉可以增强对语音的选择性空间注意。
MECHANISMS of human attention allow selective processing of just the relevant events among the many stimuli bombarding our senses(1). Most laboratory studies examine attention within just a single sense, but in the real world many important events are specified multimodally, as in verbal communication. Speech comprises visual lip movements as well as sounds, and lip-reading contributes to speech perception. even for listeners with good hearing, by a process of audiovisual integration(2). Such examples raise the problem of how we coordinate our spatial attention across the sensory modalities, to select sights and sounds from a common source for further processing. Here we show that this problem is alleviated by allowing some cross-modal matching before attentional selection is completed. Cross modal matching can lead to an illusion, whereby sounds are mislocated at their apparent visual source(3); this crossmodal illusion can enhance selective spatial attention to speech sounds.