Binding and unbinding the auditory and visual streams in the McGurk effect
Binding and unbinding the auditory and visual streams in the McGurk effect
复制标题
DOI：
10.1121/1.4728187
复制
发表时间：
2012-08-01
影响因子：
2.4
通讯作者：
Schwartz, Jean-Luc
中科院分区：
文献类型：
--
作者：
Nahorna, Olha;Berthommier, Frederic;Schwartz, Jean-Luc
受试者被呈现连贯的听觉和视觉流，通常会将它们融合成一个单一的感知。这导致噪音的可理解性增强，或者麦格克效应中听觉感知的视觉修饰。传统观点认为，听觉和视觉系统的加工是独立完成的，然后在某个表征阶段发生相互作用，从而形成一个完整的感知。然而，一些行为和神经生理学数据表明存在一个两阶段的过程。第一阶段将涉及在第二阶段融合之前将适当的音频和视频信息片段绑定在一起。然后就有可能设计出导致解绑定的实验。这里显示，如果给定的麦格克刺激之前有一个不连贯的视听环境，麦格克效应的量就会大大减少。各种不连贯的上下文（视频句子上的声学音节或常规音视频音节序列的声学内容的语音或时间修改）即使很短（少于4秒）也会显著降低麦格克效应。这些数据在视听语音感知的两阶段“绑定和融合”模型框架中进行解释。(C) 2012美国声学学会。[http://dx.doi.org/10.1121/1.4728187]
Subjects presented with coherent auditory and visual streams generally fuse them into a single percept. This results in enhanced intelligibility in noise, or in visual modification of the auditory percept in the McGurk effect. It is classically considered that processing is done independently in the auditory and visual systems before interaction occurs at a certain representational stage, resulting in an integrated percept. However, some behavioral and neurophysiological data suggest the existence of a two-stage process. A first stage would involve binding together the appropriate pieces of audio and video information before fusion per se in a second stage. Then it should be possible to design experiments leading to unbinding. It is shown here that if a given McGurk stimulus is preceded by an incoherent audiovisual context, the amount of McGurk effect is largely reduced. Various kinds of incoherent contexts (acoustic syllables dubbed on video sentences or phonetic or temporal modifications of the acoustic content of a regular sequence of audiovisual syllables) can significantly reduce the McGurk effect even when they are short (less than 4 s). The data are interpreted in the framework of a two-stage "binding and fusion" model for audiovisual speech perception. (C) 2012 Acoustical Society of America. [http://dx.doi.org/10.1121/1.4728187]