Does audiovisual speech perception use information about facial configuration?
Does audiovisual speech perception use information about facial configuration?
复制标题
DOI：
10.1080/09541440042000025
复制
发表时间：
2001-07-01
期刊：
影响因子：
--
通讯作者：
Surakka, V
中科院分区：
文献类型：
--
作者：
Hietanen, JK;Manninen, P;Surakka, V
麦格克错觉有效地证明了言语感知的视听本质。当一个听觉音节被配音到一个不协调的视觉音节上时，所产生的感受通常不是这两个成分中的任何一个，而是它们的组合或融合。本实验研究了当操纵视听刺激的面部结构时McGurk效应的持续性。两个一致和两个不一致的视听音节是从口语/ipi/和/伊基/中产生的。这些视听令牌由五个说话者的七个面部配置发出。所有的面部结构都产生了明显的麦格克效应（报告/iti/听到！ipi/ + seen /伊基/），但当由不对称的杂乱面部配置发出时，效果显著较小。结果还显示，不同谈话者之间麦格克效应的持续性存在显着差异。总之，面部特征信息可以用于某些语音片段的视听整合。这些信息不是整合发生所必需的，但是整合过程可以被违反正常视觉信息的面部刺激所破坏。
The McGurk illusion effectively demonstrates the audiovisual nature of speech perception. When an auditory syllable is dubbed onto an incongruous visual syllable the resulting percept is usually not either of the components, but their combination or fusion. The present experiment investigated the persistence of the McGurk effect when the facial configuration context of the audiovisual stimuli was manipulated. Two congruent and two incongruent audiovisual syllables were created from spoken /ipi/ and /iki/. These audiovisual tokens were uttered by seven facial configurations of five talkers. All facial configurations produced a clear McGurk effect (reported /iti/ for heard !ipi/ + seen /iki/), but the effect was significantly less when uttered by an asymmetrically scrambled face configuration. The results also showed significant differences in the persistence of the McGurk effect between different talkers. In sum, facial configural information can be used in the audiovisual integration of certain speech segments. This information is not necessary for the integration to occur, but the integration process can be disrupted by face stimuli violating the normal configural information.