Face configuration affects speech perception: Evidence from a McGurk mismatch negativity study
Face configuration affects speech perception: Evidence from a McGurk mismatch negativity study
复制标题
DOI：
10.1016/j.neuropsychologia.2014.10.021
复制
发表时间：
2015-01-01
期刊：
影响因子：
2.6
通讯作者：
Andersen, Tobias S.
中科院分区：
文献类型：
--
作者：
Eskelund, Kasper;MacDonald, Ewen N.;Andersen, Tobias S.
我们从面孔中感知身份、表情和言语。虽然对身份和表情的感知主要取决于面部特征的结构，但这是否适用于视觉言语感知还不太清楚。面部结构对颠倒的面孔感知较差，如撒切尔错觉所示，在这种错觉中，眼睛和嘴相对于面部的方向是颠倒的（撒切尔化）。这使面部呈现出一种怪诞的外观，但这只有在面部直立时才能看到。撒切尔化同样会破坏视觉言语感知，但只有在面部直立时，这表明面部结构对视觉言语感知很重要。这种效应可以通过视听整合传播到听觉言语感知，因此撒切尔化破坏了麦格克错觉，在麦格克错觉中，视觉言语感知改变了对不一致声学音素的感知。这被称为McThatcher效应。在这里，我们表明McThatcher效应反映在McGurk失配负性（MMN）中。MMN是由听觉感知的变化引起的事件相关电位。McGurk-MMN可以通过McGurk错觉引起的听觉感知的变化而引起，而不需要任何声学刺激的变化。我们发现，撒切尔化破坏了一个强大的McGurk错觉和相应的强大的McGurk-MMN只对直立的面孔。这证实了面部结构对于视听语音感知是重要的。对于倒置的脸，我们发现了一个较弱的麦格克错觉，但令人惊讶的是，没有MMN。我们还发现麦格克错觉的强度和麦格克-MMN的振幅之间没有相关性。我们认为，这可能是由于一个阈值效应，使一个强大的麦格克错觉，需要引起麦格克MMN。(C)2014作者爱思唯尔有限公司出版
We perceive identity, expression and speech from faces. While perception of identity and expression depends crucially on the configuration of facial features it is less clear whether this holds for visual speech perception.Facial configuration is poorly perceived for upside-down faces as demonstrated by the Thatcher illusion in which the orientation of the eyes and mouth with respect to the face is inverted (Thatcherization). This gives the face a grotesque appearance but this is only seen when the face is upright.Thatcherization can likewise disrupt visual speech perception but only when the face is upright indicating that facial configuration can be important for visual speech perception. This effect can propagate to auditory speech perception through audiovisual integration so that Thatcherization disrupts the McGurk illusion in which visual speech perception alters perception of an incongruent acoustic phoneme. This is known as the McThatcher effect.Here we show that the McThatcher effect is reflected in the McGurk mismatch negativity (MMN). The MMN is an event-related potential elicited by a change in auditory perception. The McGurk-MMN can be elicited by a change in auditory perception due to the McGurk illusion without any change in the acoustic stimulus.We found that Thatcherization disrupted a strong McGurk illusion and a correspondingly strong McGurk-MMN only for upright faces. This confirms that facial configuration can be important for audiovisual speech perception. For inverted faces we found a weaker McGurk illusion but, surprisingly, no MMN. We also found no correlation between the strength of the McGurk illusion and the amplitude of the McGurk-MMN. We suggest that this may be due to a threshold effect so that a strong McGurk illusion is required to elicit the McGurk-MMN. (C) 2014 The Authors. Published by Elsevier Ltd.