Visual speech speeds up the neural processing of auditory speech
Visual speech speeds up the neural processing of auditory speech
复制标题
DOI：
10.1073/pnas.0408949102
复制
发表时间：
2005-01-25
影响因子：
11.1
通讯作者：
Poeppel, D
中科院分区：
文献类型：
--
作者：
van Wassenhove, V;Grant, KW;Poeppel, D
听觉和视觉系统同步呈现刺激可以改变两种模式中的感知的形成。例如，当说话者的面部发音运动可见时，听觉语音的感知得到改善。神经收敛到多感官网站表现出超加性已被提出作为整合的主要机制。然而，最近的研究结果表明，假定的感觉特异性皮层是通过不同的方式呈现的输入作出反应。因此，视听表现形式何时何地出现仍然没有定论。在心理物理和脑电图相结合的实验中，我们表明，视觉语音加速了皮层处理听觉信号的早期（在100毫秒的信号发作）。视觉-听觉的相互作用反映为发音器特异性的时间易化（以及非特异性的幅度降低）。潜伏期促进系统地依赖于视觉信号预测可能的听觉目标的程度。观察到的语音视觉数据支持的观点，存在抽象的内部表示，约束后续的语音输入的分析。这是一个“综合分析”机制存在的证据，在视觉言语知觉。
Synchronous presentation of stimuli to the auditory and visual systems can modify the formation of a percept in either modality. For example, perception of auditory speech is improved when the speaker's facial articulatory movements are visible. Neural convergence onto multisensory sites exhibiting supra-additivity has been proposed as the principal mechanism for integration. Recent findings, however, have suggested that putative sensory-specific cortices are responsive to inputs presented through a different modality. Consequently, when and where audiovisual representations emerge remain unsettled. In combined psychophysical and electroencephalography experiments we show that visual speech speeds up the cortical processing of auditory signals early (within 100 ms of signal onset). The auditory-visual interaction is reflected as an articulator-specific temporal facilitation (as well as a nonspecific amplitude reduction). The latency facilitation systematically depends on the degree to which the visual signal predicts possible auditory targets. The observed auditory-visual data support the view that there exist abstract internal representations that constrain the analysis of subsequent speech inputs. This is evidence for the existence of an "analysis-by-synthesis" mechanism in auditory-visual speech perception.