Prediction and constraint in audiovisual speech perception.
Prediction and constraint in audiovisual speech perception.
复制标题
DOI：
10.1016/j.cortex.2015.03.006
复制
发表时间：
2015-07
期刊：
影响因子：
3.6
通讯作者：
Sommers, Mitchell S.
中科院分区：
文献类型：
--
作者：
Peelle, Jonathan E.;Sommers, Mitchell S.
在面对面的对话演讲中，听者必须有效地处理快速而复杂的多感官信息流。视觉语音可以作为听觉信息的重要补充，因为它提供了输入声音信号的定时(幅度包络，影响注意力和知觉敏感度)及其内容(发音的位置和方式，限制词汇选择)的线索。在这里，我们回顾了有关听者使用视觉语音信息的行为和神经生理学证据。视听语音线索的多感官整合提高了识别的准确性，尤其是对噪声中的语音。即使仅根据听觉信息就可以理解语音，添加视觉信息也可能通过提高预测的精确度来减少对听者的认知需求。电生理学研究表明，当存在视觉语音时，听觉皮质对语音的振荡皮层夹带作用增强，增加了对重要声学线索的敏感性。神经成像研究还表明，当获得一致的视觉信息时，听觉皮质的活动增加，但另外强调，后上颞沟的异交感区域在整合加工中发挥作用。我们在时间聚焦词汇竞争的框架下解释了这些发现，在这个框架中，视觉语音信息影响听觉加工，通过早期整合机制提高对听觉信息的敏感度，而后期整合阶段结合说话人发音器的特定信息，以限制口语中可能的候选者的数量。归根结底，在日常听力中，与听觉和视觉信息兼容的词汇最大程度上决定了成功的言语感知。因此，在不同的神经解剖学机制的支持下，视听言语知觉是通过多个阶段的整合来完成的。
During face-to-face conversational speech listeners must efficiently process a rapid and complex stream of multisensory information. Visual speech can serve as a critical complement to auditory information because it provides cues to both the timing of the incoming acoustic signal (the amplitude envelope, influencing attention and perceptual sensitivity) and its content (place and manner of articulation, constraining lexical selection). Here we review behavioral and neurophysiological evidence regarding listeners' use of visual speech information. Multisensory integration of audiovisual speech cues improves recognition accuracy, particularly for speech in noise. Even when speech is intelligible based solely on auditory information, adding visual information may reduce the cognitive demands placed on listeners through increasing precision of prediction. Electrophysiological studies demonstrate oscillatory cortical entrainment to speech in auditory cortex is enhanced when visual speech is present, increasing sensitivity to important acoustic cues. Neuroimaging studies also suggest increased activity in auditory cortex when congruent visual information is available, but additionally emphasize the involvement of heteromodal regions of posterior superior temporal sulcus as playing a role in integrative processing. We interpret these findings in a framework of temporally-focused lexical competition in which visual speech information affects auditory processing to increase sensitivity to auditory information through an early integration mechanism, and a late integration stage that incorporates specific information about a speaker's articulators to constrain the number of possible candidates in a spoken utterance. Ultimately it is words compatible with both auditory and visual information that most strongly determine successful speech perception during everyday listening. Thus, audiovisual speech perception is accomplished through multiple stages of integration, supported by distinct neuroanatomical mechanisms.
登录
查看更多内容
DOI：
10.1080/14640749108400991
发表时间：
1991-08-01
期刊：
QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY SECTION A-HUMAN EXPERIMENTAL PSYCHOLOGY
影响因子：
--
作者：
BRAIDA, LD
通讯作者：
BRAIDA, LD
影响因子：
25
作者：
通讯作者：
--
影响因子：
3.8
作者：
Ghitza O
通讯作者：
Ghitza O
影响因子：
56.9
作者：
Calvert, GA;Bullmore, ET;David, AS
通讯作者：
David, AS
影响因子：
9.2
作者：
Calvert, GA;Campbell, R;Brammer, MJ
通讯作者：
Brammer, MJ