Disruptive effects of auditory signal delay on speech perception with lipreading.

Disruptive effects of auditory signal delay on speech perception with lipreading.
复制标题

听觉信号延迟对唇读语音感知的破坏性影响。

DOI:
--
复制
发表时间:
1986
期刊:
The Journal of auditory research
影响因子:
--
通讯作者:
S. Abel
S. Abel
中科院分区:
--
文献类型:
--
作者:
Pandey Pc;H. Kunov;S. Abel

文献摘要

被引文献

相似文献

以听力正常的被试为被试,研究了听觉信号延迟对被试对录像句子的视听感知的影响。测试材料由一名男子朗读的句子组成,每句话中有或没有代表关键词的图片作为上下文。在实验一中,12名没有唇读经验的学生(6 M,6 F)分别以纯音频(A)、纯视觉(V)和视听(AV)模式呈现测试材料。语音信号以0或-10 dB S/N呈现,相对于固定在60 dbA的多说话者混串音。音频信号从0-300毫秒以6个步骤延迟(重新视觉信号)。实验II用6名熟悉唇读的学生(2 M,4F)重复实验I;语音信号以-5 dB S/N和0-240 msec的4个音频延迟呈现。虽然这些学生在V模式中的表现比实验一中的学生好,但背景和延迟的主要影响是相似的。音频延迟对唇读(AV模式)语音感知的破坏性影响是S/N的函数,在更差的S/N下相对更具破坏性,但对于高达80-120毫秒的延迟并不显著。结果与理论(麦格拉思和萨默菲尔德,J. Acoust. Soc. Am.,1985,77,678-685),对视听区分的敏感性仅在连接言语中的音节水平上是显著的。研究结果进一步表明,中度延迟高达80毫秒介绍的语音处理援助唇读,耳蜗植入患者,将不会干扰提供的听觉信息的优势。
The effect of auditory signal delay on audio-visual perception of videotaped sentence lists by Ss with normal hearing was measured. The test material consisted of sentences read by a man, with or without a picture representing as context one of the key words in each sentence. In Exper. I, 12 Ss (6M, 6F), inexperienced with lipreading, were presented test material in the audio-only (A), visual-only (V) and audio-visual (AV) modes. Speech signals were presented at 0 or -10 db S/N re a multitalker babble fixed at 60 dbA. The audio signal was delayed (re visual signal) in 6 steps from 0-300 msec. Exper. II repeated Exper. I with 6 Ss (2M, 4F) familiar with lipreading; the speech signal was presented at -5 db S/N and 4 audio delays from 0-240 msec. While these Ss performed better in the V mode than those in Exper. I, the main effects of context and delays were similar. The disruptive effect of the audio delay on speech perception with lipreading (AV mode) was a function of S/N, being relatively more disruptive at the worse S/N, but it was not significant for delays up to a range of 80-120 msec. The results are in agreement with the theory (McGrath and Summerfield, J. Acoust. Soc. Am., 1985, 77, 678-685) that sensitivity to audio-visual desynchrony is significant only at a syllabic level in connected speech. The results further imply that moderate delays of up to 80 msec introduced by speech-processing aids for lipreading, as for cochlear-implanted patients, will not interfere with the advantages of providing the auditory information.