SPEECH INTELLIGIBILITY DERIV ASYNCHRONOUS PROCESSING OF AUDITORY -
SPEECH INTELLIGIBILITY DERIV ASYNCHRONOUS PROCESSING OF AUDITORY -
复制标题
语音清晰度源自听觉异步处理 -
DOI：
--
复制
发表时间：
--
期刊：
影响因子：
--
通讯作者：
S. Greenberg
中科院分区：
文献类型：
--
作者：
K. W. Grant;S. Greenberg
当前的研究检查了与句子材料的听觉-视觉信息的跨模式整合相关的时间参数。语音信号被过滤成1/3倍频程通道，除了低频（298-375 Hz）和高频（4762-6000 Hz）频带外，所有通道都被丢弃。对于 9 名听力正常的受试者来说，这种纯音频信号的清晰度在 9% 到 31% 之间。相同材料的单独视觉呈现的清晰度在 1% 到 22% 之间。当音频和视频信号合并并同步呈现时，清晰度平均可达 63%。当音频信号领先于视频时，即使是最短的 40 毫秒异步，清晰度也会明显下降。视频延迟的进一步增加导致清晰度逐渐下降，达到与 400 毫秒异步的纯音频条件相当的水平。相反，当视频信号领先于音频时，对于长达 160-200 毫秒的开始异步，清晰度保持相对稳定。因此，音频和视觉信息的整合存在明显的不对称性，这对基于感觉的听觉-视觉语音处理模型具有重要意义。
The current study examines the temporal parameters associated with cross-modal integration of auditory-visual information for sentential material. The speech signal was filtered into 1/3-octave channels, all of which were discarded except for a low-frequency (298-375 Hz) and a high-frequency (4762-6000 Hz) band. The intelligibility of this audio-only signal ranged between 9% and 31% for nine normal-hearing subjects. Visual-alone presentation of the same material ranged between 1% and 22% intelligi-bility. When the audio and video signals are combined and presented in synchrony, intelligibility climbs to an average of 63%. When the audio signal leads the video, intelligibil-ity declines appreciably for even the shortest asynchrony of 40 ms. Additional increases in video delay result in a progressive decline in intelligibility, reaching a level comparable to that of the audio-alone condition for an asyn-chrony of 400 ms. In contrast, when the video signal leads the audio, intelligibility remains relatively stable for onset asynchronies up to 160-200 ms. Hence, there is a marked asymmetry in the integration of audio and visual information that has important implications for sensory-based models of auditory-visual speech processing.
影响因子：
2.4
作者：
Grant, KW;Seitz, PF
通讯作者：
Seitz, PF
影响因子：
2.4
作者：
Grant, KW;Seitz, PF
通讯作者：
Seitz, PF