Effects of audio-visual bimodal training on the perception of the cochlear implant speech simulated by the noise vocoded speech sound

在听力正常的受试者中，使用高度退化的噪声编码语音，考察了双峰视听刺激听觉训练对单峰语音清晰度的影响。与仅使用听觉刺激的听觉训练相比，视觉线索与听觉刺激同时呈现在训练过程中，不仅显著提高了训练中使用的单词的听觉语音清晰度，而且显著提高了未训练单词的听觉语音清晰度。在视听语音感知过程中，视觉信息通常被认为是对听觉系统传递的语音信息不足的补充。然而，本研究结果揭示了视听训练的另一个有益效果，即视觉线索增强了对退化新语音的听觉适应过程，这与双峰训练不同。

Effects of auditory training with bimodal audio-visual stimuli on mono-modal aural speech intelligibility were examined in subjects with normal hearing using highly degraded noise-vocoded speech sound. Visual cue simultaneously presented with auditory stimuli during the training session significantly improved auditory speech intelligibility not only for words used in the training session but also untrained words, when compared to the auditory training using only auditory stimuli. Visual information is generally considered to complement insufficient speech information conveyed by the auditory system during audio-visual speech perception. However, the present results revealed another beneficial effect of audio-visual training, that the visual cue enhances the auditory adaptation process to the degraded new speech sound which is different from those given in during bimodal training.