Lipreading: A Review of Its Continuing Importance for Speech Recognition With an Acquired Hearing Loss and Possibilities for Effective Training.
Lipreading: A Review of Its Continuing Importance for Speech Recognition With an Acquired Hearing Loss and Possibilities for Effective Training.
复制标题
DOI：
10.1044/2021_aja-21-00112
复制
发表时间：
2022-06-02
影响因子：
1.8
通讯作者：
中科院分区：
文献类型：
--
作者：
这篇综述文章的目的是重新唤起对唇读和唇读训练的兴趣，为成年人获得性听力损失。大多数成年人受益于能够看到说话者时，语音退化;然而，效果大小与他们的唇读能力有关，这通常是穷人的成年人谁经历了正常的听力通过他们的生活。唇读训练已被视为一种可能的途径，为康复的成年人与后天性听力损失，但大多数的训练方法并没有特别成功。在这里，我们描述唇读和理论动机的方法来训练，以及成功的训练范例的例子。我们讨论了一些扩展到仅语音识别（AO）和视听（AV）语音识别。描述了视觉语音感知和单词识别。概述了传统和当代的培训和感知学习的观点。我们专注于外部和内部反馈的作用和知觉学习的训练任务，我们描述唇读训练实验的结果。唇读通常被描述为仅限于视位感知。然而，有证据表明，视觉语音信息的亚视位知觉。唇读单词也依赖于词汇限制，这与听觉口语单词识别不同。唇读已经被证明很难通过训练来提高，但在特定的反馈和任务条件下，训练可以成功，学习可以推广到未经训练的材料，包括噪音中的AV句子刺激。唇读的结果有影响的AO和AV培训和使用的声学处理的语音在面对面的交流。鉴于唇读对听力损失患者语音识别的重要性，我们建议研究和临床界将唇读纳入其努力中，以改善后天性听力损失成年人的语音识别。
The goal of this review article is to reinvigorate interest in lipreading and lipreading training for adults with acquired hearing loss. Most adults benefit from being able to see the talker when speech is degraded; however, the effect size is related to their lipreading ability, which is typically poor in adults who have experienced normal hearing through most of their lives. Lipreading training has been viewed as a possible avenue for rehabilitation of adults with an acquired hearing loss, but most training approaches have not been particularly successful. Here, we describe lipreading and theoretically motivated approaches to its training, as well as examples of successful training paradigms. We discuss some extensions to auditory-only (AO) and audiovisual (AV) speech recognition. Visual speech perception and word recognition are described. Traditional and contemporary views of training and perceptual learning are outlined. We focus on the roles of external and internal feedback and the training task in perceptual learning, and we describe results of lipreading training experiments. Lipreading is commonly characterized as limited to viseme perception. However, evidence demonstrates subvisemic perception of visual phonetic information. Lipreading words also relies on lexical constraints, not unlike auditory spoken word recognition. Lipreading has been shown to be difficult to improve through training, but under specific feedback and task conditions, training can be successful, and learning can generalize to untrained materials, including AV sentence stimuli in noise. The results on lipreading have implications for AO and AV training and for use of acoustically processed speech in face-to-face communication. Given its importance for speech recognition with a hearing loss, we suggest that the research and clinical communities integrate lipreading in their efforts to improve speech recognition in adults with acquired hearing loss.