ENHANCED COMMUNICATIONS FOR SPEECHREADERS

这项研究旨在改善老年人的语音接收能力 严重听障，依靠朗读进行交流。 提高基本理解的尝试包括阅读演讲稿和 视听补充剂对视听言语的影响 接待处。为演讲稿阅读器开发补充品的尝试包括 从声学语音中提取有效线索并将其显示给 有严重听力障碍的个人。 建立视听融合焦点的数学模型的尝试 浅谈低井辅助信号的定量化 演讲片段接收中的演讲朗读，超段 特点，和句子。将模型预测与测量结果进行比较 针对各种收听者和呈现条件的语音接收， 包括听觉和视觉接收的退化，以测量 视听一体化的效率。 尝试开发信号处理技术以派生语音阅读 声学语音的补充将涉及简化的信号 这可以很容易地与残余听力相匹配。信号必须是 准确地源自因干扰和混响而退化的语音。 试图确定限制此类措施有效性的因素 信号将为现实的前景评估提供基础 简化的信号作为语音阅读的补充。 尝试将自动语音识别应用于开发 演讲稿阅读补充内容涉及对手动提示语音的研究， 确定现代语音识别算法的程度 可以自动生成语音阅读提示，并学习视觉显示 用于根据Automatic的输出提供演讲阅读补充资料 向受损的听众提供识别系统。

This research is directed toward improving speech reception for the severely hearing impaired who rely on speechreading for communication. Attempts to advance basic understanding involve study of speechreading and the effects of auditory and visual supplements on audiovisual speech reception. Attempts to develop supplements for speechreaders involve extracting effective cues from acoustic speech and displaying them to individuals with severe hearing impairments. Attempts to develop mathematical models of audiovisual integration focus on quantifying low well supplementary signals are integrated with speechreading in the reception of speech segments, suprasegmental characteristics, and sentences. Model predictions are compared to measured speech reception for a variety of listeners and presentation conditions, including degraded auditory and visual reception, to measure the efficiency of audiovisual integration. Attempts to develop signal processing techniques to derive speechreading supplements from acoustic speech will be concerned with simplified signals that can be readily matched to residual hearing. The signals must be accurately derived from speech degraded by interference and reverberation. Attempts to determine the factors that limit the effectiveness of such signals will provide foundation for realistic evaluations of promising simplified signals as speechreading supplements. Attempts to apply automatic speech recognition to the development of speechreading supplements involve the study of Manual Cued Speech, determination of the extent to which modern speech recognition algorithms can produce speechreading cues automatically, and study of visual displays for presenting speechreading supplements based on the output of automatic recognition systems to impaired listeners.