ENHANCED COMMUNICATIONS FOR SPEECHREADERS

增强语音朗读者的沟通能力

• 批准号: 2127121
• 负责人: LOUIS D BRAIDA
• 金额: $ 25.39万
• 依托单位: MASSACHUSETTS INSTITUTE OF TECHNOLOGY
• 依托单位国家: 美国
• 财政年份: 1994
• 资助国家: 美国
• 起止时间: 1994-07-01 至 1998-06-30
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/2127121
• 关键词: auditory stimulus; cues; deafness; hearing; hearing aids; human subject; mathematical model; psychoacoustics; psychomotor reaction time; sensorineural hearing loss; speech viewer; speechreading; stimulus /response; visual perception; visual stimulus

This research is directed toward improving speech reception for the severely hearing impaired who rely on speechreading for communication. Attempts to advance basic understanding involve study of speechreading and the effects of auditory and visual supplements on audiovisual speech reception. Attempts to develop supplements for speechreaders involve extracting effective cues from acoustic speech and displaying them to individuals with severe hearing impairments. Attempts to develop mathematical models of audiovisual integration focus on quantifying low well supplementary signals are integrated with speechreading in the reception of speech segments, suprasegmental characteristics, and sentences. Model predictions are compared to measured speech reception for a variety of listeners and presentation conditions, including degraded auditory and visual reception, to measure the efficiency of audiovisual integration. Attempts to develop signal processing techniques to derive speechreading supplements from acoustic speech will be concerned with simplified signals that can be readily matched to residual hearing. The signals must be accurately derived from speech degraded by interference and reverberation. Attempts to determine the factors that limit the effectiveness of such signals will provide foundation for realistic evaluations of promising simplified signals as speechreading supplements. Attempts to apply automatic speech recognition to the development of speechreading supplements involve the study of Manual Cued Speech, determination of the extent to which modern speech recognition algorithms can produce speechreading cues automatically, and study of visual displays for presenting speechreading supplements based on the output of automatic recognition systems to impaired listeners.

这项研究旨在改善语音接收能力 依赖语音朗读进行交流的严重听力障碍者。 增进基本理解的尝试涉及演讲阅读和 听觉和视觉补充对视听言语的影响 接待。为演讲朗读器开发补充品的尝试涉及 从声学语音中提取有效线索并将其显示给 患有严重听力障碍的人。 尝试开发视听集成数学模型焦点 量化低井补充信号与 言语片段接收中的言语阅读，超片段 特点、句子。模型预测与测量结果进行比较 适合各种听众和演示条件的语音接收， 包括听觉和视觉接收能力下降，以测量 视听整合效率。 尝试开发信号处理技术来导出语音朗读 声学语音的补充将涉及简化的信号 这可以很容易地与残余听力相匹配。信号必须是 准确地源自因干扰和混响而退化的语音。 尝试确定限制此类措施有效性的因素 信号将为有前途的现实评估提供基础 简化信号作为语音朗读的补充。 尝试将自动语音识别应用于开发 语音阅读补充材料涉及手动提示语音的研究， 确定现代语音识别算法的程度 可以自动产生语音阅读提示，并研究视觉显示 用于根据自动输出呈现语音朗读补充 受损听众的识别系统。