ENHANCED COMMUNICATIONS FOR SPEECHREADERS

增强语音朗读者的沟通能力

• 批准号: 2443614
• 负责人: LOUIS D BRAIDA
• 金额: $ 26.81万
• 依托单位: MASSACHUSETTS INSTITUTE OF TECHNOLOGY
• 依托单位国家: 美国
• 财政年份: 1994
• 资助国家: 美国
• 起止时间: 1994-07-01 至 2000-06-30
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/2443614
• 关键词: auditory stimulus; behavioral /social science research tag; cues; deafness; hearing; hearing aids; human subject; mathematical model; psychoacoustics; psychomotor reaction time; sensorineural hearing loss; speech recognition; speech viewer; speechreading; stimulus /response; visual perception; visual stimulus

This research is directed toward improving speech reception for the severely hearing impaired who rely on speechreading for communication. Attempts to advance basic understanding involve study of speechreading and the effects of auditory and visual supplements on audiovisual speech reception. Attempts to develop supplements for speechreaders involve extracting effective cues from acoustic speech and displaying them to individuals with severe hearing impairments. Attempts to develop mathematical models of audiovisual integration focus on quantifying low well supplementary signals are integrated with speechreading in the reception of speech segments, suprasegmental characteristics, and sentences. Model predictions are compared to measured speech reception for a variety of listeners and presentation conditions, including degraded auditory and visual reception, to measure the efficiency of audiovisual integration. Attempts to develop signal processing techniques to derive speechreading supplements from acoustic speech will be concerned with simplified signals that can be readily matched to residual hearing. The signals must be accurately derived from speech degraded by interference and reverberation. Attempts to determine the factors that limit the effectiveness of such signals will provide foundation for realistic evaluations of promising simplified signals as speechreading supplements. Attempts to apply automatic speech recognition to the development of speechreading supplements involve the study of Manual Cued Speech, determination of the extent to which modern speech recognition algorithms can produce speechreading cues automatically, and study of visual displays for presenting speechreading supplements based on the output of automatic recognition systems to impaired listeners.

这项研究旨在改善人们的语音接收能力 严重听力受损的人，他们依靠读话来进行交流。 试图提高基本的理解包括演讲阅读的研究， 视听辅助对视听言语的影响 接待为演讲朗读者开发补充材料的尝试包括 从声学语音中提取有效线索并将其显示给 有严重听力障碍的人。 尝试开发视听集成焦点的数学模型 在量化低井补充信号时，与 在接受言语片段时的言语阅读，超音段的 特征和句子。将模型预测与测量结果进行比较 用于各种收听者和呈现条件的语音接收， 包括退化的听觉和视觉接收，以测量 视听整合的效率。 尝试开发信号处理技术来推导语音阅读 声学语音的补充将涉及简化的信号 可以很容易地与残余听力相匹配。信号必须是 准确地从由于干扰和混响而退化的语音中导出。 试图确定限制这种有效性的因素， 信号将为现实的评估提供基础， 简化的信号作为语音阅读的补充。 尝试将自动语音识别应用于 语音朗读补充包括手动提示语音的研究， 确定现代语音识别算法 可以自动产生读话提示， 用于基于自动语音识别系统的输出来呈现语音阅读补充 识别系统，以受损听众。