VIDEO PROCESSING OF SPEECH FOR HEARING-IMPAIRED PERSONS

实验将使用现代信号处理进行 识别和测量感知重要性的技术 语音阅读（唇读）的视频信号特性 听力正常者和听力受损者。 的影响 空间滤波以及常见的视频退化 语音阅读性能将被调查和指数 类似于清晰度指数，将开发用于 从物理测量预测语音阅读性能。 将开发用于合成视频语音信号的方法， 用于感知研究，旨在识别物理 这些特征在语音阅读中很重要。 辅助视觉线索的发展， 通过语音阅读的沟通将被调查使用 合成视频语音信号。 中获得的数据 将整合组成项目，以制定一个 语段水平的言语阅读定量模型。

Experiments will be performed using modern signal processing techniques to identify and measure the perceptually important characteristics of video signals for speechreading (lipreading) by both normal-hearing and hearing-impaired persons. The effects of spatial filtering as well as that of common video degradations on speechreading performance will be investigated and an index analogous to the Articulation Index will be developed for predicting speechreading performance from physical measurements. Methods for synthesizing video speech signals will be developed and used in perceptual studies designed to identify the physical characteristics of the signal that are important in speechreading. The development of supplementary visual cues for improved communication by speechreading will be investigated using synthesized video speech signals. The data obtained in the component project will be integrated in order to develop a quantitative model of speechreading at the segmental level.