VIDEO PROCESSING OF SPEECH FOR HEARING-IMPAIRED PERSONS

实验将使用现代信号处理进行 识别和衡量感知上重要的技术 用于语音阅读（唇读）的视频信号的特征 听力正常者和听力障碍者。 的影响 空间过滤以及常见的视频降级 将调查演讲阅读表现并制定指数 类似于衔接指数将被开发 根据物理测量预测语音阅读性能。 将开发和合成视频语音信号的方法 用于旨在识别物理的感知研究 在语音朗读中很重要的信号特征。 开发补充视觉提示以改善 通过语音阅读进行的交流将使用以下方法进行调查 合成视频语音信号。 中获得的数据 将整合组件项目以开发 分段级别语音阅读的定量模型。

Experiments will be performed using modern signal processing techniques to identify and measure the perceptually important characteristics of video signals for speechreading (lipreading) by both normal-hearing and hearing-impaired persons. The effects of spatial filtering as well as that of common video degradations on speechreading performance will be investigated and an index analogous to the Articulation Index will be developed for predicting speechreading performance from physical measurements. Methods for synthesizing video speech signals will be developed and used in perceptual studies designed to identify the physical characteristics of the signal that are important in speechreading. The development of supplementary visual cues for improved communication by speechreading will be investigated using synthesized video speech signals. The data obtained in the component project will be integrated in order to develop a quantitative model of speechreading at the segmental level.