LILiR2 - Language Independent Lip Reading

众所周知，人类可以并且确实可以唇读，但对于有效唇读所需的视觉信息确切地知道得不多，特别是在非实验室环境中。该项目将收集唇读数据，并将其用于构建自动唇读系统：将唇动视频转换为文本的机器。为了有效，这样的系统必须在各种姿势下准确地跟踪头部;提取描述嘴唇的数字或特征，然后学习哪些特征对应于哪些文本。为了解决这个问题，我们需要使用从音频语音中收集的信息。因此，这个项目也将研究如何使用广泛的信息已知的音频语音识别视觉语音。该项目是一个合作之间的东安格利亚大学谁以前开发了国家的最先进的语音阅读系统;萨里大学建立了准确可靠的面部和嘴唇跟踪器，内政部科学分支希望调查这种方法用于打击犯罪的可行性。

It is known that humans can, and do, lip-read but not much is known about exactly what visual information is needed for effective lip-reading, particularly in non-laboratory environments. This project will collect data for lip-reading and use it to build automatic lip-reading systems: machines that convert videos of lip-motions into text. To be effective such systems must accurately track the head over a variety of poses; extract numbers, or features, that describe the lips and then learn what features correspond to what text. To tackle the problem we will need to use information collected from audio speech. So this project will also investigate how to use the extensive information known about audio speech to recognise visual speech.The project is a collaboration between the University of East Anglia who have previously developed state-of-the-art speech reading systems; the University of Surrey who built accurate and reliable face and lip-trackers and the Home Office Scientific Branch who wish to investigate the feasibility of this approach for crime fighting.