LILiR2 - Language Independent Lip Reading

LILiR2 - 独立于语言的唇读

• 批准号: EP/E027946/1
• 负责人: Richard Bowden
• 金额: $ 44.67万
• 依托单位: University of Surrey
• 依托单位国家: 英国
• 项目类别: Research Grant
• 财政年份: 2007
• 资助国家: 英国
• 起止时间: 2007 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=EP%2FE027946%2F1
• 关键词: LILiR2; Language; Independent; Lip; Reading

It is known that humans can, and do, lip-read but not much is known about exactly what visual information is needed for effective lip-reading, particularly in non-laboratory environments. This project will collect data for lip-reading and use it to build automatic lip-reading systems: machines that convert videos of lip-motions into text. To be effective such systems must accurately track the head over a variety of poses; extract numbers, or features, that describe the lips and then learn what features correspond to what text. To tackle the problem we will need to use information collected from audio speech. So this project will also investigate how to use the extensive information known about audio speech to recognise visual speech.The project is a collaboration between the University of East Anglia who have previously developed state-of-the-art speech reading systems; the University of Surrey who built accurate and reliable face and lip-trackers and the Home Office Scientific Branch who wish to investigate the feasibility of this approach for crime fighting.

众所周知，人类可以并且确实进行唇读，但对于有效的唇读到底需要哪些视觉信息，尤其是在非实验室环境中，我们知之甚少。该项目将收集唇读数据，并用它来构建自动唇读系统：将唇部动作视频转换为文本的机器。为了发挥作用，此类系统必须在各种姿势下准确跟踪头部；提取描述嘴唇的数字或特征，然后了解哪些特征对应于哪些文本。为了解决这个问题，我们需要使用从音频语音中收集的信息。因此，该项目还将研究如何利用已知的音频语音的广泛信息来识别视觉语音。该项目是东安格利亚大学之间的合作，该大学之前开发了最先进的语音阅读系统；萨里大学建造了准确可靠的面部和嘴唇追踪器，内政部科学部门希望调查这种打击犯罪方法的可行性。

项目成果

Visualisation and prediction of conversation interest through mined social signals

通过挖掘的社交信号可视化和预测对话兴趣

• DOI: 10.1109/fg.2011.5771380
• 发表时间: 2011
• 作者: Okwechime D

Analysis and Modeling of Faces and Gestures

面部和手势的分析和建模

• DOI: 10.1007/978-3-540-75690-3_6
• 发表时间: 2007
• 作者: Moore S

Image Analysis and Recognition

图像分析与识别

• DOI: 10.1007/978-3-642-13772-3_41
• 发表时间: 2010
• 作者: Moore S

Real-time motion control using pose space probability density estimation

使用位姿空间概率密度估计的实时运动控制

• DOI: 10.1109/iccvw.2009.5457534
• 发表时间: 2009
• 作者: Okwechime D

Comparing visual features for lipreading

比较唇读的视觉特征

• 发表时间: 2009
• 期刊: AVSP-2009
• 作者: Lan Y