Joint audio-visual signal processing for video conferencing

视频会议的联合视听信号处理

• 批准号: 249590-2009
• 负责人: Dansereau, Richard
• 金额: $ 1.82万
• 依托单位: Carleton University
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2013
• 资助国家: 加拿大
• 起止时间: 2013-01-01 至 2014-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=524714
• 关键词: Joint; audio; visual; signal; processing

We are seeing the emergence of new signal processing techniques that combine multiple physiological modalities such as hearing and in vision. These modalities can be in the form of speech, facial movements, and gestures and used to improve signal processing results and human-computer interaction. Areas that can take advantage of multimodal processing includes audiovisual speech recognition, audiovisual speech enhancement, audiovisual speaker detection, audiovisual speech separation, audiovisual affect-sensitive recognition (emotion recognition), and gesture-speech recognition for human-computer interaction.

我们正在看到新的信号处理技术的出现，这些技术结合了多种生理方式，如听觉和视觉。这些模式可以是语音、面部动作和手势的形式，并用于改善信号处理结果和人机交互。可以利用多模式处理的领域包括视听语音识别、视听语音增强、视听说话人检测、视听语音分离、视听情感敏感识别(情感识别)以及用于人机交互的手势-语音识别。