Audio-Visual Scene Recognition

视听场景识别

• 批准号: 2197029
• 金额: --
• 依托单位: University of Surrey
• 依托单位国家: 英国
• 项目类别: Studentship
• 财政年份: 2019
• 资助国家: 英国
• 起止时间: 2019 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=studentship-2197029
• 关键词: Audio; Visual; Scene; Recognition

Traditionally audio and visual recognition departments have operated independently, however with the emergence of new deep learning techniques there is a possibility to combine elements from both sets of research groups, in the audio and visual domain.My proposal is to work on a novel technique that will allow a system to draw on image and speech recognition in order to describe a scene by exploring the recent research in Deep Learning, specifically, Cycle GANs. There are many potentially useful applications for such a system, such as YouTube videos or for companies such as IKEA for video instructions on constructing furniture.

传统上，音频和视觉识别部门是独立运作的，但随着新的深度学习技术的出现，有可能在音频和视觉领域将两组研究小组的元素联合收割机结合起来。我的建议是研究一种新技术，通过探索深度学习的最新研究，特别是循环GAN。这种系统有许多潜在的有用应用，例如YouTube视频或宜家等公司的视频说明。