Audio-Visual Scene Recognition

传统上，音频和视觉识别部门是独立运作的，但是随着新的深度学习技术的出现，有可能将音频和视觉领域的两组研究小组的元素结合起来。我的建议是通过探索深度学习的最新研究，特别是循环gan，研究一种新的技术，使系统能够利用图像和语音识别来描述场景。这种系统有许多潜在的有用应用，比如YouTube视频，或者像宜家这样的公司制作家具的视频指导。

Traditionally audio and visual recognition departments have operated independently, however with the emergence of new deep learning techniques there is a possibility to combine elements from both sets of research groups, in the audio and visual domain.My proposal is to work on a novel technique that will allow a system to draw on image and speech recognition in order to describe a scene by exploring the recent research in Deep Learning, specifically, Cycle GANs. There are many potentially useful applications for such a system, such as YouTube videos or for companies such as IKEA for video instructions on constructing furniture.