Neural Rendering of object-based audio-visual scenes

基于对象的视听场景的神经渲染

• 批准号: 2644080
• 金额: --
• 依托单位: University of Surrey
• 依托单位国家: 英国
• 项目类别: Studentship
• 财政年份: 2022
• 资助国家: 英国
• 起止时间: 2022 至 无数据
• 项目状态: 未结题
• 来源: https://gtr.ukri.org/projects?ref=studentship-2644080
• 关键词: Neural; Rendering; object; based; audio

This research will investigate the use of neural rendering methods to render general dynamic scenes from object-based representations with the realism of video. Learnt representations of natural spatial and temporal appearance will be exploited through deep network architectures (GAN, VAE etc.) for real time rendering of scenes. The goal is to enable the reproduction of highly-realistic content for natural scenes from object based scene representations derived from video capture.

本研究将探讨使用神经渲染方法，从基于对象的表示与视频的真实感渲染一般的动态场景。自然空间和时间外观的学习表示将通过深度网络架构（GAN，VAE等）进行开发。用于场景的真实的时间渲染。其目标是使高逼真的内容的自然场景的再现从基于对象的场景表示来自视频捕捉。