Photorealistic Fusion of Virtual and Real Content for Augmented Reality Games

增强现实游戏中虚拟和真实内容的逼真融合

• 批准号: 2761669
• 金额: --
• 依托单位: University of York
• 依托单位国家: 英国
• 项目类别: Studentship
• 财政年份: 2021
• 资助国家: 英国
• 起止时间: 2021 至 无数据
• 项目状态: 未结题
• 来源: https://gtr.ukri.org/projects?ref=studentship-2761669
• 关键词: Photorealistic; Fusion; Virtual; Real; Content

Based on the history of computer graphics and the demand gamers have placed on improved real-time rendering, players will soon expect the photorealistic quality of traditional games in Augmented Reality (AR) applications. However, the generation of photorealistic AR is severely limited by deficiencies in the current state-of-the-art in "inverse modelling". The proposed research will study what information about a scene is essential to facilitate the insertion of virtual content with photorealistic quality. It proposes that the quality of real-time AR effects can be drastically improved by combining depth estimation with inverse rendering and including a neural renderer on the output. Upon completion, this research has the potential to enable ultra high quality AR effects, which can produce new social gaming experiences, overlay AR effects on sports events and support the development of AR arcades and theatres.

根据计算机图形学的历史和游戏玩家对改进实时渲染的需求，玩家很快就会期待增强现实（AR）应用中传统游戏的真实感质量。然而，真实感AR的生成受到当前最先进的“逆建模”中的缺陷的严重限制。拟议的研究将研究什么样的场景信息是必不可少的，以促进插入的虚拟内容与逼真的质量。它提出，通过将深度估计与逆渲染相结合，并在输出上包含神经渲染器，可以大大提高实时AR效果的质量。完成后，这项研究有可能实现超高质量的AR效果，这可以产生新的社交游戏体验，将AR效果叠加在体育赛事上，并支持AR拱廊和剧院的发展。