Photorealistic Fusion of Virtual and Real Content for Augmented Reality Games

点击翻译按钮获取中文摘要

Based on the history of computer graphics and the demand gamers have placed on improved real-time rendering, players will soon expect the photorealistic quality of traditional games in Augmented Reality (AR) applications. However, the generation of photorealistic AR is severely limited by deficiencies in the current state-of-the-art in "inverse modelling". The proposed research will study what information about a scene is essential to facilitate the insertion of virtual content with photorealistic quality. It proposes that the quality of real-time AR effects can be drastically improved by combining depth estimation with inverse rendering and including a neural renderer on the output. Upon completion, this research has the potential to enable ultra high quality AR effects, which can produce new social gaming experiences, overlay AR effects on sports events and support the development of AR arcades and theatres.