Real-time volumetric video recording of large capture areas

点击翻译按钮获取中文摘要

The aim of this project is to build a system capable of recording photorealistic 3D models of fast moving content in real-time, with an initial focus on sports events. When paired with virtual reality (VR), augmented reality (AR) or mixed reality (MR) hardware, these recordings will provide viewers with immersive, hologram-style renderings of events from the comfort of their own homes. The technology (known as volumetric capture) will use multiple, non intrusive sensors positioned around an event to generate the 3D reconstruction. Although the focus of this project will be on sports, the technology will be applicable to a wide range of live events. Currently, recording volumetric video of large areas (as large as or greater than the size of a boxing ring) requires processing times which prohibit live broadcasting. To enable us to record and distribute sports events in real-time, we will develop highly optimised algorithms and data structures alongside deep learning powered systems to create volumetric video of fast moving events over large areas in real-time. Working with our partner company, we will also develop camera equipment which is portable, easy to set up, and non-intrusive so as not to restrict the view of audience members.