Real-time volumetric video recording of large capture areas

大捕捉区域的实时体积视频录制

• 批准号: 107443
• 金额: $ 22.21万
• 依托单位: CONDENSE REALITY LTD
• 依托单位国家: 英国
• 项目类别: Collaborative R&D
• 财政年份: 2020
• 资助国家: 英国
• 起止时间: 2020 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=107443
• 关键词: Real; time; volumetric; video; recording

The aim of this project is to build a system capable of recording photorealistic 3D models of fast moving content in real-time, with an initial focus on sports events. When paired with virtual reality (VR), augmented reality (AR) or mixed reality (MR) hardware, these recordings will provide viewers with immersive, hologram-style renderings of events from the comfort of their own homes. The technology (known as volumetric capture) will use multiple, non intrusive sensors positioned around an event to generate the 3D reconstruction. Although the focus of this project will be on sports, the technology will be applicable to a wide range of live events. Currently, recording volumetric video of large areas (as large as or greater than the size of a boxing ring) requires processing times which prohibit live broadcasting. To enable us to record and distribute sports events in real-time, we will develop highly optimised algorithms and data structures alongside deep learning powered systems to create volumetric video of fast moving events over large areas in real-time. Working with our partner company, we will also develop camera equipment which is portable, easy to set up, and non-intrusive so as not to restrict the view of audience members.

该项目的目标是建立一个能够实时记录快速移动内容的逼真3D模型的系统，最初的重点是体育赛事。当与虚拟现实（VR）、增强现实（AR）或混合现实（MR）硬件配合使用时，这些记录将为观众提供身临其境的、全息式的事件渲染。该技术（被称为体积捕获）将使用多个非侵入式传感器，定位在事件周围，生成3D重建。虽然这个项目的重点将放在体育上，但这项技术将适用于广泛的现场活动。目前，录制大面积（与拳击台一样大或更大）的体积视频需要处理时间，因此无法进行现场直播。为了使我们能够实时记录和分发体育赛事，我们将开发高度优化的算法和数据结构，以及深度学习驱动的系统，以实时创建大面积快速移动赛事的体积视频。我们还将与我们的合作伙伴公司合作，开发便携，易于设置，非侵入性的摄像设备，以不限制观众的视野。