Cloud compression for live volumetric video

实时体积视频的云压缩

• 批准号: 10038316
• 金额: $ 25.48万
• 依托单位: CONDENSE REALITY LTD
• 依托单位国家: 英国
• 项目类别: Responsive Strategy and Planning
• 财政年份: 2022
• 资助国家: 英国
• 起止时间: 2022 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=10038316
• 关键词: Cloud; compression; live; volumetric; video

Condense Reality has developed a system for capturing and streaming live volumetric video into Game Engines. This will allow customers to put on ticketed events in virtual spaces that can hugely expand the addressable market for live music.To date the focus of Condense Reality has been live capture. It has solved many complex computer vision problems in order to get to this stage. This has been validated by a £3.45M VC investment in December 2021\.It is now shifting focus to distribution and the delivery of immersive experiences to the end user. In order to do this there is a need to maintain high quality but reduce the bitrate of the live volumetric video that is streamed from a cloud based CDN. In order to continue to drive adoption there is a need to cater for customers with a wide range of connection speeds and on devices with varying processing capabilities. This project is focused on the novel application of deep learning to efficiently compress live-streamed volumetric video. This is a hard problem to solve.University of Bristol is recognised as a world leader in AI-based video coding, with contributions to MPEG standards including new training databases, coding frameworks, and deep learning network architectures. In this collaborative project, researchers within the Visual Information Laboratory will contribute expertise and enhance their state-of-the-art coding approaches to volumetric video content.**This project will focus on:**1. Novel methods that employ deep learning to improve compression efficiency.2. Enhanced architectures for delivering volumetric video content at variable bitrates.3. Integrating systems into the decoder which dynamically influence the bitrate based on bandwidth and device capability (updating the Unity and Unreal plugins so that they can cope with whatever compression methodology is adopted).Through this, we will provide the following **benefits to the user**:1. Enhanced visual quality and immersive experience associated with volumetric video content2. Reduced end-to-end latency of the compression systems3. Improved unit economics of delivery4. Increased content accessibilityThis project will make a major contribution to the state of the art in volumetric video delivery and generate significant impact on a wide range of immersive video applications. Bristol has a unique ecosystem of researchers, technology companies and artists that can be at the forefront of defining and creating a future collaborative Metaverse. The world-leading innovations in this project will contribute to this ambition and thus bring with significant economic benefits to the region.

Condense Reality开发了一个用于捕获和流式传输实时体积视频到游戏引擎的系统。这将使客户能够在虚拟空间中举办门票活动，从而极大地扩展现场音乐的可寻址市场。迄今为止，Condense Reality的重点一直是现场捕捉。它已经解决了许多复杂的计算机视觉问题，以达到这一阶段。2021年12月，345万英镑的VC投资验证了这一点，现在它正在将重点转移到分销和向最终用户提供沉浸式体验。为了做到这一点，需要保持高质量，但降低从基于云的CDN流式传输的实况体积视频的比特率。为了继续推动采用，需要满足具有各种连接速度和不同处理能力的设备的客户。该项目专注于深度学习的新应用，以有效压缩实时流媒体体积视频。布里斯托大学被公认为基于人工智能的视频编码领域的世界领导者，对MPEG标准做出了贡献，包括新的训练数据库、编码框架和深度学习网络架构。在这个合作项目中，视觉信息实验室的研究人员将贡献专业知识并增强他们对立体视频内容的最先进编码方法。**本项目将重点关注：**1。采用深度学习来提高压缩效率的新方法。2.增强的架构，用于以可变比特率传输体积视频内容。3.将系统集成到解码器中，根据带宽和设备能力动态影响比特率（更新Unity和Unreal插件，以便它们可以科普采用的任何压缩方法）。通过这一点，我们将为用户提供以下 ** 好处 **：1.增强的视觉质量和与立体视频内容相关的沉浸式体验2。减少压缩系统的端到端延迟3.提高单位交付的经济性4。提高内容可访问性该项目将对容量视频传输的最新技术做出重大贡献，并对广泛的沉浸式视频应用产生重大影响。布里斯托拥有一个由研究人员、技术公司和艺术家组成的独特生态系统，他们可以站在定义和创建未来协作元宇宙的最前沿。该项目中世界领先的创新将有助于实现这一目标，从而为该地区带来巨大的经济效益。