Multiscale 3D Scanning with Framerate for TV and Immersive Applications

**项目愿景**要讲述一个真正身临其境的故事，捕捉到的真实世界内容必须令人信服、准确和可信。它还必须是空间的和数字可操作的。现有的以3D形式捕捉随时间推移的实况动作的技术昂贵得令人望而却步，并且范围仅限于人类规模的事件。3D扫描技术和由此产生的点云被独特地定位为满足这些需求，以跨尺度的空间方式捕获真实照片内容。ScanLab是一项开创性的技术实践，也是针对离线和实时渲染的静态内容(即无帧速率的数据)的点云可视化方面的全球领导者。该项目将使ScanLab能够创建一个全新的工具集来捕获和渲染多个尺度的帧速率的点云数据：*小的(人/动物)*中等的(音乐会/建筑)*大的(景观/城市景观)**主要目标**该项目将：*开发创新的软件工具，以多个尺度的帧速率可靠地捕获和渲染点云数据。*通过捕获关键的、质量的、多尺度数据集。*产生以两种格式交付的原型内容：离线渲染的4K电影和HTC VIVE的实时沉浸式体验。**焦点领域**现有客户已经认识到捕获的需求，这种捕获为传统电视带来令人惊叹的视觉效果，同时为身临其境的讲故事创造内容，使以前不可能的故事被讲述。包括BBC在内的现有客户已经将这项技术确定为一种解决方案，用于：*为历史节目制作视觉上引人注目的‘戏剧重建’*为自然历史捕捉真人动物和风景尺度变化**为戏剧可视化新的故事讲述**创新**关键创新是利用3D扫描和点云数据集而不是传统的网格来进行体积捕捉。该项目创建软件来从根本上改变现有的硬件能力。该技术开辟了中型和大型捕获硬件的使用并使高效的文件格式得以利用，充分利用现有的点云可视化能力。01：**多尺度帧速率点云捕获软件**将：*与多个传感器接口的多尺度位置操作*使带有时间戳的3D数据与制作质量的音频同步*对小规模捕获强制执行固定帧速率，并对中/大尺度启用帧速率捕获*支持通过新的空间动画文件格式存储包含十亿+点的数据集。02：*帧速率点云渲染软件**将：*扩展ScanLab先前存在的渲染软件，以获取新的空间动画文件，并使帧速率数据集的当前静态扫描渲染质量能够离线和实时实现。

"**Project Vision**To tell a truly immersive story captured real world content must be compelling, accurate and believable. It must also be spatial and digitally manipulable.Existing techniques to capture live action in 3D over time are prohibitively expensive and limited in range to human scale events.3D scanning techniques and the resultant 'pointclouds' created are uniquely positioned to fulfil these needs, capturing photoreal content in a spatial manner across scales.ScanLAB are a pioneering creative technology practice and global leaders in pointcloud visualisation for offline and realtime rendered static content (i.e. data without a framerate).This project will enable ScanLAB to create a fundamentally new tool set to capture and render pointcloud data with a framerate at multiple scales:* SMALL (human/animal)* MEDIUM (concert/building)* LARGE (landscape/cityscape)**Key Objectives**The project will:* Develop innovative software tools to robustly Capture and Render pointcloud data with a framerate at multiple scales.* Test this software via capture of crucial, quality, multiscale datasets.* Produce prototype content delivered in two formats: an offline rendered 4K film and a realtime immersive experience for HTC VIVE.**Focus Areas**Existing clients have identified the need for capture that contributes breathtaking visuals to traditional TV and simultaneously creates content for immersive storytelling, enabling previously impossible stories to be told.Existing clients including the BBC have identified this technique as a solution to:* Make visually compelling 'drama reconstruction' for History programs* Capture live action animals and landscape scale change for Natural History* Visualise new storytelling for Drama**Innovation**The key innovation is to utilise 3D scanning and pointcloud datasets instead of traditional meshes for volumetric capture.The project creates software to fundamentally transform existing hardware capabilities. This technique opens up the use of medium & large scale capture hardware and enables efficient files formats to be utilised, capitalising on existing pointcloud visualisation capabilities.01: **Multiscale Framerate Pointcloud Capture Software** will:* operate on location at multiple scales interfacing with multiple sensors* enable time stamped 3D data to sync with production quality audio* enforce a fixed framerate for SMALL scale capture & enable framerate capture for MEDIUM/LARGE scales* enable datasets containing billion+ points to be stored via a new spatial animation file format.02: **Framerate Pointcloud Render Software** will:* expand ScanLAB's pre-existing rendering software to take new spatial animation files and enable the current quality of static scan rendering to be achieved on framerate datasets both Offline and in Realtime."