Multiscale 3D Scanning with Framerate for TV and Immersive Applications

点击翻译按钮获取中文摘要

"**Project Vision**To tell a truly immersive story captured real world content must be compelling, accurate and believable. It must also be spatial and digitally manipulable.Existing techniques to capture live action in 3D over time are prohibitively expensive and limited in range to human scale events.3D scanning techniques and the resultant 'pointclouds' created are uniquely positioned to fulfil these needs, capturing photoreal content in a spatial manner across scales.ScanLAB are a pioneering creative technology practice and global leaders in pointcloud visualisation for offline and realtime rendered static content (i.e. data without a framerate).This project will enable ScanLAB to create a fundamentally new tool set to capture and render pointcloud data with a framerate at multiple scales:* SMALL (human/animal)* MEDIUM (concert/building)* LARGE (landscape/cityscape)**Key Objectives**The project will:* Develop innovative software tools to robustly Capture and Render pointcloud data with a framerate at multiple scales.* Test this software via capture of crucial, quality, multiscale datasets.* Produce prototype content delivered in two formats: an offline rendered 4K film and a realtime immersive experience for HTC VIVE.**Focus Areas**Existing clients have identified the need for capture that contributes breathtaking visuals to traditional TV and simultaneously creates content for immersive storytelling, enabling previously impossible stories to be told.Existing clients including the BBC have identified this technique as a solution to:* Make visually compelling 'drama reconstruction' for History programs* Capture live action animals and landscape scale change for Natural History* Visualise new storytelling for Drama**Innovation**The key innovation is to utilise 3D scanning and pointcloud datasets instead of traditional meshes for volumetric capture.The project creates software to fundamentally transform existing hardware capabilities. This technique opens up the use of medium & large scale capture hardware and enables efficient files formats to be utilised, capitalising on existing pointcloud visualisation capabilities.01: **Multiscale Framerate Pointcloud Capture Software** will:* operate on location at multiple scales interfacing with multiple sensors* enable time stamped 3D data to sync with production quality audio* enforce a fixed framerate for SMALL scale capture & enable framerate capture for MEDIUM/LARGE scales* enable datasets containing billion+ points to be stored via a new spatial animation file format.02: **Framerate Pointcloud Render Software** will:* expand ScanLAB's pre-existing rendering software to take new spatial animation files and enable the current quality of static scan rendering to be achieved on framerate datasets both Offline and in Realtime."