SBIR Phase I: Multi-depth-camera volumetric video recording and streaming

小型企业创新研究(SBIR)第一阶段项目的更广泛影响/商业潜力是改进体积内容的数字内容交付，即3D主题的表示。由于文件很大，当前的体积内容通常限于非常短的剪辑(通常为10秒)。这项研究提出了一种低成本、实时流媒体、360度体积内容平台，即使在4G网络上也没有持续时间限制。个人将能够获得低成本、容易获得的组件，并创建通常被称为他们自己的全息图，用于现场广播和/或记录。这些内容将与现有的移动设备以及大多数商用可穿戴式扩展现实(XR)设备兼容。无论是移动的还是被拴住的。由于该项目将利用入门级现成硬件，体积内容创建成本将与在线视频制作成本持平，确保在医疗、教育、培训、安全、娱乐和电信等广泛应用中得到广泛采用。该小型企业创新研究(SBIR)第一阶段项目旨在使用两个或更多深度传感器捕获人类主体，将其快速组合在单个压缩视频流中，并使用现有的云服务将其广播到移动和可穿戴设备。然后，这些内容就可以在手机等标准的二维设备上查看，或者在XR可穿戴设备等3D设备上查看。内容将完全实现，并可在任何时间从任何角度查看。该奖项将没有持续时间限制，文件大小将与标准高清视频内容相当。该奖项反映了NSF的法定使命，并已通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

The broader impact/commercial potential of this Small Business Innovation Research (SBIR) Phase I project is to improve digital content delivery of volumetric content, or representation of 3D subjects. Current volumetric content is commonly limited to very short clips (typically 10 seconds) due to huge file sizes. This research advances a low-cost, live-streaming, 360-degree volumetric content platform with no duration limits, even on 4G networks. An individual will be able to take low-cost, readily available components and create what would commonly be referred to as a hologram of themselves, for live broadcast and/or recording. The content will be compatible with existing mobile devices, and most commercially available wearable extended reality (XR) devices. both mobile and tethered. Due to the entry-level off-the-shelf hardware that this project will leverage, volumetric content creation costs will be on par with online video production costs, ensuring broad adoption across a wide number of applications, including medical, education, training, safety, entertainment and telecommunications.This Small Business Innovation Research (SBIR) Phase I project seeks to enable the capture of a human subject using two or more depth-sensors, quickly combine those in a single stream of compressed video, and broadcast them to mobile and wearable devices using existing cloud services. This content can then be viewed on a standard two-dimensional device like a mobile phone, or on a 3D device like an XR wearable. The content will be fully realized, and viewable from any angle at any time. There will be no duration limits, and file sizes will be comparable to standard HD video content.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.