SBIR Phase I: Multi-depth-camera volumetric video recording and streaming

这个小企业创新研究（SBIR）第一阶段项目的更广泛的影响/商业潜力是改善数字内容的体积内容交付，或3D主题的表示。由于文件大小巨大，当前的容量内容通常限于非常短的片段（通常为10秒）。这项研究提出了一种低成本、实时流媒体、360度容量内容平台，没有持续时间限制，即使在4G网络上也是如此。个人将能够采用低成本、容易获得的组件，创造出通常被称为自己的全息图，用于直播和/或录音。内容将与现有的移动设备和大多数商用可穿戴扩展现实（XR）设备兼容。无论是移动还是有线。由于该项目将利用入门级现成硬件，容量内容创建成本将与在线视频制作成本相当，从而确保广泛采用各种应用，包括医疗、教育、培训、安全、娱乐和电信。这个小型企业创新研究（SBIR）第一阶段项目旨在使用两个或更多的深度传感器捕获人体，将它们快速合并成一个压缩视频流，并使用现有的云服务将它们广播到移动和可穿戴设备上。然后，这些内容可以在标准的二维设备（如手机）或3D设备（如XR可穿戴设备）上观看。内容将完全实现，并可在任何时间从任何角度查看。没有持续时间限制，文件大小将与标准高清视频内容相当。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

The broader impact/commercial potential of this Small Business Innovation Research (SBIR) Phase I project is to improve digital content delivery of volumetric content, or representation of 3D subjects. Current volumetric content is commonly limited to very short clips (typically 10 seconds) due to huge file sizes. This research advances a low-cost, live-streaming, 360-degree volumetric content platform with no duration limits, even on 4G networks. An individual will be able to take low-cost, readily available components and create what would commonly be referred to as a hologram of themselves, for live broadcast and/or recording. The content will be compatible with existing mobile devices, and most commercially available wearable extended reality (XR) devices. both mobile and tethered. Due to the entry-level off-the-shelf hardware that this project will leverage, volumetric content creation costs will be on par with online video production costs, ensuring broad adoption across a wide number of applications, including medical, education, training, safety, entertainment and telecommunications.This Small Business Innovation Research (SBIR) Phase I project seeks to enable the capture of a human subject using two or more depth-sensors, quickly combine those in a single stream of compressed video, and broadcast them to mobile and wearable devices using existing cloud services. This content can then be viewed on a standard two-dimensional device like a mobile phone, or on a 3D device like an XR wearable. The content will be fully realized, and viewable from any angle at any time. There will be no duration limits, and file sizes will be comparable to standard HD video content.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.