SBIR Phase I: Low latency and ultra high quality video streaming platform for highly immersive virtual reality (VR) experiences

SBIR 第一阶段：低延迟和超高质量视频流平台，提供高度沉浸式虚拟现实 (VR) 体验

• 批准号: 2151286
• 负责人: Richard Echeita
• 金额: $ 25.55万
• 依托单位: YERBA BUENA VR, INC.
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-09-01 至 2023-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2151286&HistoricalAwards=false
• 关键词: SBIR; Phase; Low; latency; ultra

The broader impact of this Small Business Innovation Research (SBIR) Phase I project is to address the technological challenges that limit the wide adoption of virtual and augmented reality in the United States. The proposed solution may enable or improve telemedicine applications, mental health and wellness social support programs, realistic training simulations for defense personnel, workforce development training and science, technology, engineering and mathematics (STEM) teaching solutions, and other applications which benefit from real-time immersive experiences. Current virtual reality (VR) technology uses low-quality video in order to deliver real-time interactions or uses realistic high-quality video that cannot simulate real-time interactions due to high-latency issues. High quality video delivered with low latency (less than 1 second) is the goal of this project. This Small Business Innovation Research (SBIR) Phase I project seeks to develop a virtual reality, image rendering, streaming solution that can manage 360-degree video with ultra-high quality at low latencies. The technical challenges are to overcome the trade-off between video quality and streaming latency. High-quality VR video, such as 360-degree crisp video, would have high latency, rendering the images very slowly. In contrast, low-quality video has low-latency (below 1 second), which means that the images can be rendered much faster. Both cases limit the immersive nature and feel of virtual reality technology because the video quality is insufficient and/or the latency makes it impossible for live virtual interaction. This SBIR project will include architecture design, low latency product developmental research, and prototype testing and validation. The commercialized product may enable companies to offer a fully immersive VR experience leading to more realistic training simulations, educational demonstrations, and real-time, social interactions for health and mental well-being.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

这项小型企业创新研究（SBIR）I阶段项目的更广泛影响是应对美国广泛采用虚拟和增强现实的技术挑战。提出的解决方案可以启用或改善远程医疗应用，心理健康和健康社会支持计划，对国防人员的现实培训模拟，劳动力发展培训和科学，技术，工程和数学（STEM）教学解决方案以及其他受益于实时沉浸式体验的应用。当前的虚拟现实（VR）技术使用低质量的视频来提供实时互动或使用现实的高质量视频，这些视频无法模拟由于高延迟问题而导致的实时互动。该项目的目标是低潜伏期（小于1秒）的高质量视频。这项小型企业创新研究（SBIR）I阶段项目旨在开发虚拟现实，图像渲染，流媒体解决方案，该解决方案可以在低潜伏期以超高质量管理360度视频。技术挑战是要克服视频质量和流潜伏期之间的权衡。高质量的VR视频（例如360度清晰的视频）将具有很高的延迟，使图像非常缓慢。相比之下，低质量的视频具有低延迟（低于1秒），这意味着可以更快地渲染图像。两种情况都限制了虚拟现实技术的沉浸性和感觉，因为视频质量不足和/或延迟使现场虚拟互动不可能。该SBIR项目将包括建筑设计，低潜伏期产品的发展研究以及原型测试和验证。商业化的产品可以使公司能够提供完全沉浸式的VR经验，从而提供更现实的培训模拟，教育示范以及实时的健康和精神福祉的社交互动。该奖项反映了NSF的法定任务，并被认为是值得通过基金会的知识分子优点和更广泛影响的评估审查标准来通过评估来支持的。