OpenUVR: an Open-Source System Framework for Untethered Virtual Reality Applications

OpenUVR: an Open-Source System Framework for Untethered Virtual Reality Applications
复制标题

DOI:
10.1109/rtas52030.2021.00026
复制
发表时间:
2021-01
期刊:
2021 IEEE 27th Real-Time and Embedded Technology and Applications Symposium (RTAS)
影响因子:
--
通讯作者:
Alec Rohloff;Zackary Allen;Kung-Min Lin;Joshua Okrend;Chengyi Nie;Yu-Chia Liu;H. Tseng
Alec Rohloff;Zackary Allen;Kung-Min Lin;Joshua Okrend;Chengyi Nie;Yu-Chia Liu;H. Tseng
中科院分区:
其他
文献类型:
--
作者:
Alec Rohloff;Zackary Allen;Kung-Min Lin;Joshua Okrend;Chengyi Nie;Yu-Chia Liu;H. Tseng

文献摘要

相似文献

异构计算技术的进步使虚拟现实(VR)应用具有巨大的潜力。为了提供最佳的用户体验(UX),系统应该采用一个不受限制的、基于无线网络的架构来在用户和内容生成器之间传输VR内容。然而,现代无线网络技术使得实现这样的架构具有挑战性,因为VR应用需要上级视频质量-具有高分辨率、高帧速率和非常低的延迟。本文介绍了OpenUVR,一个开源的框架,使用商品硬件组件,以满足交互式,实时VR应用程序的需求。OpenUVR通过重新设计系统堆栈显著改善了用户体验,并解决了现代计算系统中与冗余内存复制相关的最具时效性的问题。OpenUVR提供了一个跨层的VR数据路径,以避免系统组件之间的冗余数据操作和计算,OpenUVR自定义网络堆栈,以消除不必要的内存操作所产生的不匹配的数据格式在每一层,OpenUVR使用反馈从移动的设备,以消除内存缓冲区。这些修改使OpenUVR能够将VR应用延迟降低到14.32 ms,满足避免晕动病的最小延迟20 ms。作为一个与商用硬件完全兼容的开源系统,OpenUVR为研究社区提供了一个开发、研究和优化不受限制的高性能VR架构应用程序的机会。
Advancements in heterogeneous computing technologies enable the significant potential of virtual reality (VR) applications. To offer the best user experience (UX), a system should adopt an untethered, wireless-network-based architecture to transfer VR content between the user and the content generator. However, modern wireless network technologies make implementing such an architecture challenging, as VR applications require superior video quality–with high resolution, high frame rates, and very low latency. This paper presents OpenUVR, an open-source framework that uses commodity hardware components to satisfy the demands of interactive, real-time VR applications. OpenUVR significantly improves UX through a redesign of the system stack and addresses the most time-sensitive issues associated with redundant memory copying in modern computing systems. OpenUVR presents a cross-layered VR datapath to avoid redundant data operations and computation among system components, OpenUVR customizes the network stack to eliminate unnecessary memory operations incurred by mismatching data formats in each layer, and OpenUVR uses feedback from mobile devices to remove memory buffers. Together, these modifications allow OpenUVR to reduce VR application delays to 14.32 ms, meeting the 20 ms minimum latency in avoiding motion sickness. As an open-source system that is fully compatible with commodity hardware, OpenUVR offers the research community an opportunity to develop, investigate, and optimize applications for untethered, high-performance VR architectures.