Millimeter Wave meets Edge Computing for Mobile VR with High-Fidelity 8K Scalable 360° Video
Millimeter Wave meets Edge Computing for Mobile VR with High-Fidelity 8K Scalable 360° Video
复制标题
DOI：
10.1109/mmsp.2019.8901752
复制
发表时间：
2019-09
期刊：
影响因子：
--
通讯作者：
Sabyasachi Gupta;Jacob Chakareski;P. Popovski
中科院分区：
文献类型：
--
作者：
Sabyasachi Gupta;Jacob Chakareski;P. Popovski
我们研究了一种新的多用户可扩展的8 K 360°视频移动的虚拟现实街机流媒体系统，通过可扩展的360°内容，预期的VR用户视口建模，毫米波（mmWave）通信和网络边缘计算能力的协同集成，实现高可靠性和沉浸保真度，以及低交互延迟。高数据速率毫米波链路用于以增强的质量传输预期用户360视口的视频内容。为了补偿毫米波链路的动态特性和预期的视口表征误差，我们集成了基于向所有用户广播360度全景基线表示的Wi-Fi的回退传输。在我们提出的传输策略中，预期的视口内容可以作为原始内容发送或以不同的质量进行编码，这通过利用接收用户处的通信和计算延迟之间的有效权衡来增强端到端性能。为了最大限度地提高所有用户的最低VR沉浸保真度，我们研究了毫米波接入点（AP）与用户关联的联合优化，要传输的360视口内容的编码部分的数据速率，以及计算资源分配。我们的实验结果表明，所提出的系统可以实现显着改善交付VR用户沉浸保真度和体验质量相对于一个国家的最先进的参考方法，仅利用Wi-Fi传输。
We investigate a novel multiple user scalable 8K 360° video mobile virtual reality arcade streaming system that enables high reliability and immersion fidelity, and low interactive latency, by the synergistic integration of scalable 360° content, expected VR user viewport modeling, millimeter wave (mmWave) communication and network edge computation capability. The high data rate mmWave link is used to transmit the video content of the expected user 360 viewport at enhanced quality. To compensate for the dynamic nature of mmWave links and prospective expected viewport characterization error, we integrate a fall back transmission based on Wi-Fi broadcast of a baseline representation of the 360 panorama to all users. In our proposed transmission strategy, the expected viewport content can be sent as raw or encoded at different qualities, which enhances the end-to-end performance, by exploiting effective trade-offs between communication and computation latency at the receiving user. With the aim of maximizing the minimum VR immersion fidelity across all users, we investigate the joint optimization of the mmWave access point (AP) to user association, the data rate for the encoded portion of the 360 viewport content that is to be transmitted, and computation resource allocation. Our experimental results demonstrate that the proposed system can achieve significant improvement in delivered VR user immersion fidelity and quality of experience relative to a state-of-the-art reference method that leverages Wi-Fi transmission only.