Coterie: Exploiting Frame Similarity to Enable High-Quality Multiplayer VR on Commodity Mobile Devices
Coterie: Exploiting Frame Similarity to Enable High-Quality Multiplayer VR on Commodity Mobile Devices
复制标题
DOI：
10.1145/3373376.3378516
复制
发表时间：
2020-03
期刊：
影响因子：
--
通讯作者：
Jiayi Meng;Sibendu Paul;Y. C. Hu
中科院分区：
文献类型：
--
作者：
Jiayi Meng;Sibendu Paul;Y. C. Hu
在本文中，我们研究如何在商品移动的设备上支持高质量的沉浸式多人VR。首先，我们进行了一个缩放实验，表明简单地复制现有技术的2层分布式VR渲染架构到多个播放器不能支持多个播放器，由于网络带宽要求的线性增加。其次，我们建议利用背景环境（BE）帧的相似性，以减少从服务器预取BE帧所需的带宽，通过缓存和重用类似的帧。我们发现，在虚拟世界中，由于“近物”效应，即使相邻位置的BE帧之间也几乎没有相似之处。我们提出了一种新的技术，分裂之间的移动终端和服务器，大大提高了BE帧的相似性，并减少了帧缓存的网络负载的渲染BE帧。我们在Unity和Google Daydream上的实现评估显示，我们的新VR框架Coterie将每个玩家的网络需求降低了10.6倍-25.7倍，并轻松支持4个玩家在Pixel 2上使用802.11ac的高分辨率VR应用程序，60 FPS和16 ms以下的响应时间。
In this paper, we study how to support high-quality immersive multiplayer VR on commodity mobile devices. First, we perform a scaling experiment that shows simply replicating the prior-art 2-layer distributed VR rendering architecture to multiple players cannot support more than one player due to the linear increase in network bandwidth requirement. Second, we propose to exploit the similarity of background environment (BE) frames to reduce the bandwidth needed for prefetching BE frames from the server, by caching and reusing similar frames. We find that there is often little similarly between the BE frames of even adjacent locations in the virtual world due to a "near-object" effect. We propose a novel technique that splits the rendering of BE frames between the mobile device and the server that drastically enhances the similarity of the BE frames and reduces the network load from frame caching. Evaluation of our implementation on top of Unity and Google Daydream shows our new VR framework, Coterie, reduces per-player network requirement by 10.6X-25.7X and easily supports 4 players for high-resolution VR apps on Pixel 2 over 802.11ac, with 60 FPS and under 16ms responsiveness.