Energy-Efficient Video Processing for Virtual Reality
Energy-Efficient Video Processing for Virtual Reality
复制标题
虚拟现实的节能视频处理
DOI：
10.1109/mm.2020.2985692
复制
发表时间：
2020
期刊：
影响因子：
3.6
通讯作者：
Yuhao Zhu
中科院分区：
文献类型：
--
作者：
Yue Leng;Jian Huang;Chi;Qiuyue Sun;Yuhao Zhu
虚拟现实（VR）具有实现全新应用的巨大潜力，其背后的球形全景视频处理是骨干技术之一。然而，当前的VR系统重复使用用于处理传统平面视频的技术，导致显著的能源效率低下。我们的特征表明，处理360°VR内容的独特操作占处理总能耗的40%。我们提出了EVR，一个端到端高效的VR视频处理系统。EVR认识到虚拟现实税的主要贡献者是投影转换（PT）业务。EVR通过两项关键技术减轻了PT的开销：服务器上的语义感知流和客户端设备上的硬件加速呈现。实际系统测量表明，EVR可将VR渲染的能量降低58%，这相当于为VR设备节省42%的能源。
Virtual reality (VR) has huge potential to enable radically new applications, behind which spherical panoramic video processing is one of the backbone techniques. However, current VR systems reuse the techniques designed for processing conventional planar videos, resulting in significant energy inefficiencies. Our characterizations show that operations that are unique to processing 360° VR content constitute 40% of the total processing energy consumption. We present EVR, an end-to-end system for energy-efficient VR video processing. EVR recognizes that the major contributor to the VR tax is the projective transformation (PT) operations. EVR mitigates the overhead of PT through two key techniques: semantic-aware streaming on the server and hardware-accelerated rendering on the client device. Real system measurements show that EVR reduces the energy of VR rendering by up to 58%, which translates to up to 42% energy saving for VR devices.