QuRate: power-efficient mobile immersive video streaming
QuRate: power-efficient mobile immersive video streaming
复制标题
DOI：
10.1145/3339825.3391863
复制
发表时间：
2020-05
期刊：
影响因子：
--
通讯作者：
Nan Jiang;Yao Liu;Tian Guo;Wenyao Xu;Viswanathan Swaminathan;Lisong Xu;Sheng Wei
中科院分区：
文献类型：
--
作者：
Nan Jiang;Yao Liu;Tian Guo;Wenyao Xu;Viswanathan Swaminathan;Lisong Xu;Sheng Wei
智能手机最近已经成为部署计算密集型虚拟现实（VR）应用的流行平台，例如沉浸式视频流（a.k.a.，360-度视频流）。涉及基于智能手机的头戴式显示器（HMD）的一个具体挑战是减少由沉浸式视频引起的潜在巨大功耗。为了应对这一挑战，我们首先进行了一个典型的智能手机沉浸式流媒体系统，确定主要的功耗源的经验功率测量研究。然后，我们开发了QuRate，一种质量感知和以用户为中心的帧速率自适应机制，以解决沉浸式视频流中的功耗问题。QuRate通过对可感知视频质量与用户行为之间的相关性进行建模，优化沉浸式视频功耗。具体而言，QuRate建立在视图切换期间用户对视频帧的关注程度降低的基础上，并动态调整帧速率，而不会影响可感知的视频质量。我们评估QuRate与一组全面的实验，涉及5个智能手机，21个用户，和6个沉浸式视频使用经验的用户头部运动轨迹。我们的实验结果表明，QuRate能够将智能手机的电池寿命延长高达1.24倍，同时在沉浸式视频流传输过程中保持可感知的视频质量。此外，我们还进行了机构审查委员会（IRB）批准的主观用户研究，以进一步验证QuRate对视频质量的最小影响。
Smartphones have recently become a popular platform for deploying the computation-intensive virtual reality (VR) applications, such as immersive video streaming (a.k.a., 360-degree video streaming). One specific challenge involving the smartphone-based head mounted display (HMD) is to reduce the potentially huge power consumption caused by the immersive video. To address this challenge, we first conduct an empirical power measurement study on a typical smartphone immersive streaming system, which identifies the major power consumption sources. Then, we develop QuRate, a quality-aware and user-centric frame rate adaptation mechanism to tackle the power consumption issue in immersive video streaming. QuRate optimizes the immersive video power consumption by modeling the correlation between the perceivable video quality and the user behavior. Specifically, QuRate builds on top of the user's reduced level of concentration on the video frames during view switching and dynamically adjusts the frame rate without impacting the perceivable video quality. We evaluate QuRate with a comprehensive set of experiments involving 5 smartphones, 21 users, and 6 immersive videos using empirical user head movement traces. Our experimental results demonstrate that QuRate is capable of extending the smartphone battery life by up to 1.24X while maintaining the perceivable video quality during immersive video streaming. Also, we conduct an Institutional Review Board (IRB)-approved subjective user study to further validate the minimum video quality impact caused by QuRate.