Color-Perception-Guided Display Power Reduction for Virtual Reality
Color-Perception-Guided Display Power Reduction for Virtual Reality
复制标题
DOI：
10.1145/3550454.3555473
复制
发表时间：
2022-09
期刊：
影响因子：
--
通讯作者：
Budmonde Duinkharjav;Kenneth Chen;Abhishek Tyagi;Jiaying He;Yuhao Zhu;Qiuyue Sun
中科院分区：
文献类型：
--
作者：
Budmonde Duinkharjav;Kenneth Chen;Abhishek Tyagi;Jiaying He;Yuhao Zhu;Qiuyue Sun
对于当今不受限制的VR和AR设备，电池寿命是日益紧迫的挑战。但是，头部安装显示器的功率效率自然与由更好的分辨率，刷新速率和动态范围驱动的计算需求不断增长，所有这些范围都减少了未经处理的AR/VR设备的持续使用时间。例如，Oculus Quest 2在充满电的电池下只能维持2到3个小时的操作时间。先前的显示功率减少技术主要针对智能手机显示。但是，直接应用智能手机显示功率降低技术，但是，用明显的文物降低了AR/VR的视觉感知。例如，智能手机上的“节省功率模式”均匀地降低了显示屏上的像素亮度，因此，如果直接应用于VR内容，则向用户呈现了整体变暗的视觉感知。我们的关键见解是，VR显示功率降低必须意识到高视野VR显示的凝视性质。为此，我们提出了一个注视诱导的系统，该系统在不降低亮度的情况下，在用户积极查看沉浸式视频序列时，可以最大程度地减少显示功耗，同时保持高视觉保真度。这是通过构建心理物理研究的凝视颜色歧视模型的启用，以及2）通过实际设备测量值的显示功率模型（相对于像素颜色）。至关重要的是，由于构建两个模型的仔细设计决策，我们的算法被用作封闭形式解决方案的约束优化问题，该解决方案可以作为实时的图像空间空间。我们使用一系列心理物理研究和自然图像进行大规模分析来评估我们的系统。实验结果表明，我们的系统将显示功率降低了多达24％（平均14％），而几乎没有感知的保真度降解。
Battery life is an increasingly urgent challenge for today's untethered VR and AR devices. However, the power efficiency of head-mounted displays is naturally at odds with growing computational requirements driven by better resolution, refresh rate, and dynamic ranges, all of which reduce the sustained usage time of untethered AR/VR devices. For instance, the Oculus Quest 2, under a fully-charged battery, can sustain only 2 to 3 hours of operation time. Prior display power reduction techniques mostly target smartphone displays. Directly applying smartphone display power reduction techniques, however, degrades the visual perception in AR/VR with noticeable artifacts. For instance, the "power-saving mode" on smartphones uniformly lowers the pixel luminance across the display and, as a result, presents an overall darkened visual perception to users if directly applied to VR content. Our key insight is that VR display power reduction must be cognizant of the gaze-contingent nature of high field-of-view VR displays. To that end, we present a gaze-contingent system that, without degrading luminance, minimizes the display power consumption while preserving high visual fidelity when users actively view immersive video sequences. This is enabled by constructing 1) a gaze-contingent color discrimination model through psychophysical studies, and 2) a display power model (with respect to pixel color) through real-device measurements. Critically, due to the careful design decisions made in constructing the two models, our algorithm is cast as a constrained optimization problem with a closed-form solution, which can be implemented as a real-time, image-space shader. We evaluate our system using a series of psychophysical studies and large-scale analyses on natural images. Experiment results show that our system reduces the display power by as much as 24% (14% on average) with little to no perceptual fidelity degradation.