A Log-Rectilinear Transformation for Foveated 360-degree Video Streaming
A Log-Rectilinear Transformation for Foveated 360-degree Video Streaming
复制标题
DOI：
10.1109/tvcg.2021.3067762
复制
发表时间：
2021-03
影响因子：
5.2
通讯作者：
David Li;Ruofei Du;Adharsh Babu;C. Brumar;Amitabh Varshney
中科院分区：
文献类型：
--
作者：
David Li;Ruofei Du;Adharsh Babu;C. Brumar;Amitabh Varshney
随着360°摄像机的迅速分辨率，头部安装的显示器和实时流程服务，在有限的带宽网络上，流式的高分辨率全景视频成为了一个关键的挑战，这可以解决这一挑战。 iasing和在本文中，我们介绍了一个新的日志式转换，将夏季式桌子过滤和现成的视频编解码器允许360°视频的流媒体播放现有360°的实验视频数据集并观察到，与对数极态亚采样相比，与夏季桌面过滤配对的对数直线转换大大降低了闪烁，同时还会降低带宽的使用情况。
With the rapidly increasing resolutions of 360° cameras, head-mounted displays, and live-streaming services, streaming high-resolution panoramic videos over limited-bandwidth networks is becoming a critical challenge. Foveated video streaming can address this rising challenge in the context of eye-tracking-equipped virtual reality head-mounted displays. However, conventional log-polar foveated rendering suffers from a number of visual artifacts such as aliasing and flickering. In this paper, we introduce a new log-rectilinear transformation that incorporates summed-area table filtering and off-the-shelf video codecs to enable foveated streaming of 360° videos suitable for VR headsets with built-in eye-tracking. To validate our approach, we build a client-server system prototype for streaming 360° videos which leverages parallel algorithms over real-time video transcoding. We conduct quantitative experiments on an existing 360° video dataset and observe that the log-rectilinear transformation paired with summed-area table filtering heavily reduces flickering compared to log-polar subsampling while also yielding an additional 10% reduction in bandwidth usage.