Viewport-Driven Rate-Distortion Optimized 360º Video Streaming
Viewport-Driven Rate-Distortion Optimized 360º Video Streaming
复制标题
视口驱动的速率失真优化 360° 视频流
DOI：
10.1109/icc.2018.8422859
复制
发表时间：
2018
期刊：
影响因子：
--
通讯作者：
Swaminathan, Viswanathan
中科院分区：
文献类型：
--
作者：
Chakareski, Jacob;Aksu, Ridvan;Corbillon, Xavier;Simon, Gwendal;Swaminathan, Viswanathan
虚拟和增强现实通信以及360°视频流的日益普及正在将视频通信系统移动到更加动态和资源有限的操作设置中。360°视频的巨大数据量需要有效利用网络带宽，以保持最终用户所需的体验质量。为此，我们提出了一个视口驱动的率失真优化的360°视频流的框架，该框架集成了用户视图导航模式和360°视频内容的时空率失真特性，以最大限度地提高给定网络/系统资源的用户体验质量。该框架包括用于构建动态热图的方法，该动态热图捕获用户随时间推移导航360°视频的不同空间段的可能性，其时空率失真特性的分析和表征，其利用360°视图球体的预处理空间填充，以及优化问题公式化，其在给定用户导航模式，360°视频编码决策，以及可用的系统/网络资源。我们的实验结果证明了我们的框架的优势，超过传统的方法流单片均匀编码的360°视频和最先进的参考方法。在两个流行的4K 360°视频的情况下，证明了4 - 5 dB的相当大的视频质量增益。
The growing popularity of virtual and augmented reality communications and 360° video streaming is moving video communication systems into much more dynamic and resource-limited operating settings. The enormous data volume of 360° videos requires an efficient use of network bandwidth to maintain the desired quality of experience for the end user. To this end, we propose a framework for viewport-driven rate-distortion optimized 360° video streaming that integrates the user view navigation pattern and the spatiotemporal rate-distortion characteristics of the 360° video content to maximize the delivered user quality of experience for the given network/system resources. The framework comprises a methodology for constructing dynamic heat maps that capture the likelihood of navigating different spatial segments of a 360° video over time by the user, an analysis and characterization of its spatiotemporal rate-distortion characteristics that leverage preprocessed spatial tilling of the 360° view sphere, and an optimization problem formulation that characterizes the delivered user quality of experience given the user navigation patterns, 360° video encoding decisions, and the available system/network resources. Our experimental results demonstrate the advantages of our framework over the conventional approach of streaming a monolithic uniformly-encoded 360° video and a state-of-the-art reference method. Considerable video quality gains of 4 - 5 dB are demonstrated in the case of two popular 4K 360° videos.
当 HTTP/2 拯救 DASH 时：视频帧复用
DOI：
10.1109/infcomw.2017.8116458
发表时间：
2017
期刊：
2017 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS)
影响因子：
--
作者：
Mariem Ben Yahia;Yannick Le Louédec;L. Nuaymi;G. Simon
通讯作者：
G. Simon
使用 HTTP/2 改进虚拟现实流
DOI：
10.1145/3083187.3083224
发表时间：
2017
期刊：
Proceedings of the 8th ACM on Multimedia Systems Conference
影响因子：
--
作者：
Stefano Petrangeli;F. Turck;Viswanathan Swaminathan;Mohammad Hosseini
通讯作者：
Mohammad Hosseini