Exploiting layer and spatial correlations to enhance SVC and tile based 360-degree video streaming
Exploiting layer and spatial correlations to enhance SVC and tile based 360-degree video streaming
复制标题
利用层和空间相关性来增强 SVC 和基于图块的 360 度视频流
DOI：
10.1016/j.comnet.2021.107985
复制
发表时间：
2021
影响因子：
5.6
通讯作者：
Gao Qian
中科院分区：
文献类型：
--
作者：
Zhang Guoqiang;Wu Chenyi;Gao Qian
由于高带宽和低运动到光子延迟的要求，在今天的互联网上流传输360度视频是具有挑战性的。通过将更多的比特率分配给用户受限的视场，并基于用户估计的吞吐量和凝视点来流送适当的表示，视点自适应流传输是一种很有前途的技术来应对这些挑战。典型的动态自适应流传输系统使用媒体呈现描述(MPD)文件来描述不同质量表示的周期的可持续比特率。然而，对于可变比特率(VBR)视频，视频比特率在时间维度上变化很大。除了吞吐量高估/低估问题外，视频码率高估/低估也影响自适应比特率(ABR)算法的效率。本文首先发现，对于SVC和基于瓦片的编码，360度视频在层和空间维度上都可以观察到很强的视频块大小相关性。然后，我们提出在360度视频调度框架中引入一个块大小预测器来预测：(1)基于同一分片段对应的基层块的未来增强层视频块的大小；(2)基于水平相邻的基层视频块的未来基层视频块。实验表明，添加了块大小预测器的ABR算法可以显著提高用户感知的视频播放质量。
Streaming 360-degree videos over today’s Internet is challenging due to its high bandwidth and low Motion-to-Photon latency requirements. Viewport adaptive streaming is a promising technique to cope with these challenges by allocating more bitrates to a user’s constrained field of view and streaming appropriate representations based on the user’s estimated throughput and fixation point. A typical dynamic adaptive streaming system uses a Media Presentation Description (MPD) file to describe the sustainable bitrates of a period for different quality representations. However, video bitrates vary significantly along the temporal dimension for Variable Bitrate (VBR) videos. In addition to the throughput overestimate/underestimate problem, video bitrate overestimate/underestimate also affects the efficiency of Adaptive Bitrate (ABR) algorithms.In this paper, we first discovered that for SVC and tile-based encoding, strong video chunk size correlation can be observed on both the layer and spatial dimensions for 360-degree videos. We then proposed to enhance the 360-degree video scheduling framework with a chunk size predictor that predicts the size of: (1) a future enhancement layer video chunk based on the corresponding base layer chunk of the same tiled segment; (2) future base layer video chunks based on the horizontally adjacent base layer video chunks. Experiments showed that ABR algorithms augmented by a chunk size predictor can significantly improve a user’s perceived video playback quality.
登录
查看更多内容
DOI：
10.1109/tcsvt.2007.905532
发表时间：
2007-09-01
影响因子：
8.4
作者：
Schwarz, Heiko;Marpe, Detlev;Wiegand, Thomas
通讯作者：
Wiegand, Thomas
影响因子：
--
作者：
Patrice Rondao-Alface;J. Macq;Nico Verzijp
通讯作者：
Patrice Rondao-Alface;J. Macq;Nico Verzijp
利用层相关性通过可扩展视频编码改进 DASH 调度
影响因子：
5.6
作者：
Zhang Guoqiang;Wu Yue;Han Xu;Gao Qian;Chen Jiasi
通讯作者：
Chen Jiasi
DOI：
10.1109/tcsvt.2003.815165
发表时间：
2003-07-01
影响因子：
8.4
作者：
Wiegand, T;Sullivan, GJ;Luthra, A
通讯作者：
Luthra, A
DOI：
10.1109/lcomm.2018.2848915
发表时间：
2018-09-01
期刊：
IEEE COMMUNICATIONS LETTERS
影响因子：
--
作者：
Thanh Cong Nguyen;Yun, Ji-Hoon
通讯作者：
Yun, Ji-Hoon