Implementing 360 video tiled streaming system
Implementing 360 video tiled streaming system
复制标题
实施360视频平铺流系统
DOI：
10.1145/3204949.3208119
复制
发表时间：
2018
期刊：
影响因子：
--
通讯作者：
Eun‐Seok Ryu
中科院分区：
文献类型：
--
作者：
Jangwoo Son;Dongmin Jang;Eun‐Seok Ryu
与高质量的VR相比，当前VR的计算能力和带宽都是有限的。为了克服这些局限性，本研究提出了一种新的视点相关视频流方法，该方法使用高效视频编码(HEVC)和HEVC的可伸缩性扩展(SHVC)来传输360度视频。所提出的SHVC和HEVC编码器生成可以独立传输分片的比特流。因此，可以以块为单位提取由所提出的编码器生成的比特流。根据标准中讨论的内容，所提出的提取程序提取与视区相对应的瓦片的比特流。由所提出的方法提取的SHVC视频比特流由(I)表示整个360度区域的SHVC基本层(BL)和(Ii)用于使用视区(感兴趣区域(ROI))瓦片选择性流传输的SHVC增强层(EL)组成。当使用所提出的HEVC编码器时，低分辨率和高分辨率序列分别被编码为SHVC的BL和EL。该方法通过流传输带有ROI的低分辨率和选择性EL块，而不是流传输整个高质量的360度视频，从而降低了网络带宽和解码端的计算复杂度。实验结果表明，带宽降低了47%以上。
The computing power and bandwidth of the current VR are limited when compared to the high-quality VR. To overcome these limits, this study proposes a new viewport dependent streaming method that transmits 360-degree videos using the high efficiency video coding (HEVC) and the scalability extension of HEVC (SHVC). The proposed SHVC and HEVC encoders generate the bitstream that can transmit tiles independently. Therefore, the bitstream generated by the proposed encoder can be extracted in units of tiles. In accordance with what is discussed in the standard, the proposed extractor extracts the bitstream of the tiles corresponding to the viewport. SHVC video bitstream extracted by the proposed methods consist of (i) an SHVC base layer (BL) which represents the entire 360-degree area and (ii) an SHVC enhancement layer (EL) for selective streaming with viewport (region of interest (ROI)) tiles. When the proposed HEVC encoder is used, low and high resolution sequences are separately encoded as the BL and EL of SHVC. By streaming the BL(low resolution) and selective EL(high resolution) tiles with ROI instead of streaming whole high quality 360-degree video, the proposed method can reduce the network bandwidth as well as the computational complexity on the decoder side. Experimental results show more than 47% bandwidth reduction.