Texture-Aware Spherical Rotation for High Efficiency Omnidirectional Intra Video Coding
Texture-Aware Spherical Rotation for High Efficiency Omnidirectional Intra Video Coding
复制标题
用于高效全向视频内编码的纹理感知球形旋转
DOI：
10.1109/tcsvt.2022.3192665
复制
发表时间：
2022-12
影响因子：
8.4
通讯作者：
Yo-Sung Ho
中科院分区：
文献类型：
--
作者：
Jinyong Pi;Yun Zhang;Linwei Zhu;Jinzhi Lin;Yo-Sung Ho
为了适应现有的视频编码标准，全向视频通常从三维（3D）球体投影到二维（2D）平面。然而，这种投影将导致几何拉伸失真和边界不连续，这可能降低编码效率。在本文中，我们提出了一种基于球面旋转的全向视频编码（SROVC）方法，它利用了球面旋转的全向视频的纹理特性。首先，提出了SROVC框架，并提出了全遍历球面旋转（FSR）算法，通过帧级率失真优化（RDO）来获得最佳旋转角度。其次，为了获得与FSR相当的编码增益和更低的计算复杂度，提出了一种纹理感知的球面旋转（TSR）方法来预测旋转角度。最后，为了进一步降低复杂度和保持编码效率，提出了一种面向组的TSR（G-TSR）方法，其中组长度是统计确定的。大量的实验表明，所提出的TSR和G-TSR计划可以实现比特率降低4.38%，0.94%和0.89%的平均立方体映射投影（CMP）为基础的高效全向视频编码。此外，TSR方案在三种基于CMP的投影格式下平均节省了0.91%至1.19%的比特率，并且对于X、Y和Z轴的联合旋转节省了1.89%的比特率。
To adapt to the existing video coding standards, omnidirectional videos are usually projected from Three-Dimensional (3D) sphere to Two-Dimensional (2D) plane. However, this projection will cause geometrical stretching distortion and boundary discontinuity, which may degrade coding efficiency. In this paper, we present a Spherical Rotation based Omnidirectional Video Coding (SROVC) method, which exploits the textural properties of omnidirectional videos with spherical rotation. Firstly, SROVC framework is presented and Full-traversal Spherical Rotation (FSR) is developed to derive the optimal rotation angle with frame-level Rate Distortion Optimization (RDO). Secondly, to achieve comparable coding gains and lower computational complexity when compared with FSR, a Texture-aware Spherical Rotation (TSR) method is proposed to predict the rotation angle. Finally, to further reduce complexity and maintain coding efficiency, a Group-oriented TSR (G-TSR) approach is presented, in which the group length is statistically determined. Extensive experiments demonstrate that the proposed TSR and G-TSR schemes can achieve bit rate reductions up to 4.38%, 0.94% and 0.89% on average for CubeMap Projection (CMP) based high efficiency omnidirectional video coding. Additionally, the TSR scheme achieves bit rate saving from 0.91% to 1.19% on average under three more CMP-based projection formats, and 1.89% for joint rotation of X, Y, and Z axes.
登录
查看更多内容
DOI：
10.1109/tcsvt.2021.3101484
发表时间：
2020-08
影响因子：
8.4
作者：
Xinju Wu;Yun Zhang;Chunling Fan;Junhui Hou;S. Kwong
通讯作者：
Xinju Wu;Yun Zhang;Chunling Fan;Junhui Hou;S. Kwong
基于机器学习的视频编码优化：调查
影响因子：
8.1
作者：
Yun Zhang;Sam Kwong;Shiqi Wang
通讯作者：
Shiqi Wang
影响因子：
20.6
作者：
M. Hannuksela;Ye-Kui Wang
通讯作者：
M. Hannuksela;Ye-Kui Wang
影响因子：
3.9
作者：
Sun, Yule;Lu, Ang;Yu, Lu
通讯作者：
Yu, Lu
DOI：
10.1109/tcsvt.2019.2945698
发表时间：
2020-05
影响因子：
8.4
作者：
Xiaoyu Xiu;Philippe Hanhart;Yuwen He;Yan Ye;R. Vanam;Taoran Lu;Fangjun Pu;P. Yin
通讯作者：
Xiaoyu Xiu;Philippe Hanhart;Yuwen He;Yan Ye;R. Vanam;Taoran Lu;Fangjun Pu;P. Yin