Unequal Error Protection Aided Region of Interest Aware Wireless Panoramic Video
Unequal Error Protection Aided Region of Interest Aware Wireless Panoramic Video
复制标题
不等差错保护辅助感兴趣区域感知无线全景视频
DOI：
10.1109/access.2019.2921880
复制
发表时间：
2019
期刊：
影响因子：
3.9
通讯作者：
Lajos Hanzo
中科院分区：
文献类型：
--
作者：
Yongkai Huo;Xu Wang;Peichang Zhang;Jianmin Jiang;Lajos Hanzo
全景视频以其完美的沉浸式远程呈现被认为是不久的将来的视频格式的选择，因为它们可以360度覆盖指定的场景。然而，观看者可能将他们的特定注意力集中在作为全景视频场景的一部分的完美嘴唇同步视频上，因此仅具有帧的剩余部分的周边视觉。因此，对全景视频感兴趣区域分配更强的保护是直观的。作为一种解决方案，我们提出了感兴趣区域感知不等错误保护（ROI-UEP），用于高效视频编码（HEVC）序列的无线传输。具体地，全景帧的ROI可以被认为在观看中心的120°角度范围内，这可以根据头戴式显示器的观看轨迹来估计。然后，通过最小化期望的视频失真，将为ROI信号找到最合适的不等前向纠错（FEC）编码率。此外，所谓的加权峰值信噪比（WPSNR）被提出用于评估重建的全景视频的质量，其中像素的权重被考虑用于计算由相关像素引起的失真。仿真结果表明，基于ROI的等差错保护（ROI-EEP）方案的WPSNR超过EEP方案10 dB，而ROI-UEP方案在信道$E_{B}/N_{0}$为6 dB时，WPSNR进一步提高到9.4 dB。
Panoramic video with its flawless immersive tele-presence is considered to be the near-future video format of choice since they carry 360 degree coverage of the designated scenes. However, the viewers may focus their specific attention on perfectly lip-synchronized video as part of the panoramic video scene, hence only have a peripheral vision of the remaining parts of a frame. Therefore, it is intuitive to allocate stronger protection to the panoramic video region of interest. As a solution, we propose Region of Interest Aware Unequal Error Protection (ROI-UEP) for wireless transmission of high-efficiency video code (HEVC) sequences. Specifically, the ROI of a panoramic frame may be deemed to be within the 120° angular range of the viewing center, which can be estimated from the viewing trajectory of a head mounted display. Then, the most appropriate unequal forward error correction (FEC) coding rates will be found for the ROI signals by minimizing the expected video distortion. Moreover, the so-called weighted peak signal-to-noise ratio (WPSNR) is proposed for evaluating the quality of the reconstructed panoramic video, where the weights of pixels are taken into account for calculating the distortion caused by the related pixels. Our simulation results show that the ROI based equal error protection (ROI-EEP) scheme substantially outperforms the EEP by a WPSNR of more than 10 dB, while the ROI-UEP scheme further improves its ROI-EEP counterpart by a WPSNR of 9.4 dB at a channel $E_{b}/N_{0}$ of 6 dB.