Quality Assessment of Stereoscopic 3D Image Compression by Binocular Integration Behaviors
Quality Assessment of Stereoscopic 3D Image Compression by Binocular Integration Behaviors
复制标题
DOI：
10.1109/tip.2014.2302686
复制
发表时间：
2014-04-01
影响因子：
10.6
通讯作者：
Wu, Ja-Ling
中科院分区：
文献类型：
--
作者：
Lin, Yu-Hsun;Wu, Ja-Ling
三维图像质量的客观评价方法对于压缩标准的制定和各种三维多媒体应用具有重要意义。与二维图像相比，三维图像的质量评估面临着更多的新挑战，如非对称立体压缩、深度感知和虚拟视图合成。此外，广泛使用的2D图像质量度量（例如，PSNR和SSIM）不能直接应用于处理这些新引入的挑战。当3D图像是测试目标时，计算出的客观测量值和主观测量的平均意见得分（MOS）之间的低相关性可以验证这一说法。为了应对这些新的挑战，本文除了传统的2D图像度量，双目整合行为-双目组合和双目频率整合，被用作衡量立体3D图像质量的基础。通过对公开的立体图像数据库进行主观评价，验证了所提出的度量的有效性。实验结果表明，测量的MOS和建议的指标之间可以达到显着的一致性，其中它们之间的相关系数可以达到0.88。此外，我们发现，所提出的指标也可以很好地解决合成的彩色加深度3D图像的质量评估。因此，我们相信双眼整合行为是发展3D影像客观品质评估的重要因素。
The objective approaches of 3D image quality assessment play a key role for the development of compression standards and various 3D multimedia applications. The quality assessment of 3D images faces more new challenges, such as asymmetric stereo compression, depth perception, and virtual view synthesis, than its 2D counterparts. In addition, the widely used 2D image quality metrics (e.g., PSNR and SSIM) cannot be directly applied to deal with these newly introduced challenges. This statement can be verified by the low correlation between the computed objective measures and the subjectively measured mean opinion scores (MOSs), when 3D images are the tested targets. In order to meet these newly introduced challenges, in this paper, besides traditional 2D image metrics, the binocular integration behaviors-the binocular combination and the binocular frequency integration, are utilized as the bases for measuring the quality of stereoscopic 3D images. The effectiveness of the proposed metrics is verified by conducting subjective evaluations on publicly available stereoscopic image databases. Experimental results show that significant consistency could be reached between the measured MOS and the proposed metrics, in which the correlation coefficient between them can go up to 0.88. Furthermore, we found that the proposed metrics can also address the quality assessment of the synthesized color-plus-depth 3D images well. Therefore, it is our belief that the binocular integration behaviors are important factors in the development of objective quality assessment for 3D images.