Comparison of Objective Image Quality Metrics to Expert Radiologists' Scoring of Diagnostic Quality of MR Images
Comparison of Objective Image Quality Metrics to Expert Radiologists' Scoring of Diagnostic Quality of MR Images
复制标题
DOI：
10.1109/tmi.2019.2930338
复制
发表时间：
2020-04-01
影响因子：
10.6
通讯作者：
Beyea, Steven
中科院分区：
文献类型：
--
作者：
Mason, Allister;Rioux, James;Beyea, Steven
图像质量指标(IQM)，如均方根误差(RMSE)和结构相似指数(SSIM)，通常用于评估和优化加速磁共振成像(MRI)采集和重建策略。然而，目前还不清楚这些指数与放射科医生对诊断图像质量的感知有多大关系。在这项研究中，我们比较了五位放射科医生与RMSE、SSIM和其他潜在有用的IQM的图像质量评分：峰值信噪比(PSNR)多尺度SSIM(MSSSIM)、信息加权SSIM(IWSSIM)、梯度幅度相似偏差(GMSD)、特征相似指数(FSIM)、高动态范围可见差异预测(HDRVDP)、噪声质量度量(NQM)和视觉信息保真度(VIF)。这项比较使用的是大脑和腹部的MR图像数据库，这些图像已经因噪声、模糊、欠采样、运动和小波压缩而回溯退化，总共有414幅退化图像。五位放射科医生共给出了1017分主观评分。通过Spearman等级相关系数(SROCC)测量IQM的表现，并检验IQM评分残差和放射科医生评分之间的统计学差异。当考虑综合所有影像类型的所有放射科医生的分数计算的SROCC时，RMSE和SSIM的SROCC低于研究中包括的其他六个IQM(VIF、FSIM、NQM、GMSD、IWSSIM和HDRVDP)。在任何情况下，SSIM都没有比RMSE具有更高的SROCC或显著更小的残差。在今后的影像研究中，在选择IQM时应考虑这些结果。
Image quality metrics (IQMs) such as root mean square error (RMSE) and structural similarity index (SSIM) are commonly used in the evaluation and optimization of accelerated magnetic resonance imaging (MRI) acquisition and reconstruction strategies. However, it is unknown how well these indices relate to a radiologist's perception of diagnostic image quality. In this study, we compare the image quality scores of five radiologists with the RMSE, SSIM, and other potentially useful IQMs: peak signal to noise ratio (PSNR) multi-scale SSIM (MSSSIM), information-weighted SSIM (IWSSIM), gradient magnitude similarity deviation (GMSD), feature similarity index (FSIM), high dynamic range visible difference predictor (HDRVDP), noise quality metric (NQM), and visual information fidelity (VIF). The comparison uses a database of MR images of the brain and abdomen that have been retrospectively degraded by noise, blurring, undersampling, motion, and wavelet compression for a total of 414 degraded images. A total of 1017 subjective scores were assigned by five radiologists. IQM performance was measured via the Spearman rank order correlation coefficient (SROCC) and statistically significant differences in the residuals of the IQM scores and radiologists' scores were tested. When considering SROCC calculated from combining scores from all radiologists across all image types, RMSE and SSIM had lower SROCC than six of the other IQMs included in the study (VIF, FSIM, NQM, GMSD, IWSSIM, and HDRVDP). In no case did SSIM have a higher SROCC or significantly smaller residuals than RMSE. These results should be considered when choosing an IQM in future imaging studies.