Diagnostic accuracy and interobserver variability of CO-RADS in patients with suspected coronavirus disease-2019: a multireader validation study.
Diagnostic accuracy and interobserver variability of CO-RADS in patients with suspected coronavirus disease-2019: a multireader validation study.
复制标题
DOI：
10.1007/s00330-020-07273-y
复制
发表时间：
2021-04
影响因子：
5.9
通讯作者：
Carbone I
中科院分区：
文献类型：
--
作者：
Bellini D;Panvini N;Rengo M;Vicini S;Lichtner M;Tieghi T;Ippoliti D;Giulio F;Orlando E;Iozzino M;Ciolfi MG;Montechiarello S;d'Ambrosio U;d'Adamo E;Gambaretto C;Panno S;Caldon V;Ambrogi C;Carbone I
目的：进行一项多读者验证研究，以评价新冠肺炎报告和数据系统(CO-RADS)评分的观察者间变异性和诊断肺部受累的准确性。这项回顾性研究包括2020年3月至2020年5月连续接受胸部CT和逆转录聚合酶链式反应(RT-PCR)检查的疑似新冠肺炎的患者。具有不同专业水平的12名读者分别使用新冠肺炎的CO-RADS方案对每个CT进行评分。计算受试者工作特征(ROC)曲线以研究诊断率。Fleiss‘s kappa统计量用于评估读者之间的一致性。共有572名患者(平均年龄63±20[标准差]；329名男性；142名新冠肺炎患者和430名非新冠肺炎患者)接受了评估。所有读者对CO-RADS评分有中等一致性(Fleiss‘K=0.43[95%CI 0.42-0.44])，CO-RADS 1类基本一致(Fleiss’K=0.61[95%CI 0.60-0.62])，CO-RADS 5类基本一致(Fleiss‘K=0.60[95%CI 0.58-0.61])。ROC分析显示CORADS评分≥4为最佳阈值，曲线下累积面积为0.72(95%可信区间66~78%)，敏感性61%(95%可信区间52~69%)，特异性81%(95%可信区间77~84%)。CoRADS在不同专业水平的读者中显示出较高的诊断准确率和中等的评价者间一致性。特异性比之前认为的要高，这可能会导致重新考虑CT在这一临床环境中的作用。·新冠肺炎报告和数据系统(CO-RADS)显示新冠肺炎对肺部受累的诊断准确率很高，平均AUC0.72(95%可信区间67-75%)。·以≥-4为阈值，其敏感性和特异性分别为61%(95%CI 52-69%)和81%(95%CI 76-84%)。·不同专业水平的读者对CO-RADS的评级总体上是中等一致的(Fleiss‘K=0.43[95%CI 0.42-0.44])。本文的在线版本(10.1007/s00330-020-07273-y)包含向授权用户提供的补充材料。
To conduct a multireader validation study to evaluate the interobserver variability and the diagnostic accuracy for the lung involvement by COVID-19 of COVID-19 Reporting and Data System (CO-RADS) score. This retrospective study included consecutive symptomatic patients who underwent chest CT and reverse transcriptase-polymerase chain reaction (RT-PCR) from March 2020 to May 2020 for suspected COVID-19. Twelve readers with different levels of expertise independently scored each CT using the CO-RADS scheme for detecting pulmonary involvement by COVID-19. Receiver operating characteristic (ROC) curves were computed to investigate diagnostic yield. Fleiss’ kappa statistics was used to evaluate interreader agreement. A total of 572 patients (mean age, 63 ± 20 [standard deviation]; 329 men; 142 patients with COVID-19 and 430 patients without COVID-19) were evaluated. There was a moderate agreement for CO-RADS rating among all readers (Fleiss’ K = 0.43 [95% CI 0.42–0.44]) with a substantial agreement for CO-RADS 1 category (Fleiss’ K = 0.61 [95% CI 0.60–0.62]) and moderate agreement for CO-RADS 5 category (Fleiss’ K = 0.60 [95% CI 0.58–0.61]). ROC analysis showed the CO-RADS score ≥ 4 as the optimal threshold, with a cumulative area under the curve of 0.72 (95% CI 66–78%), sensitivity 61% (95% CI 52–69%), and specificity 81% (95% CI 77–84%). CO-RADS showed high diagnostic accuracy and moderate interrater agreement across readers with different levels of expertise. Specificity is higher than previously thought and that could lead to reconsider the role of CT in this clinical setting. • COVID-19 Reporting and Data System (CO-RADS) demonstrated a good diagnostic accuracy for lung involvement by COVID-19 with an average AUC of 0.72 (95% CI 67–75%). • When a threshold of ≥ 4 was used, sensitivity and specificity were 61% (95% CI 52–69%) and 81% (95% CI 76–84%), respectively. • There was an overall moderate agreement for CO-RADS rating across readers with different levels of expertise (Fleiss’ K = 0.43 [95% CI 0.42–0.44]). The online version of this article (10.1007/s00330-020-07273-y) contains supplementary material, which is available to authorized users.
登录
查看更多内容
Stard 2015：用于报告诊断准确性研究的基本项目的更新列表。
DOI：
10.1136/bmj.h5527
发表时间：
2015-10-28
期刊：
BMJ (Clinical research ed.)
影响因子：
--
作者：
Bossuyt PM;Reitsma JB;Bruns DE;Gatsonis CA;Glasziou PP;Irwig L;Lijmer JG;Moher D;Rennie D;de Vet HC;Kressel HY;Rifai N;Golub RM;Altman DG;Hooft L;Korevaar DA;Cohen JF;STARD Group
通讯作者：
STARD Group
影响因子：
5
作者：
Raptis, Constantine A.;Hammer, Mark M.;Henry, Travis S.
通讯作者：
Henry, Travis S.
影响因子：
19.7
作者：
Fang, Yicheng;Zhang, Huangqi;Ji, Wenbin
通讯作者：
Ji, Wenbin
影响因子：
1.9
作者：
DELONG, ER;DELONG, DM;CLARKEPEARSON, DI
通讯作者：
CLARKEPEARSON, DI
DOI：
10.1148/ryct.2020200152
发表时间：
2020-04-01
期刊：
RADIOLOGY-CARDIOTHORACIC IMAGING
影响因子：
--
作者：
Simpson, Scott;Kay, Fernando U.;Litt, Harold
通讯作者：
Litt, Harold