Implementation of the Radiological Society of North America Expert Consensus Guidelines on Reporting Chest CT Findings Related to COVID-19: A Multireader Performance Study
Implementation of the Radiological Society of North America Expert Consensus Guidelines on Reporting Chest CT Findings Related to COVID-19: A Multireader Performance Study
复制标题
DOI:
10.1148/ryct.2020200276
复制
发表时间:
2020-10-01
期刊:
影响因子:
--
通讯作者:
Little, Brent P.
中科院分区:
文献类型:
--
作者:
Som, Avik;Lang, Min;Little, Brent P.
Purpose: To assess the performance of the Radiological Society of North America (RSNA) guidelines and quantify interobserver variability in application of the guidelines in patients undergoing chest CT for suspected coronavirus disease 2019 (COVID-19) pneumonia.Materials and Methods: A retrospective search from January 15, 2020 to March 30, 2020 identified 89 consecutive CT scans whose radio -logic report mentioned COVID-19. One positive or two negative reverse-transcription polymerase chain reaction tests for COVID-19 were considered the reference standard for diagnosis. Each chest CT scan was evaluated using RSNA guidelines by nine readers (six fellowship-trained thoracic radiologists and three radiology resident trainees). Clinical information was obtained from the electronic medical record.Results: There was strong concordance of findings between radiology training levels with agreement ranging from 60% to 86% among attending physicians and trainees (K, 0.43 to 0.86). Sensitivity and specificity of typical CT findings for COVID-19 per the RSNA guidelines were on average 86% (range, 72%-94%) and 80.2% (range, 75%-93%), respectively. Combined typical and indeterminate findings had a sensitivity of 97.5% (range, 94%-100%) and specificity of 54.7% (range, 37%-62%). A total of 163 disagreements were seen out of 801 observations (79.6% total agreement). Uncertainty in classification primarily derived from difficulty in ascertain-ing peripheral distribution, multiple dominant disease processes, or minimal disease.Conclusion: The typical appearance category for COVID-19 CT reporting has an average sensitivity of 86% and specificity rate of 80%. There is reasonable interreader agreement and good reproducibility across various levels of experience.Supplemental material is available for this article.(c) RSNA, 2020