Prevalence effect in a laboratory environment
Prevalence effect in a laboratory environment
复制标题
DOI：
10.1148/radiol.2281020709
复制
发表时间：
2003-07-01
期刊：
影响因子：
19.7
通讯作者：
Warfel, TE
中科院分区：
文献类型：
--
作者：
Gur, D;Rockette, HE;Warfel, TE
目的：测量不同患病率水平下的观察者表现。材料和方法：进行一项多观察者多异常受试者操作特征(ROC)研究，以评估患病率对观察者表现的影响。14名观察者，包括8名教职员工、2名研究员和4名住院医生，使用嵌套研究设计解释了1,632张具有5个患病率水平的后前胸图像。性能比较是通过使用多读者多阶段方法来评估患病率从28%(249人中的69人)到2%(1577人中的31人)对诊断准确性的影响。结果：ROC曲线下的面积显示，在研究的实验条件下，对于任何异常、病例组或读者，不能作为患病率的函数来衡量显著的影响(P>；0.05)。在不同患病率水平和不同读者群体中，审查和报告病例所需的平均时间没有显著差异(P>；0.05)。结论：本研究结果和规模的一致性表明，在实验室条件下，如果流行率影响存在，其幅度很小；因此，它不太可能改变来自此类研究的结论。(C)RSNA，2003年。
PURPOSE: To measure observer performance at various levels of prevalence.MATERIALS AND METHODS: A multiobserver multiabnormality receiver operating characteristic (ROC) study to assess the effect of prevalence on observer performance was conducted. Fourteen observers, including eight faculty members, two fellows, and four residents, interpreted 1,632 posteroanterior chest images with five prevalence levels by using a nested study design. Performance comparisons were accomplished by using a multireader multicase approach to assess the effect of prevalence from 28% (69 of 249) to 2% (31 of 1,577) on diagnostic accuracy. The mean times required to review and report a case were analyzed and compared for different levels of prevalence and readers' experience.RESULTS: Area under the ROC curve demonstrated that, with the study experimental conditions, no significant effect could be measured as a function of prevalence (P >.05) for any abnormality, group of cases, or readers. There were no significant differences (P >.05) in the mean times required to review and report cases at different prevalence levels and with different groups of readers.CONCLUSION: The consistency in the results and the size of this study suggest that with laboratory conditions, if a prevalence effect exists, it is quite small in magnitude; hence, it will not likely alter conclusions derived from such studies. (C) RSNA, 2003.