A permutation test sensitive to differences in areas for comparing ROC curves from a paired design
A permutation test sensitive to differences in areas for comparing ROC curves from a paired design
复制标题
DOI：
10.1002/sim.2149
复制
发表时间：
2005-09-30
影响因子：
2
通讯作者：
Gur, D
中科院分区：
文献类型：
--
作者：
Bandos, AI;Rockette, HE;Gur, D
受试者工作特征（ROC）曲线下面积（AUC）是诊断程序总体性能的广泛接受的总结指标，并且在比较两种诊断系统时经常使用AUC之间的差异。我们开发了一种精确的非参数统计程序，用于比较配对设计设置中的两条ROC曲线。基于受试者特定等级评定的所有排列的检验在形式上是对AUC差异的替代敏感的ROC曲线的等同性检验。在广泛的参数范围内使用广泛的模拟评估所提出的测试的操作特性。所提出的程序可以很容易地在实验ROC数据集上实现。对于小样本和基本参数，是常见的诊断成像的实验研究中的测试具有良好的操作特性，是更强大的比传统的非参数程序AUC comparisons.We还推导出一个渐近版本的测试，它使用一个精确的估计方差的排列空间，并提供了一个很好的近似，即使当样本量很小。这种渐近过程是一个简单而精确的近似精确的测试，是有用的大样本量的精确测试可能是计算负担。版权所有（C）2005约翰威利父子有限公司
The area under the receiver operating characteristic (ROC) curve (AUC) is a widely accepted summary index of the overall performance of diagnostic procedures and the difference between AUCs is often used when comparing two diagnostic systems. We developed an exact non-parametric statistical procedure for comparing two ROC curves in paired design settings. The test which is based on all permutations of the subject specific rank ratings is formally a test for equality of ROC curves that is sensitive to the alternatives of AUC difference. The operating characteristics of the proposed test were evaluated using extensive simulations over a wide range of parameters.The proposed procedure can be easily implemented in experimental ROC data sets. For small samples and for underlying parameters that are common in experimental studies in diagnostic imaging the test possesses good operating characteristics and is more powerful than the conventional non-parametric procedure for AUC comparisons.We also derived an asymptotic version of the test which uses an exact estimate of the variance in the permutation space and provides a good approximation even when the sample sizes are small. This asymptotic procedure is a simple and precise approximation to the exact test and is useful for large sample sizes where the exact test may be computationally burdensome. Copyright (C) 2005 John Wiley & Sons, Ltd.