Roe and Metz identical-test simulation model for validating multi-reader methods of analysis for comparing different radiologic imaging modalities.
Roe and Metz identical-test simulation model for validating multi-reader methods of analysis for comparing different radiologic imaging modalities.
复制标题
Roe 和 Metz 相同测试模拟模型，用于验证多读取器分析方法，以比较不同的放射成像模式。
DOI：
10.1117/1.jmi.10.s1.s11916
复制
发表时间：
2023
期刊：
影响因子：
--
通讯作者：
Hillis,StephenL
中科院分区：
文献类型：
--
作者：
Hillis,StephenL
目的模拟多阅片人多病例（MRMC）数据的最常用模型是Roe和梅斯模型，该模型模拟了诊断成像研究的疾病置信度评级，由Roe和梅斯于1997年提出，后来由Hillis（2012）、修道院等人推广。（2013），以及Gallas和Hillis（2014）。这些模型已被用于评估MRMC分析和样本量方法。在这些论文中提出的用于评估I型错误的模型是空模型，其中每个测试的受试者操作特征曲线下的预期面积是相同的。然而，对于这些空模型，如果两个检验相同，则存在其他不存在的差异。上面提到的论文都没有讨论如何制定一个空模型，也是一个相同的测试模型，其中两个测试在所有方面都是相同的。本文的目的是展示如何制定一个罗伊和梅斯相同的测试模型，并显示其有效性验证的误差协方差约束所采用的Obuchowski-Roclove. Approach（1995年）对于一个给定的罗伊和梅斯模型，相应的Roe-and-梅斯相同-测试模型是通过修改罗伊和梅斯零模型的假设下，这两个测试是相同的。使用Roe和梅斯恒等检验模型模拟的数据建立了避免负方差估计的Rocker模型约束。它还表明，负方差估计可以发生在非平凡率时，两个测试是不相同的，但有点“接近”是identical.ConclusionsThe本文的研究结果是重要的，因为它最近已被证明（希利斯，2022年），常用的MRMC方法提出的Gallas（2006年）和Gallas等人。（2009）使用与无约束Obuchowski-Rocket方法相同的检验统计量。
PurposeThe most frequently used model for simulating multi-reader multi-case (MRMC) data that emulate confidence-of-disease ratings from diagnostic imaging studies has been the Roe and Metz model, proposed by Roe and Metz in 1997 and later generalized by Hillis (2012), Abbey et al. (2013), and Gallas and Hillis (2014). These models have been used for evaluating MRMC analysis and sample size methods. The models suggested in these papers for assessing type I error have been null models, where the expected area under the receiver-operating-characteristic curve across readers is the same for each test. However, for these null models, there are other differences that would not exist if the two tests were identical. None of the papers mentioned above discuss how to formulate a null model that is also an identical-test model, where the two tests are identical in all respects. The purpose of this paper is to show how to formulate a Roe and Metz identical-test model and to show its usefulness for validating the error covariance constraints employed by the Obuchowski-Rockette (1995) method.ApproachFor a given Roe-and-Metz model, the corresponding Roe-and-Metz identical-test model is derived by modifying the Roe and Metz null model under the assumption that the two tests are identical.ResultsThe importance of the Obuchowski-Rockette model constraints for avoiding negative variance estimates is established using data simulated from the Roe and Metz identical-test model. It is also shown that negative variance estimates can occur at nontrivial rates when the two tests are not identical but somewhat “close” to being identical.ConclusionsThe findings of this paper are important because it has recently been shown (Hillis, 2022) that the commonly used MRMC method proposed by Gallas (2006) and Gallas et al. (2009) uses the same test statistic as the unconstrained Obuchowski-Rockette method.