Inference procedures for assessing interobserver agreement among multiple raters
Inference procedures for assessing interobserver agreement among multiple raters
复制标题
DOI：
10.1111/j.0006-341x.2001.00584.x
复制
发表时间：
2001-06-01
期刊：
影响因子：
1.9
通讯作者：
Klar, N
中科院分区：
文献类型：
--
作者：
Altaye, M;Donner, A;Klar, N
我们提出了一个新的程序，用于构建推理的一个措施，观察者间的协议，在研究中涉及一个二元的结果和多个评分。所提出的程序基于应用于相关二项模型的卡方拟合优度检验（Bahadur，1961，Studies in Item Analysis and Prediction，158-176），是Donner和Eliasziw（1992，Statistics in Medicine 11，1511-1519）针对两名评分者开发的拟合优度程序的扩展。新的程序示出提供的置信区间覆盖水平，接近标称的参数组合的范围很广。该程序还提供了一个样本量公式，可用于确定此类研究所需的受试者和评分者数量。
We propose a new procedure for constructing inferences about a measure of interobserver agreement in studies involving a binary outcome and multiple raters. The proposed procedure, based on a chi-square goodness-of-fit test as applied to the correlated binomial model (Bahadur, 1961, in Studies in Item Analysis and Prediction, 158-176), is an extension of the goodness-of-fit procedure developed by Donner and Eliasziw (1992, Statistics in Medicine 11, 1511-1519) for the case of two raters. The new procedure is shown to provide confidence-interval coverage levels that are close to nominal over a wide range of parameter combinations. The procedure also provides a sample-size formula that may be used to determine the required number of subjects and raters for such studies.