COEFFICIENT KAPPA - SOME USES, MISUSES, AND ALTERNATIVES
COEFFICIENT KAPPA - SOME USES, MISUSES, AND ALTERNATIVES
复制标题
DOI：
10.1177/001316448104100307
复制
发表时间：
1981-01-01
影响因子：
2.7
通讯作者：
PREDIGER, DJ
中科院分区：
文献类型：
--
作者：
BRENNAN, RL;PREDIGER, DJ
本文考虑了一些适当和不适当的使用系数kappa和替代kappa-like统计。讨论仅限于这些统计量的可靠性和有效性研究中测量与分类数据的一致性的特征。特别考虑到是否边际是固定的先验，或自由变化的假设。在信度研究中，当边际是固定的，系数Kappa被认为是适当的。然而，当一个或两个边缘值可以自由变化时，建议将Kappa中的“机会”项替换为1/n，其中n是类别的数量。在有效性研究中，我们建议考虑是否需要一个超越“机会”或超越最佳的先验策略，采用基本利率的改善指数。在前一种情况下，考虑因素与可靠性研究中的考虑因素相似，其中标准测量的边际被视为固定的。在后一种情况下，建议使用标准措施的最大边际比例来代替Kappa中的“机会”一词。这些统计之间的相似性和差异进行了讨论，并与合成数据说明。
This paper considers some appropriate and inappropriate uses of coefficient kappa and alternative kappa-like statistics. Discussion is restricted to thedescriptivecharacteristics of these statistics for measuring agreement with categorical data in studies of reliability and validity. Special consideration is given to assumptions about whether marginals are fixed a priori, or free to vary. In reliability studies, when marginals are fixed, coefficient kappa is found to be appropriate. When either or both of the marginals are free to vary, however, it is suggested that the "chance" term in kappa be replaced by 1/n, wherenis the number of categories. In validity studies, we suggest considering whether one wants an index of improvement beyond "chance" or beyond the best a priori strategy employing base rates. In the former case, considerations are similar to those in reliability studies with the marginals for the criterion measure considered as fixed. In the latter case, it is suggested that the largest marginal proportion for the criterion measure be used in place of the "chance" term in kappa. Similarities and differences among these statistics are discussed and illustrated with synthetic data.