HIGH AGREEMENT BUT LOW KAPPA .2. RESOLVING THE PARADOXES
HIGH AGREEMENT BUT LOW KAPPA .2. RESOLVING THE PARADOXES
复制标题
DOI：
10.1016/0895-4356(90)90159-m
复制
发表时间：
1990-01-01
影响因子：
7.2
通讯作者：
FEINSTEIN, AR
中科院分区：
文献类型：
--
作者：
CICCHETTI, DV;FEINSTEIN, AR
综合索引为两个观察者之间的二元一致性的四重表提供了一个单一的总结表达式。在现有的其他综合指标中，没有一个指标能令人满意地解决与p0和。kappa出现的矛盾。只有将ppox和pneg作为观察者积极和消极决定的比例一致度的两个单独指标，才能避免这个问题。这两个指标类似于诊断标记测试中一致性的敏感性和特异性，在.kappa中产生机会校正时形成的悖论。是两个指标的增量与边际总量增量的乘积。如果只使用一个综合指数来比较不同的表现在观察者可变性，悖论。是可取的，因为它们适当地“惩罚”了ppos和pneg中的不平等。但是，为了更好地理解结果并计划改进观察员的表现，.kappa的综合值。应该总是伴随着单独的ppos和pneg值。
An omnibus index offers a single summary expression for a fourfold table of binary concordance among two observers. Among the available other omnibus indexes, none offers a satisfactory solution for the paradoxes that occur with p0 and .kappa.. The problem can be avoided only by using ppox and pneg as two separate indexes of proportionate agreement in the observers'' positive and negative decisions. These two indexes, which are analogous to sensitivity and specificity for concordance in a diagnostic marker test, create the paradoxes formed when the chance correction in .kappa. is calculated as a product of the increment in the two indexes and the increment in marginal totals. If only a single omnibus index is used to compared different performances in observer variability, the paradoxes of .kappa. are desirable since they appropriately "penalize" inequalities in ppos and pneg. For better understanding of results and for planning improvements in the observers'' performance, however, the omnibus value of .kappa. should always be accompanied by separate individual values of ppos and pneg.