INTEGRATION AND GENERALIZATION OF KAPPAS FOR MULTIPLE RATERS
INTEGRATION AND GENERALIZATION OF KAPPAS FOR MULTIPLE RATERS
复制标题
DOI:
10.1037/0033-2909.88.2.322
复制
发表时间:
1980-01-01
影响因子:
22.4
通讯作者:
CONGER, AJ
中科院分区:
文献类型:
--
作者:
CONGER, AJ
JA Cohen's kappa (1960) for measuring agreement between 2 raters, using a nominal scale, has been extended for use with multiple raters by RJ Light (1971) and JL Fleiss (1971). In the present article, these indices are analyzed and reformulated in terms of agreement statistics based on all pairs of raters. It has been argued that simultaneous agreement among all raters could provide an alternative basis for measuring multiple-rater agreement; however, agreement among raters can actually be considered to be an arbitrary choice along a continuum ranging from agreement for a pair of raters to agreement among all raters. Using this generalized concept of g-wise agreement, multiple-rater kappas are extended, interrelated, and illustrated.(4 ref)(PsycINFO Database Record (c) 2016 APA, all rights reserved)