Agreement and Information in the Reliability of Coding
Agreement and Information in the Reliability of Coding
复制标题
DOI：
10.1080/19312458.2011.568376
复制
发表时间：
2011-01-01
影响因子：
11.4
通讯作者：
Krippendorff, Klaus
中科院分区：
文献类型：
--
作者：
Krippendorff, Klaus
评估数据制作过程的可靠性的系数，即编码文本、转录访谈或将观察归类为可分析的术语，大多是根据一组编码员、观察员、法官或测量仪器展示的协议来概念化的。当变化很小时，可靠性系数揭示了它们对一个经常被忽视的现象的依赖性，即可靠性数据提供的关于编码过程的可靠性或其生成的数据的信息量。本文探讨了可靠性的概念、简单一致性、纠正该一致性的三个偶然性概念以及信息缺失的来源，并发展了两种关于可靠性的信息度量，类似于统计检验的力量，旨在作为传统可靠性系数的伴侣，特别是Krippendorff(2004，pp.221-250；Hayes&Krippendorff，2007)的阿尔法。
Coefficients that assess the reliability of data-making processes, that is, coding text, transcribing interviews, or categorizing observations into analyzable terms, are mostly conceptualized in terms of the agreement a set of coders, observers, judges, or measuring instruments exhibit. When variation is low, reliability coefficients reveal their dependency on an often neglected phenomenon, the amount of information that reliability data provide about the reliability of the coding process or the data it generates. This paper explores the concept of reliability, simple agreement, three conceptions of chance to correct that agreement, and sources of information deficiency, and it develops two measures of information about reliability, akin to the power of a statistical test, intended as a companion to traditional reliability coefficients, especially Krippendorff's (2004, pp. 221-250; Hayes & Krippendorff, 2007) alpha.