Generalizability of behavioral observations: a clarification of interobserver agreement and interobserver reliability.
Generalizability of behavioral observations: a clarification of interobserver agreement and interobserver reliability.
复制标题
DOI：
--
复制
发表时间：
1979-03
期刊：
影响因子：
--
通讯作者：
R. Berk
中科院分区：
文献类型：
--
作者：
R. Berk
评述了16个观察者间一致性指标和6种估计观察者间信度系数的方法。一致的统计数据被发现是不精确的，在心理测量学上是有限的，并且在精神发育迟滞研究中通常遇到的不同的类别和数量数据集方面相对僵化。其中五项可靠性统计数据提供了对一致性的准确估计，但也有类似的局限性。只有类内相关性--概括性理论方法似乎提供了处理可靠性评估的复杂性所需的精确度、全面性和灵活性。描述了一个基本的概化模型，并用群体和单项研究数据进行了说明。
Sixteen indices of interobserver agreement and six methods for estimating coefficients of interobserver reliability were critiqued. The agreement statistics were found to be imprecise, limited psychometrically, and relatively inflexible in terms of the diverse categorical and quantitative data sets typically encountered in mental retardation research. Five of the reliability statistics produced precise estimates of agreement, yet possessed similar limitations. Only the intraclass correlation--generalizability theory approach seemed to offer the precision, comprehensiveness, and flexibility required to deal with the complexity of reliability assessment. A basic generalizability model was described and illustrated with group and single-subject research data.