Interrater agreement and interrater reliability: Key concepts, approaches, and applications
Interrater agreement and interrater reliability: Key concepts, approaches, and applications
复制标题
DOI：
10.1016/j.sapharm.2012.04.004
复制
发表时间：
2013-05-01
影响因子：
3.9
通讯作者：
Chen, Timothy F.
中科院分区：
文献类型：
--
作者：
Gisev, Natasa;Bell, J. Simon;Chen, Timothy F.
评价评价者之间的一致性和评价者之间的可靠性可以应用于许多不同的背景，在社会和行政药学研究中经常遇到。这项研究的目的是强调评价者间一致性和评价者间可靠性之间的主要区别；描述评估评价者间一致性和评价者间可靠性的关键概念和方法；并提供它们在社会和行政药学领域研究中的应用实例。这是对评委间一致性和评委间可靠性指标的描述性回顾。它概述了这些指数在社会和行政药学研究中的实际应用和解释。评分者之间的一致性指数评估两个或更多独立评分者的回答一致的程度。评分员之间的可靠性指数评估评分员在多大程度上一致地区分不同的回答。存在一些指数，一些常见的例子包括Kappa、Kendall协调系数、Bland-Altman曲线图和类内相关系数。为选择适当的指数提供了指导。总之，选择适当的指数来评价评价者之间的一致性或评价者之间的可靠性取决于许多因素，包括进行研究的背景、正在考虑的变量类型以及进行评估的评分员人数。(C)2013 Elsevier Inc.保留所有权利。
Evaluations of interrater agreement and interrater reliability can be applied to a number of different contexts and are frequently encountered in social and administrative pharmacy research. The objectives of this study were to highlight key differences between interrater agreement and interrater reliability; describe the key concepts and approaches to evaluating interrater agreement and interrater reliability; and provide examples of their applications to research in the field of social and administrative pharmacy. This is a descriptive review of interrater agreement and interrater reliability indices. It outlines the practical applications and interpretation of these indices in social and administrative pharmacy research. Interrater agreement indices assess the extent to which the responses of 2 or more independent raters are concordant. Interrater reliability indices assess the extent to which raters consistently distinguish between different responses. A number of indices exist, and some common examples include Kappa, the Kendall coefficient of concordance, Bland-Altman plots, and the intraclass correlation coefficient. Guidance on the selection of an appropriate index is provided. In conclusion, selection of an appropriate index to evaluate interrater agreement or interrater reliability is dependent on a number of factors including the context in which the study is being undertaken, the type of variable under consideration, and the number of raters making assessments. (C) 2013 Elsevier Inc. All rights reserved.