Content analysis in mass communication: Assessment and reporting of intercoder reliability
Content analysis in mass communication: Assessment and reporting of intercoder reliability
复制标题
DOI：
10.1093/hcr/28.4.587
复制
发表时间：
2002-10-01
影响因子：
5
通讯作者：
Bracken, CC
中科院分区：
文献类型：
--
作者：
Lombard, M;Snyder-Duch, J;Bracken, CC
作为一种专门用于研究信息的方法，内容分析是大众传播研究的基础。编码器间可靠性，更具体地称为编码器间一致性，是独立法官在评估消息特性时做出相同编码决策的程度的度量，并且是该方法的核心。然而，有几个标准和可访问的指导方针，用于评估和报告编码器间的可靠性，或软件工具来计算它的适当程序，因此，似乎有可能是如何在内容分析的这一关键要素是评估和报告在出版的大众传播研究很少的一致性。在回顾了相关概念、指数和工具之后，利用1994年至1998年间传播文献中发表的内容分析对200项研究进行了内容分析，以描述该领域的实践特征。结果表明，大众传播研究人员往往无法评估（或至少报告）编码器间的可靠性，往往依赖于百分比协议，一个过于自由的指数。根据审查和这些结果，就内容分析这一重要方面的评估和报告程序提出了具体准则。
As a method specifically intended for the study of messages, content analysis is fundamental to mass communication research. Intercoder reliability, more specifically termed intercoder agreement, is a measure of the extent to which independent judges make the same coding decisions in evaluating the characteristics of messages, and is at the heart of this method. Yet there are few standard and accessible guidelines available regarding the appropriate procedures to use to assess and report intercoder reliability, or software tools to calculate it. As a result, it seems likely that there is little consistency in how this critical element of content analysis is assessed and reported in published mass communication studies. Following a review of relevant concepts, indices, and tools, a content analysis of 200 studies utilizing content analysis published in the communication literature between 1994 and 1998 is used to characterize practices in the field. The results demonstrate that mass communication researchers often fail to assess (or at least report) intercoder reliability and often rely on percent agreement, an overly liberal index. Based on the review and these results, concrete guidelines are offered regarding procedures for assessment and reporting of this important aspect of content analysis.