Reviewing measures of outcome: reliability of data extraction
Reviewing measures of outcome: reliability of data extraction
复制标题
DOI：
10.1111/j.1365-2753.2003.00411.x
复制
发表时间：
2004-05-01
影响因子：
2.4
通讯作者：
Lamb, SE
中科院分区：
文献类型：
--
作者：
Haywood, KL;Hargreaves, J;Lamb, SE
基本原理、目的和目标 尽管人们广泛接受评估健康结果措施的必要领域，但对数据提取方法（例如清单）的开发或评估却很少。本研究旨在评估使用为健康结果指标的结构化审查而开发的新电子数据库从已发表文章中提取数据的评估者间可靠性。方法 在健康结果评估中被认为重要的领域为使用新电子数据库提取数据的清单提供了基础。数据库使用Microsoft Access 2000 软件（Microsoft Corporation，2000）。培训结束后，三名独立审稿人使用电子数据库从七篇选定的文章中提取数据，并根据预先定义的标准评估文章和衡量质量。比较数据提取的一致性和项目内容。通过多重 kappa 相关性评估审稿人之间对分类数据的一致性。结果分析表明评审者之间在数据提取的各个方面都达成了强烈的一致。然而，发表的文章缺乏清晰度影响了清楚地确定结果衡量标准的能力。结论 审稿人之间的高水平协议支持在数据提取中使用多名经过培训的审稿人，以使用所描述的检查表和 Access 软件来审阅结果测量。电子数据库支持从已发表的文章中进行标准化数据提取，受益于数据提取和数据输入的一步组合。建议对数据库进行调整，以支持对其他健康状况评估中采用的结果措施进行结构化审查。
Rationale, aims and objectives Although there is wide acceptance of the necessary domains for the evaluation of measures of health outcome, there has been little development or evaluation of methods of data extraction, such as checklists. This study aimed to assess the inter-rater reliability of data extraction from published articles using a new electronic database developed for structured reviews of health outcome measures. Methods Domains considered important in the evaluation of measures of health outcome provided the foundation for a checklist for data extraction using a new electronic database. The database utilized Microsoft Access 2000 software (Microsoft Corporation, 2000). Following training, three independent reviewers extracted data from seven selected articles using the electronic database, and assessed article and measure quality against pre-defined criteria. Data extraction was compared for consistency and item content. Inter-reviewer agreement for categorical data was assessed by multiple kappa correlation. Results Analysis demonstrated strong agreement between reviewers for all aspects of data extraction. However, lack of clarity in published articles affected the ability to clearly identify measures of outcome. Conclusions The high level of inter-reviewer agreement supports the use of multiple trained reviewers in data extraction for reviews of measures of outcome using the checklist and Access software described. The electronic database supports standardized data extraction from published articles, benefiting from the combination of data extraction and data entry in a single step. Adaptation of the database to support structured reviews of measures of outcome adopted in the evaluation of other health states is proposed.