Development of the AGREE II, part 2: assessment of validity of items and tools to support application

Development of the AGREE II, part 2: assessment of validity of items and tools to support application
复制标题

DOI:
10.1503/cmaj.091716
复制
发表时间:
2010-07-13
影响因子:
14.6
通讯作者:
Makarski, Julie
Makarski, Julie
中科院分区:
医学1区
文献类型:
--
作者:
Brouwers, Melissa C.;Kho, Michelle E.;Makarski, Julie

文献摘要

被引文献

相似文献

背景我们建立了一个研究计划,以改善实践指南的开发、报告和评估。我们评估了结构效度的项目和用户手册中的测试版的AGREE II。方法我们设计的指南摘录,反映高质量和低质量的指南内容的23个项目中的21工具。我们设计了两个研究包,每个项目的一个低质量版本和一个高质量版本被随机分配到每个包。我们将30名参与者随机分配到两个包中的一个。结果在所有病例中,21例患者中有18例患者对高质量内容的评价高于低质量内容,差异有统计学意义(p < 0.05)。参与者认为该手册易于使用,有助于区分不同质量的指南,所有分数均高于七分制的中点。就如何改进beta-AGREE II的项目和手册提出了大量反馈意见。我们使用这些结果和我们在第1部分中提出的研究结果来修改项目和用户手册。我们建议将AGREE II(可在www.agreetrust.org获得)作为指南制定、报告和评估的修订标准。
Background We established a program of research to improve the development, reporting and evaluation of practice guidelines. We assessed the construct validity of the items and user's manual in the beta version of the AGREE II.Methods We designed guideline excerpts reflecting high- and low-quality guideline content for 21 of the 23 items in the tool. We designed two study packages so that one low-quality and one high-quality version of each item were randomly assigned to each package. We randomly assigned 30 participants to one of the two packages. Participants reviewed and rated the guideline content according to the instructions of the user's manual and completed a survey assessing the manual.Results In all cases, content designed to be of high quality was rated higher than low-quality contents in 18 of 21 cases, the differences were significant (p < 0.05). The manual was rated by participants as appropriated easy to used and helpful in differentiating guidelines of varying quality, with all scores above the mid-point of the sevene-point scale. Considerable feedback was offered on how the items and manual of the beta-AGREE II could be improved.Interpretation The validity of the items was established and the user's manual was rated as highly useful by users. We used these results and those of our study presented in part 1 to modify the items and user's manual. We recommend AGREE II (available at www.agreetrust.org) as the revised standard for guideline development, reporting and evaluation.