Conducting online expert panels: a feasibility and experimental replicability study.
Conducting online expert panels: a feasibility and experimental replicability study.
复制标题
DOI：
10.1186/1471-2288-11-174
复制
发表时间：
2011-12-23
影响因子：
4
通讯作者：
Dalal S
中科院分区：
文献类型：
--
作者：
Khodyakov D;Hempel S;Rubenstein L;Shekelle P;Foy R;Salem-Schatz S;O'Neill S;Danz M;Dalal S
本文有两个目标。首先，我们探讨进行在线专家小组，以促进大量的地理分布的利益相关者之间的共识发现的可行性。第二，我们测试了在四个不同大小的面板上的面板结果的可复制性。我们让119名小组成员参与了一个迭代过程，以确定持续质量改进（CQI）的定义特征。我们使用兰德的ExpertLens过程，通过三个为期一周的阶段，进行了四个不同大小的平行在线面板。在第一阶段，参与者对潜在的定义性CQI特征进行评级。在第二阶段，他们使用异步的匿名讨论板在线讨论评级结果。在第三阶段，小组成员重新评估了第一阶段的功能，并报告了他们作为参与者的经验。66%的受邀专家参加了所有三个阶段。62%的第一阶段参与者参与了第二阶段的讨论，其中87%完成了第三阶段的讨论。小组不同意，测量平均绝对偏差中位数（MAD-M），减少小组反馈和讨论后，在36个43个判断CQI功能。在第三阶段之后，四个小组之间的协议是公平的（四向kappa = 0.36）;他们同意11个CQI特征中的5个的状态。完成后调查的结果表明，参与者普遍对在线过程感到满意。与较小小组的参与者相比，较大小组的参与者更有可能同意他们已经讨论了彼此的观点。举办在线专家小组讨论会是可行的，其目的是促进在地理上分散的参与者之间达成共识。在线方法对于围绕一系列卫生服务研究主题吸引大量不同利益相关者群体可能是实用的，并且可以帮助进行多个平行小组以测试小组结论的可重复性。
This paper has two goals. First, we explore the feasibility of conducting online expert panels to facilitate consensus finding among a large number of geographically distributed stakeholders. Second, we test the replicability of panel findings across four panels of different size. We engaged 119 panelists in an iterative process to identify definitional features of Continuous Quality Improvement (CQI). We conducted four parallel online panels of different size through three one-week phases by using the RAND's ExpertLens process. In Phase I, participants rated potentially definitional CQI features. In Phase II, they discussed rating results online, using asynchronous, anonymous discussion boards. In Phase III, panelists re-rated Phase I features and reported on their experiences as participants. 66% of invited experts participated in all three phases. 62% of Phase I participants contributed to Phase II discussions and 87% of them completed Phase III. Panel disagreement, measured by the mean absolute deviation from the median (MAD-M), decreased after group feedback and discussion in 36 out of 43 judgments about CQI features. Agreement between the four panels after Phase III was fair (four-way kappa = 0.36); they agreed on the status of five out of eleven CQI features. Results of the post-completion survey suggest that participants were generally satisfied with the online process. Compared to participants in smaller panels, those in larger panels were more likely to agree that they had debated each others' view points. It is feasible to conduct online expert panels intended to facilitate consensus finding among geographically distributed participants. The online approach may be practical for engaging large and diverse groups of stakeholders around a range of health services research topics and can help conduct multiple parallel panels to test for the reproducibility of panel conclusions.
登录
查看更多内容
影响因子：
--
作者：
Campbell, SM;Shield, T;Gask, L
通讯作者：
Gask, L
影响因子：
3.8
作者：
MCKENNA, HP
通讯作者：
MCKENNA, HP
影响因子：
--
作者：
Danz, M. S.;Rubenstein, L. V.;Shekelle, P. G.
通讯作者：
Shekelle, P. G.
影响因子：
1.9
作者：
LANDIS, JR;KOCH, GG
通讯作者：
KOCH, GG
影响因子：
22.4
作者：
CONGER, AJ
通讯作者：
CONGER, AJ