Engagement and Retention: Measuring Breadth and Depth of Participant Use of an Online Intervention
Engagement and Retention: Measuring Breadth and Depth of Participant Use of an Online Intervention
复制标题
DOI：
10.2196/jmir.1430
复制
发表时间：
2010-10-01
影响因子：
7.4
通讯作者：
Johnson, Christine Cole
中科院分区：
文献类型：
--
作者：
Couper, Mick P.;Alexander, Gwen L.;Johnson, Christine Cole
背景：互联网为我们提供了工具（用户指标或参数）来评估用户如何与在线干预进行交互。对这些矛盾的分析可以导致设计的改进。目的：目的是探讨在线干预中在线参与者参与的质量。我们在一项旨在促进水果和蔬菜消费的在线干预的替代版本的随机对照试验中分析了这一悖论。方法：志愿者被随机分为三个研究组中的一个，其中包括几个在线课程。我们创建了2个间接测量广度和深度的方法来测量不同的维度和项目参与的动态，这是基于对网页访问和在线使用干预材料的时间的参数分析。使用多元回归评估敬业度对饮食摄入的保留和变化的影响。结果：2513名入组参与者完成了基线调查。其中，86.3% （n = 2168）在3个月时完成随访调查，79.6% （n = 2027）在6个月时完成，79.4% （n = 1995）在12个月时完成。2个定制干预组比未定制干预组表现出更大的敬业度（P < 0.01）。参与的广度和深度测量与随访调查的完成程度显著相关（比值比[OR]分别= 4.11和2.12，P值均< 0.001）。参与的广度测量也与一个关键的研究结果，即水果和蔬菜消费量的平均增加显著正相关（P < 0.001）。结论：通过探索参与者对在线干预的暴露，para在解释定制在增加参与者参与干预方面的作用方面是有价值的。在干预组的控制下，更大的参与也与参与者的留存率和干预的一个关键结果——饮食改变的积极变化有关。本文展示了对评估在线健康干预措施的para - ata捕获和分析的效用。
Background: The Internet provides us with tools (user metrics or paradata) to evaluate how users interact with online interventions. Analysis of these paradata can lead to design improvements.Objective: The objective was to explore the qualities of online participant engagement in an online intervention. We analyzed the paradata in a randomized controlled trial of alternative versions of an online intervention designed to promote consumption of fruit and vegetables.Methods: Volunteers were randomized to 1 of 3 study arms involving several online sessions. We created 2 indirect measures of breadth and depth to measure different dimensions and dynamics of program engagement based on factor analysis of paradata measures of Web pages visited and time spent online with the intervention materials. Multiple regression was used to assess influence of engagement on retention and change in dietary intake.Results: Baseline surveys were completed by 2513 enrolled participants. Of these, 86.3% (n = 2168) completed the follow-up surveys at 3 months, 79.6% (n = 2027) at 6 months, and 79.4% (n = 1995) at 12 months. The 2 tailored intervention arms exhibited significantly more engagement than the untailored arm (P < .01). Breadth and depth measures of engagement were significantly associated with completion of follow-up surveys (odds ratios [OR] = 4.11 and 2.12, respectively, both P values < .001). The breadth measure of engagement was also significantly positively associated with a key study outcome, the mean increase in fruit and vegetable consumption (P < .001).Conclusions: By exploring participants' exposures to online interventions, paradata are valuable in explaining the effects of tailoring in increasing participant engagement in the intervention. Controlling for intervention arm, greater engagement is also associated with retention of participants and positive change in a key outcome of the intervention, dietary change. This paper demonstrates the utility of paradata capture and analysis for evaluating online health interventions.