A new method for assessing content validity in model-based creation and iteration of eHealth interventions.
A new method for assessing content validity in model-based creation and iteration of eHealth interventions.
复制标题
一种评估基于模型的电子卫生干预措施创建和迭代内容有效性的新方法。
DOI：
10.2196/jmir.3811
复制
发表时间：
2015-04-15
影响因子：
7.4
通讯作者：
Winston FK
中科院分区：
文献类型：
--
作者：
Kassam-Adams N;Marsac ML;Kohser KL;Kenardy JA;March S;Winston FK
电子保健干预措施的出现，以解决心理问题和健康行为，创造了新的机会，包括能够优化干预活动的有效性，然后提供这些活动一致的大量需要的人。鉴于基于一个明确界定的变革理论模型的电子保健干预措施更有可能有效，而电子保健干预措施的开发成本可能很高，因此确保最终干预内容和活动与基本模型相匹配是一个关键步骤。我们建议应用“内容有效性”的概念作为一个重要的检查点，以评估在电子健康干预计划中拟议的干预活动在多大程度上是有效的（例如，相关的，可能是有效的）的具体机制的变化，每个人都打算目标和预期的目标人群的干预。本文的目的是定义内容的有效性，因为它适用于基于模型的电子健康干预开发，提出了一种可行的方法来评估内容的有效性，在这种情况下，并描述了这种新方法的实施过程中，基于Web的儿童干预的发展。我们设计了一个实用的5步方法，用于评估电子健康干预措施的内容有效性，包括定义关键干预目标，描绘干预活动-目标配对，确定专家，并使用调查工具收集每个活动与其预期目标的相关性的专家评级，其在实现预期目标方面的可能有效性，以及其与特定预期受众的适当性，然后使用定量和定性结果来确定可能需要修改的干预活动。我们应用这种方法在我们的应对教练基于网络的干预学龄儿童的发展。在应对教练内容效度的评估中，来自五个国家的15位专家对15个干预活动-目标配对进行了评估。根据定量指标，内容效度的相关性是优秀的，可能的有效性和年龄适当性良好。两项干预活动有项目级指标，表明需要开发团队进一步审查和可能的修订。该项目表明，内容有效性的评估可以是直接和可行的实施，这一评估的结果提供了有用的信息，为正在进行的开发和新的电子保健干预措施的迭代，补充其他信息来源（如，用户反馈，有效性评价）。这种方法可以在开发过程中的一个或多个点使用，以指导电子保健干预措施的持续优化。
The advent of eHealth interventions to address psychological concerns and health behaviors has created new opportunities, including the ability to optimize the effectiveness of intervention activities and then deliver these activities consistently to a large number of individuals in need. Given that eHealth interventions grounded in a well-delineated theoretical model for change are more likely to be effective and that eHealth interventions can be costly to develop, assuring the match of final intervention content and activities to the underlying model is a key step. We propose to apply the concept of “content validity” as a crucial checkpoint to evaluate the extent to which proposed intervention activities in an eHealth intervention program are valid (eg, relevant and likely to be effective) for the specific mechanism of change that each is intended to target and the intended target population for the intervention. The aims of this paper are to define content validity as it applies to model-based eHealth intervention development, to present a feasible method for assessing content validity in this context, and to describe the implementation of this new method during the development of a Web-based intervention for children. We designed a practical 5-step method for assessing content validity in eHealth interventions that includes defining key intervention targets, delineating intervention activity-target pairings, identifying experts and using a survey tool to gather expert ratings of the relevance of each activity to its intended target, its likely effectiveness in achieving the intended target, and its appropriateness with a specific intended audience, and then using quantitative and qualitative results to identify intervention activities that may need modification. We applied this method during our development of the Coping Coach Web-based intervention for school-age children. In the evaluation of Coping Coach content validity, 15 experts from five countries rated each of 15 intervention activity-target pairings. Based on quantitative indices, content validity was excellent for relevance and good for likely effectiveness and age-appropriateness. Two intervention activities had item-level indicators that suggested the need for further review and potential revision by the development team. This project demonstrated that assessment of content validity can be straightforward and feasible to implement and that results of this assessment provide useful information for ongoing development and iterations of new eHealth interventions, complementing other sources of information (eg, user feedback, effectiveness evaluations). This approach can be utilized at one or more points during the development process to guide ongoing optimization of eHealth interventions.
登录
查看更多内容
影响因子：
7.4
作者：
Webb TL;Joseph J;Yardley L;Michie S
通讯作者：
Michie S
影响因子：
3.6
作者：
March, Sonja;Spence, Susan H.;Donovan, Caroline L.
通讯作者：
Donovan, Caroline L.
影响因子：
4.6
作者：
Meiser-Stedman, Richard;Dalgleish, Tim;Smith, Patrick
通讯作者：
Smith, Patrick
DOI：
10.1097/chi.0b013e318067e288
发表时间：
2007-08-01
影响因子：
13.3
作者：
Smith, Patrick;Yule, William;Clark, David M.
通讯作者：
Clark, David M.
影响因子：
5
作者：
Marsac ML;Kohser KL;Winston FK;Kenardy J;March S;Kassam-Adams N
通讯作者：
Kassam-Adams N