Measuring the Quality of Delivery of Prevention

衡量预防的质量

• 批准号: 7909777
• 负责人: William B. Hansen
• 金额: $ 43.18万
• 依托单位: TANGLEWOOD RESEARCH, INC.
• 依托单位国家: 美国
• 财政年份: 2007
• 资助国家: 美国
• 起止时间: 2007-09-30 至 2012-04-30
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/7909777
• 关键词: Adherence; Administrator; Adopted; Affect; Area; Awareness; Back; Bar Codes; Benchmarking; Collection; Communities; Congresses; Data; Data Collection; Databases; Development; Dimensions; Educational process of instructing; Effectiveness; Elements; Ensure; Environment; Evaluation; Evidence based program; Failure; Funding; Future; Generations; Goals; Government Agencies; In Situ; Indium; Intervention; Interview; Link; Lizards; Manuals; Measures; Methods; Modeling; Monitor; Online Systems; Outcome; Participant; Performance; Phase; Policy Maker; Prevention; Prevention Research; Prevention program; Printing; Process; Program Evaluation; Provider; Qualifying; Reporting; Research; Research Personnel; Schools; Small Business Innovation Research Grant; Standardization; Students; Surveys; System; Testing; Training; Validity and Reliability; Video Recording; Work; base; design; dosage; drug abuse prevention; federal policy; improved; meetings; phase 2 study; prevention evaluation; programs; prototype; public health relevance; satisfaction; standardize measure; success; teacher; tool; wasting

DESCRIPTION (provided by applicant): Quality of delivery is known to moderate the effectiveness of drug abuse prevention programs. As research-based programs become widely disseminated, having tools for assessing quality of delivery becomes important for documenting and understanding the conditions under which programs succeed and fail. There are currently no standard methods for measuring the quality with which prevention programs are delivered. The goal of this project is to create a standardized tool for assessing quality of delivery for research-based drug abuse prevention programs.. Commercially, the addition of this product to an existing product (Evaluation Lizard) that provides pretest and posttest surveys tailored to the evaluation of evidence-based programs, will significantly strengthen our niche in the prevention evaluation marketplace. The broad aim of this SBIR project is to develop a tool that will allow the collection of standardized measures of quality of delivery across a wide range of programs being disseminated as a result of their inclusion on the NREPP model programs list and newly developed programs that wish to qualify for future inclusion. During Phase I, we interviewed prevention researchers, program administrators, program developers, and policy makers to define and elaborate on the essential criteria for defining dimensions of quality of implementation. Based on their input, we designed a prototype system that allowed us to accomplish the following tasks: (1) create session and program rating form templates for selected NREPP facilitator-delivered prevention programs, (2) link templates to a database to track form information (program, session, observer, teacher, and date of creation), and (3) create PDF forms printed remotely that can be linked by bar code back to the database. The prototype system measures dosage, adherence, engagement, and adaptation. We also developed a manual for using the system. While functional for the pilot test, this system is not yet fully automated and does not include numerous elements. During Phase II, our first task will be to complete the quality of delivery data gathering system for collecting quality of delivery data that will include tools for assessing adherence, adaptation, dosage, engagement, and measures of overall quality. We will develop online applications that will allow data collected about quality of program delivery to be linked and jointly analyzed in various ways with pretest-posttest outcome data from students. To ensure that the application works as intended, we will conduct alpha and beta tests of all component applications. We will develop an online system for conducting basic analysis and preparing reports that meets the needs of five separate professional groups: program implementers, program administrators, program developers, prevention researchers, and policy makers. We will conduct a field trial with 10 prevention agencies and school districts to demonstrate that the quality of delivery data collection and reporting system provide program implementers, prevention agency administrators and supervisors, and government agency prevention administrators with information useful to documenting and understanding the process of prevention program delivery. Established prevention agencies will adopt the use of the Evaluation Lizard system, including both pretest-posttest surveys and quality of delivery report forms. We hypothesize that participating groups will report satisfaction with the functioning of the system and will report increased awareness of how prevention is being implemented in their area of purview. Further, we will conduct a reliability and validity sub-study in which participating agencies will be asked to select one teacher to video record the lessons they teach so that observation data can be included in the analysis in order to demonstrate reliability and validity of the measures. PUBLIC HEALTH RELEVANCE: The field of drug abuse prevention research has identified numerous interventions that can be effective; however, unless programs are implemented well in practice, they are unlikely to achieve their desired effect, and the effort and expense of these programs may be wasted. The need to assess quality of implementation is widely recognized, but, to date, there is no unified strategy for gathering or reporting about data. The value of the product we are proposing is that it would provide an easy-to-use system for documenting quality of program implementation that could be linked to outcome data.

描述（由申请人提供）：已知交付质量可以缓解预防药物滥用计划的有效性。随着基于研究的计划的广泛传播，拥有评估交付质量的工具对于记录和了解计划成功和失败的条件很重要。目前尚无衡量预防计划的质量的标准方法。该项目的目的是创建一种标准化工具，用于评估基于研究的药物滥用预防计划的交付质量。在商业上，将该产品添加到现有产品（评估蜥蜴）中，该产品提供了针对评估循证计划评估的预测试和后测试调查，将在预防评估市场中显着增强我们的利基市场。该SBIR项目的广泛目的是开发一种工具，该工具将允许收集由于将其纳入NREPP模型计划列表列表和新开发的计划，以便有资格获得未来的包容性，因此可以在广泛的计划中收集标准化的交付质量度量。在第一阶段，我们采访了预防研究人员，计划管理人员，计划开发人员和政策制定者，以定义并详细说明定义实施质量的基本标准。 Based on their input, we designed a prototype system that allowed us to accomplish the following tasks: (1) create session and program rating form templates for selected NREPP facilitator-delivered prevention programs, (2) link templates to a database to track form information (program, session, observer, teacher, and date of creation), and (3) create PDF forms printed remotely that can be linked by bar code back to the database.原型系统测量剂量，依从性和适应性。我们还开发了用于使用该系统的手册。虽然用于试验测试的功能，但该系统尚未完全自动化，也不包含许多元素。在第二阶段期间，我们的第一个任务是完成收集交付数据质量的交付数据收集系统的质量，其中包括评估依从性，适应性，剂量，参与度和整体质量度量的工具。我们将开发在线应用程序，这些应用程序将允许收集有关计划交付质量的数据，并以各种方式与学生的预测试结果数据链接并共同分析。为了确保应用程序按预期工作，我们将对所有组件应用程序进行alpha和beta测试。我们将开发一个在线系统，用于进行基本分析并准备满足五个独立专业团体需求的报告：计划实施者，计划管理人员，计划开发人员，预防研究人员和政策制定者。我们将与10个预防机构和学区进行现场试验，以证明交付数据收集和报告系统的质量为计划实施者，预防机构管理员和主管以及政府机构预防管理员提供有关记录和了解预防计划交付过程有用的信息。既定的预防机构将采用评估蜥蜴系统的使用，包括预测试调查和交付报告表的质量。我们假设参与小组将报告对系统功能的满意度，并将报告对在Purview领域实施预防的意识提高。此外，我们将进行一个可靠性和有效性子研究，其中将要求参与机构选择一位教师来记录他们所教的课程，以便可以将观察数据包括在分析中，以证明这些措施的可靠性和有效性。 公共卫生相关性：预防药物滥用领域已经确定了许多有效的干预措施；但是，除非实践中实施得很好，否则它们不太可能达到所需的效果，并且可能会浪费这些计划的努力和费用。评估实施质量的需求已得到广泛认可，但是迄今为止，还没有收集或报告有关数据的统一策略。我们提出的产品的价值是，它将提供一个易于使用的系统，用于记录程序实施质量，该系统可以链接到结果数据。