Measuring the Quality of Delivery of Prevention

描述（由申请人提供）：众所周知，交付质量会影响药物滥用预防计划的有效性。随着以研究为基础的项目的广泛传播，拥有评估交付质量的工具对于记录和理解项目成功和失败的条件变得非常重要。目前没有衡量预防方案执行质量的标准方法。该项目的目标是创建一个标准化的工具，用于评估基于研究的药物滥用预防计划的交付质量。拟议的措施将文件，通过观察，访谈和文件的搜索，四个方面的交付质量：坚持，适应，互动和剂量。第一阶段将包括以下内容：（1）与预防研究人员、方案管理人员、方案开发人员和政策制定者一起完成一项重点小组研究，以确定评估交付质量的标准。(2)开发一种工具，该工具将使用具有高评分者间可靠性的简洁措施来评估依从性、适应性、交互性和剂量。(3)完成两项正式的心理测量学研究。第一次将与研究生研究助理进行，他们将使用录像带和先前完成的芝加哥教师研究中的存档信息评估教学质量。第二项心理测量研究将涉及社区服务机构，将观察他们向学生提供预防方案。在这两项研究中，非研究员观察员和研究人员与执行质量的专业知识将提供评级，将审查评级者之间的可靠性。我们假设，分析结果将证明评估是高度可靠的，易于使用，适合的任务，并确定的价值，潜在的用户。(4)将为当地方案观察员编制一套原型培训材料，并由目标用户审查其可行性。随着以研究为基础的预防方案得到广泛传播，拥有评估交付质量的工具对于记录和了解方案成功和失败的条件变得非常重要。目前没有衡量预防方案执行质量的标准方法。该项目的目标是创建一个标准化的工具，用于评估基于研究的药物滥用预防计划的交付质量。

DESCRIPTION (provided by applicant): Quality of delivery is known to moderate the effectiveness of drug abuse prevention programs. As research-based programs become widely disseminated, having tools for assessing quality of delivery becomes important for documenting and understanding the conditions under which programs succeed and fail. There are currently no standard methods for measuring the quality with which prevention programs are delivered. The goal of this project is to create a standardized tool for assessing quality of delivery for research-based drug abuse prevention programs. The proposed measure will document, through observations, interviews, and the search of documents, four dimensions of quality of delivery: adherence, adaptation, interactivity, and dosage. Phase I will include the following: (1) The completion of a focus group study with prevention researchers, program administrators, program developers, and policy makers to define criteria for assessing quality of delivery. (2) The development of a tool that will assess adherence, adaptation, interactivity, and dosage using succinct measures that have high inter-rater reliability. (3) The completion of two formal psychometric studies. The first will be conducted with graduate research assistants who will assess quality of delivery using videotapes and archived information from a previously completed study of Chicago teachers. The second psychometric study will involve community service agencies who will be observed as they deliver prevention programming to students. In both studies, non-researcher observers and researchers with expertise in quality of implementation will provide ratings which will be examined for inter-rater reliability. We hypothesize that the results of analysis will demonstrate the assessment to be highly reliable, easy-to-use, appropriate to the task, and of defined value to potential users. (4) A set of prototype training materials for local program observers will be developed and examined by target users for feasibility. As research-based prevention programs become widely disseminated, having tools for assessing quality of delivery becomes important for documenting and understanding the conditions under which programs succeed and fail. There are currently no standard methods for measuring the quality with which prevention programs are delivered. The goal of this project is to create a standardized tool for assessing quality of delivery for research-based drug abuse prevention programs.