Measuring the Quality of Delivery of Prevention

描述(由申请人提供)：众所周知，提供的质量会降低药物滥用预防计划的有效性。随着基于研究的项目得到广泛传播，拥有用于评估交付质量的工具对于记录和了解项目成功和失败的条件变得重要。目前还没有标准方法来衡量提供预防方案的质量。该项目的目标是创建一种标准化工具，用于评估以研究为基础的药物滥用预防计划的交付质量。拟议的措施将通过观察、访谈和搜索文件，记录交付质量的四个方面：坚持、适应、互动和剂量。第一阶段将包括以下内容：(1)与预防研究人员、项目管理人员、项目开发人员和政策制定者一起完成焦点小组研究，以确定评估交付质量的标准。(2)开发一种工具，该工具将使用简明的方法评估依从性、适应性、互动性和剂量，并具有较高的评分者间可靠性。(3)完成两项正式的心理测量学研究。第一项研究将由研究生研究助理进行，他们将使用录像带和之前完成的对芝加哥教师的研究中的存档信息来评估教学质量。第二项心理测量学研究将涉及社区服务机构，他们在向学生提供预防规划时将被观察。在这两项研究中，非研究员观察员和在执行质量方面有专长的研究人员将提供评级，并将检查评分者之间的可靠性。我们假设分析结果将证明评估是高度可靠的、易于使用的、适合任务的，并且对潜在用户具有确定的价值。(4)将为当地项目观察员编写一套原型培训材料，并由目标用户审查其可行性。随着以研究为基础的预防方案得到广泛传播，拥有评估交付质量的工具对于记录和了解方案成功和失败的条件变得重要。目前还没有标准方法来衡量提供预防方案的质量。该项目的目标是创建一种标准化工具，用于评估以研究为基础的药物滥用预防计划的交付质量。

DESCRIPTION (provided by applicant): Quality of delivery is known to moderate the effectiveness of drug abuse prevention programs. As research-based programs become widely disseminated, having tools for assessing quality of delivery becomes important for documenting and understanding the conditions under which programs succeed and fail. There are currently no standard methods for measuring the quality with which prevention programs are delivered. The goal of this project is to create a standardized tool for assessing quality of delivery for research-based drug abuse prevention programs. The proposed measure will document, through observations, interviews, and the search of documents, four dimensions of quality of delivery: adherence, adaptation, interactivity, and dosage. Phase I will include the following: (1) The completion of a focus group study with prevention researchers, program administrators, program developers, and policy makers to define criteria for assessing quality of delivery. (2) The development of a tool that will assess adherence, adaptation, interactivity, and dosage using succinct measures that have high inter-rater reliability. (3) The completion of two formal psychometric studies. The first will be conducted with graduate research assistants who will assess quality of delivery using videotapes and archived information from a previously completed study of Chicago teachers. The second psychometric study will involve community service agencies who will be observed as they deliver prevention programming to students. In both studies, non-researcher observers and researchers with expertise in quality of implementation will provide ratings which will be examined for inter-rater reliability. We hypothesize that the results of analysis will demonstrate the assessment to be highly reliable, easy-to-use, appropriate to the task, and of defined value to potential users. (4) A set of prototype training materials for local program observers will be developed and examined by target users for feasibility. As research-based prevention programs become widely disseminated, having tools for assessing quality of delivery becomes important for documenting and understanding the conditions under which programs succeed and fail. There are currently no standard methods for measuring the quality with which prevention programs are delivered. The goal of this project is to create a standardized tool for assessing quality of delivery for research-based drug abuse prevention programs.