Beyond Evaluation Use: Determining the Effect of Individual Project Participation on the Influence of STEM Overall Program Evaluations

超越评估用途：确定单个项目参与对 STEM 总体项目评估的影响

• 批准号: 0438545
• 负责人: Frances Lawrenz
• 金额: --
• 依托单位: University of Minnesota-Twin Cities
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2004
• 资助国家: 美国
• 起止时间: 2004-12-15 至 2009-11-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0438545&HistoricalAwards=false
• 关键词: Beyond; Evaluation; Use; Determining; Effect

The project is designed to contrast the type and scope of influence of different approaches to program evaluation in order to increase the field's understanding of how evaluation results are used when evaluations are conducted for a large agency with both national and local implications. The project is grounded in two theoretical bases: 1) evaluation use, and 2) participation in evaluation. These are based on the theoretical work of Kirkhart, Greene, Gary and Mark, Patton, Burke, King and Lawrenz and Huffman. The primary theory of evaluation use is Kirkhart's three-dimensional influence of evaluation model - source of influence (process orresults), intention (intended and unintended), and time (immediate, end-of-cycle, or long-term). Participation in evaluation draws on a continuum of Lawrenz and Huffman bounded by program evaluation conducted by an entity separate from the projects within the program to one when where the projects independently determine the evaluation procedures and what data to collect. `The proposed research will investigate the continuum of participation and how it relates to use.The research questions are:1) What patterns of participation exist in large, multi-site evaluation?2)) To what extent do different levels of project participation in program evaluations result in different patterns of evaluation use?3) What evaluation practices are most directly related to enhancing the influence of evaluations.Case studies will be carried out of four NSF Programs: ATE, LSC, CETP, and MSP RETAs. Within the case studies, methods will include artifact analysis, interview, surveys and site visits.

该项目的目的是对比不同方案评价方法的类型和影响范围，以便外地更好地了解在对具有国家和地方影响的大型机构进行评价时如何利用评价结果。该项目基于两个理论基础：1)评估使用，2)参与评估。这些都是基于柯克哈特、格林、加里和马克、巴顿、伯克、金、劳伦斯和霍夫曼的理论工作。评价使用的基本理论是柯克哈特的评价模型的三维影响力--影响源(过程或结果)、意图(有意和无意)和时间(立即、周期结束或长期)。参与评估利用了Lawrenz和Huffman的连续体，由计划内独立于项目的实体进行的计划评估，到项目独立决定评估程序和收集哪些数据的情况。“拟议的研究将调查参与的连续体及其与使用的关系。研究问题是：1)在大型多地点评估中存在什么参与模式？2)项目评估中不同级别的项目参与在多大程度上导致不同的评估使用模式？3)哪些评估实践与增强评估的影响力最直接相关。案例研究将对四个NSF项目进行：ATE、LSC、CETP和MSP RETA。在案例研究中，方法将包括人工制品分析、访谈、调查和现场访问。