Evaluation Communities for Learning, Inquiry, and Practice about Systems (ECLIPS)

这项探索性研究将探讨如何提高STEM教育评估人员使用系统导向的评估方法的能力。这项工作将以两个研究问题为指导：（1）核心系统评价是否比没有系统定向的评价更有效？2）ECLIPS如何有效地培养评价者进行核心系统评价的能力？ITEST和ATE项目的评价人员将在修订其评价时得到指导，以便采用更加注重系统的评价方法。面向系统的评价项目的结果以及评价人员学习如何使用这一方法所需的内容，将为所有科学、技术、工程和数学项目的评价人员提供信息。研究人员将来自位于科罗拉多柯林斯堡的教育变革支持网络InSites。将确定六至八名ITEST和ATE项目的STEM教育评估员参与研究。这些评价人员将与指导人员和其他熟悉面向系统的评价的人合作，修订现有的评价计划。大部分的互动将通过每月的网络研讨会，年度会议，以及与导游的个人互动。会议将被记录，与会者和领导人之间的互动将作为数据的主要来源。此外，还将向STEM教育评估人员发放一份调查问卷。其他STEM评估人员和相关方将用于验证所做的推断。 该项目的成果将包括6至8名STEM教育评估人员，他们对系统导向的评估更为了解，关于如何使用这种方法教育其他人的书面指南，以及关于这一过程的出版文章。调查结果将特别适用于STEM项目评估人员和一般评估人员。

This exploratory study will investigate what is needed to increase the capacity of STEM education evaluators to use a systems-oriented approach to evaluation. The work will be guided by two research questions: 1) Are core system evaluations more effective than evaluations without an intentional system orientation? and 2) How does ECLIPS effectively build the capacity of evaluators to conduct core system evaluations? Evaluators of ITEST and ATE projects will be guided in revising their evaluations to employ a more systems-oriented approach to evaluation. Results from the project on systems-oriented evaluation and what is needed for evaluators to learn how to use this approach will be informative to evaluators of the full range of STEM projects. Researchers will be from InSites, a support network for educational change, located in Fort Collins, Colorado. Six to eight STEM education evaluators of ITEST and ATE projects will be identified to participate in the study. These evaluators will work with guides and others who are knowledgeable about systems-oriented evaluation to revise existing evaluation plans. Much of the interactions will be through monthly webinars, annual meetings, and individual interaction with guides. Sessions will be recorded and interactions among participants and leaders will serve as a major source of data. In addition, a pre and post questionnaire will be administered to the STEM education evaluators. Other STEM evaluators and interested parties will be used to validate inferences made. Outcomes from the project will include six to eight STEM education evaluators who are more knowledgeable about systems-oriented evaluations, a written guide on how others can be educated in using such an approach, and published articles on the process. The findings will be particularly relevant to STEM project evaluators and evaluators in general.