Evaluation Communities for Learning, Inquiry, and Practice about Systems (ECLIPS)

这项探索性研究将调查需要什么来提高STEM教育评估员使用面向系统的方法进行评估的能力。这项工作将以两个研究问题为指导：1)核心系统评估是否比没有有意的系统导向的评估更有效？2)ECLIPS如何有效地建设评价人员进行核心系统评价的能力？将指导ITEST和ATE项目的评估者修改其评估，以采用更注重系统的方法进行评估。以系统为导向的评价项目的结果以及评估者需要学习如何使用这一方法，将为所有STEM项目的评估者提供信息。研究人员将来自位于科罗拉多州柯林斯堡的教育变革支持网络InSites。将确定6至8名ITEST和ATE项目的STEM教育评估员参与这项研究。这些评估员将与指南和其他了解以系统为导向的评估的人合作，修订现有的评估计划。大部分互动将通过每月的网络研讨会、年度会议和与导游的个人互动进行。会议将被记录下来，参与者和领导人之间的互动将成为主要的数据来源。此外，还将向STEM教育评估员发放一份前后调查问卷。将使用其他STEM评估员和感兴趣的各方来验证所作的推论。该项目的成果将包括6至8名STEM教育评估员，他们对面向系统的评估有更多的了解，一份关于如何使用这种方法对其他人进行教育的书面指南，以及发表关于这一过程的文章。这些调查结果将特别适用于科技、经济、技术和经济领域的项目评估员和一般评估员。

This exploratory study will investigate what is needed to increase the capacity of STEM education evaluators to use a systems-oriented approach to evaluation. The work will be guided by two research questions: 1) Are core system evaluations more effective than evaluations without an intentional system orientation? and 2) How does ECLIPS effectively build the capacity of evaluators to conduct core system evaluations? Evaluators of ITEST and ATE projects will be guided in revising their evaluations to employ a more systems-oriented approach to evaluation. Results from the project on systems-oriented evaluation and what is needed for evaluators to learn how to use this approach will be informative to evaluators of the full range of STEM projects. Researchers will be from InSites, a support network for educational change, located in Fort Collins, Colorado. Six to eight STEM education evaluators of ITEST and ATE projects will be identified to participate in the study. These evaluators will work with guides and others who are knowledgeable about systems-oriented evaluation to revise existing evaluation plans. Much of the interactions will be through monthly webinars, annual meetings, and individual interaction with guides. Sessions will be recorded and interactions among participants and leaders will serve as a major source of data. In addition, a pre and post questionnaire will be administered to the STEM education evaluators. Other STEM evaluators and interested parties will be used to validate inferences made. Outcomes from the project will include six to eight STEM education evaluators who are more knowledgeable about systems-oriented evaluations, a written guide on how others can be educated in using such an approach, and published articles on the process. The findings will be particularly relevant to STEM project evaluators and evaluators in general.