A Phase II trial of the Systems Evaluation Protocol for Assessing and Improving STEM Education Evaluation

DRL-0814364PI：William TrochiPROJECT摘要研究人员创建了一种协议，用于使用基于网络的系统来开发对项目的评估。该项目将评估系统评价议定书(SEP)与组织评价能力和业绩成果变化的关联程度。研究人员将对该协议在NSF资助的两个研究环境中的效果进行试验：材料科学与工程中心和4-H工程与技术计划。该项目包括开发阶段，调查员将使用评估员、教育人员和软件工程师团队测试和增强在线系统。它还包括一个阶段，对评价议定书关于评价质量的结果进行经验性衡量。该项目的目的是显著提高对STEM教育评估以及如何严格实施评估的认识。这些结果旨在让教育工作者和教育研究人员了解这些评估方法的优点和缺点。研究人员已经建立了一个实习生计划，以促进未被充分代表的人群在评估中的作用。

DRL- 0814364PI: William TrochimPROJECT AbstractThe investigator has created a protocol for developing evaluations of programs using a web-based system. The project will assess the degree to which the Systems Evaluation Protocol (SEP) is associated with changes in organizational evaluation capacity and performance outcomes. The investigator will conduct a trial of how well this protocol would work in two NSF funded research settings: a Materials Science and Engineering Centers and a 4-H Engineering and Technology program. The project includes a development phase where the investigator will be testing and enhancing the on-line system using a team of evaluators, educators, and software engineers. It also includes a phase to empirically measure the results of the evaluation protocol on evaluation quality. The intent of the project is to significantly enhance knowledge of STEM education evaluation and how to implement it with rigor. The results are intended to inform educators and education researchers about the strengths and weaknesses of these evaluation methods. The researcher has established an intern program to advance the role of underrepresented populations in evaluation.