A Phase II trial of the Systems Evaluation Protocol for Assessing and Improving STEM Education Evaluation

DRL- 0814364PI: William TrochimPROJECT摘要研究人员创建了一个使用基于web的系统开发项目评估的协议。该项目将评估系统评估协议（SEP）与组织评估能力和绩效结果变化的关联程度。研究者将在两个NSF资助的研究环境中进行试验，看看该方案的效果如何：一个是材料科学与工程中心，一个是4-H工程与技术项目。该项目包括一个开发阶段，在这个阶段，研究者将使用一个由评估人员、教育工作者和软件工程师组成的团队测试和增强在线系统。它还包括一个对评估质量的评估方案的结果进行经验度量的阶段。该项目的目的是显着提高STEM教育评估的知识以及如何严格实施。研究结果旨在告知教育工作者和教育研究者这些评估方法的优缺点。研究人员建立了一个实习生计划，以促进未被充分代表的人群在评估中的作用。

DRL- 0814364PI: William TrochimPROJECT AbstractThe investigator has created a protocol for developing evaluations of programs using a web-based system. The project will assess the degree to which the Systems Evaluation Protocol (SEP) is associated with changes in organizational evaluation capacity and performance outcomes. The investigator will conduct a trial of how well this protocol would work in two NSF funded research settings: a Materials Science and Engineering Centers and a 4-H Engineering and Technology program. The project includes a development phase where the investigator will be testing and enhancing the on-line system using a team of evaluators, educators, and software engineers. It also includes a phase to empirically measure the results of the evaluation protocol on evaluation quality. The intent of the project is to significantly enhance knowledge of STEM education evaluation and how to implement it with rigor. The results are intended to inform educators and education researchers about the strengths and weaknesses of these evaluation methods. The researcher has established an intern program to advance the role of underrepresented populations in evaluation.