Exploration of Validity Evidence Gaps in Science Educational Achievement Testing

促进评估方法研究和创新(PRIME)计划旨在支持评估研究，特别强调：(1)探索确定STEM教育项目和方案的影响和有用性的创新方法；(2)建立和扩展评估STEM教育和劳动力发展倡议的理论基础，包括翻译和调整其他领域的方法；以及(3)提高评估领域的能力和基础设施。该计划将支持三种类型的提案：包括概念验证和可行性研究的探索性项目；更广泛的全面项目；以及研讨会和会议。个人投资促进机构建议研究科学成就衡量标准的有效性。他们将评估有效性差距(如果存在)，并建立一个数据库，以便就这些差距进行批判性对话。拟议的项目将解决两个主要问题。第一，在科学教育研究和评估报告中发现的科学教育成就测试的有效性证据差距的性质、程度和质量是什么？第二，与影响差距的潜在来源相关的研究和政策影响是什么。这项工作将产生支持评估领域的能力和基础设施的工具(具体地说，是为科学教育研究和科学教育干预措施的评估者提供有效性证据的数据库)。

The Promoting Research and Innovation in Methodologies for Evaluation (PRIME) program seeks to support research on evaluation with special emphasis on: (1) exploring innovative approaches for determining the impacts and usefulness of STEM education projects and programs; (2) building on and expanding the theoretical foundations for evaluating STEM education and workforce development initiatives, including translating and adapting approaches from other fields; and (3) growing the capacity and infrastructure of the evaluation field. Three types of proposals will be supported by the program: Exploratory Projects that include proof-of-concept and feasibility studies; more extensive Full-Scale Projects; and workshops and conferences. The PIs propose to study the validity of measures of science achievement. They will assess validity gaps (when they exist) and build a data base for critical dialogue about such gaps. Two major questions will be addressed by the proposed project. The first, what are the nature, extent and quality of validity evidence gaps for science education achievement testing in research and evaluation reports found in science education? The second, what are the research and policy implications related to potential sources of influence on the gaps. The work will generate tools to support capacity and infrastructure of the evaluation field (specifically, a data base with validity evidence for science education researches and evaluators of science education interventions).