Exploration of Validity Evidence Gaps in Science Educational Achievement Testing

科学教育成绩测试中有效性证据差距的探索

• 批准号: 1548098
• 负责人: Michael Gardner
• 金额: $ 29.3万
• 依托单位: University of Utah
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-09-01 至 2018-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1548098&HistoricalAwards=false
• 关键词: Exploration; Validity; Evidence; Gaps; Science

The Promoting Research and Innovation in Methodologies for Evaluation (PRIME) program seeks to support research on evaluation with special emphasis on: (1) exploring innovative approaches for determining the impacts and usefulness of STEM education projects and programs; (2) building on and expanding the theoretical foundations for evaluating STEM education and workforce development initiatives, including translating and adapting approaches from other fields; and (3) growing the capacity and infrastructure of the evaluation field. Three types of proposals will be supported by the program: Exploratory Projects that include proof-of-concept and feasibility studies; more extensive Full-Scale Projects; and workshops and conferences. The PIs propose to study the validity of measures of science achievement. They will assess validity gaps (when they exist) and build a data base for critical dialogue about such gaps. Two major questions will be addressed by the proposed project. The first, what are the nature, extent and quality of validity evidence gaps for science education achievement testing in research and evaluation reports found in science education? The second, what are the research and policy implications related to potential sources of influence on the gaps. The work will generate tools to support capacity and infrastructure of the evaluation field (specifically, a data base with validity evidence for science education researches and evaluators of science education interventions).

促进评估方法的研究和创新（PRIME）计划旨在支持评估研究，特别强调：(1)探索确定STEM教育项目和计划的影响和有用性的创新方法；(2)建立和扩展评估STEM教育和劳动力发展倡议的理论基础，包括翻译和适应其他领域的方法；(3)发展评价领域的能力和基础设施。该计划将支持三种类型的提案：探索性项目，包括概念验证和可行性研究；更广泛的全面项目；还有研讨会和会议。pi建议研究科学成就衡量标准的有效性。他们将评估有效性差距（如果存在），并建立一个数据库，以便就这些差距进行关键对话。拟议的项目将解决两个主要问题。第一，在科学教育研究和评价报告中发现的科学教育成就测试的效度证据差距的性质、程度和质量是什么？第二，与影响差距的潜在来源相关的研究和政策含义是什么。这项工作将产生工具来支持评估领域的能力和基础设施（具体而言，为科学教育研究和科学教育干预措施的评估者提供一个具有有效性证据的数据库）。