Collaborative Research: Validity Evidence and Measurement in Mathematics Education (V-M2ED)

随着教育在过去几十年中更多地转向数据驱动的政策和研究举措，与政策相关的方面的数据往往被期望具有更多的量化性质。这导致在STEM教育中使用更多的量化措施，包括数学教育。不幸的是，缺乏关于数学教育措施的有效性和可靠性的证据。此外，量化工具和测量的有效性的证据没有被该领域的研究人员一致地概念化或定义。本项目的目的是充分探索数学教育文献，以综合哪些可用于数学教育定量评估的有效性证据。根据综合研究的结果，研究人员将设计、策划和传播数学教育教学和研究中使用的定量评估库。研究人员还将为各种学者和从业者创建材料和在线培训，以使用该存储库。该团队将解决两个主要的研究问题：1)与数学教育研究中使用的定量评估相关的有效性证据如何分类和描述？2)自2000年以来在数学教育研究中使用量化工具的有效性证据是什么？研究人员将使用交叉比较方法，包括进行文献搜索，然后分析和分类工具的特点。研究小组将审查使用了量化工具的案例(即，手稿中描述的评估)，以及测量的结构、与有效性来源有关的证据和研究样本等具体特征。然后，该团队将设计、开发和部署一个免费的在线数字存储库，用于对仪器进行分类，并描述其相关的有效性证据。发现研究预科-12项目(DRK-12)旨在通过研究和开发创新资源、模型和工具，显著提高预科-12学生和教师在科学、技术、工程和数学(STEM)方面的学习和教学。DRK-12计划中的项目建立在STEM教育的基础研究和先前的研究和开发工作的基础上，为拟议的项目提供了理论和经验上的证明。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

As education has shifted more towards data-driven policy and research initiatives in the last several decades, data for policy-related aspects are often expected to be more quantitative in nature. This has led to the increase in use of more quantitative measures in STEM education, including mathematics education. Unfortunately, evidence regarding the validity and reliability of mathematics education measures is lacking. Furthermore, the evidence for validity for quantitative tools and measures is not conceptualized or defined consistently by researchers in the field. The purpose of this project is to fully explore the mathematics education literature to synthesize what validity evidence is available for quantitative assessments in mathematics education. Drawing on the results of the synthesis study, the researchers will design, curate, and disseminate a repository of quantitative assessments used in mathematics education teaching and research. The researchers will also create materials and online training for a variety of scholars and practitioners to use the repository. The team will address two main research questions: 1) How might validity evidence related to quantitative assessments used in mathematics education research be categorized and described? and 2) What validity evidence exists for quantitative instruments used in mathematics education scholarship since 2000? Researchers will use a cross-comparative methodology which involves conducting a literature search and then analyzing and categorizing features of instruments. The research team will examine cases (i.e., assessments described in manuscripts) in which quantitative instruments have been used, alongside specific features such as the construct measured, evidence related to sources of validity, and study sample. The team will then design, develop, and deploy a free online digital repository for the categorization of instruments and describe their associated validity evidence.The Discovery Research preK-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools. Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.