NODE - Network Opportunities for Developing Equitable and Effective Evaluation at HSIs

该项目的目的是建设高级别机构进行评估和研究的能力，以加强和记录由国家科学基金会-人类安全倡议资助的项目的有效性。有了六年的国会投资，现在是建设评估和研究这些项目对改善STEM学习环境和成果的贡献的能力的好时机。然而，HSI历来缺乏对其以股权为中心的STEM方法进行评估和研究的能力，也没有标准的、与文化相关的方法可供遵循。建设这种能力需要新的、严格的评估和研究方法，以绘制新的领域，公平和完整地评估这些项目如何为西班牙裔和其他STEM领域的小规模学生服务。作为一项整合教育研究和数据科学的数据库创建和分析技术的跨学科努力，在HSIS开发公平和有效评估的网络机会(NODE)项目将生成一个模型，说明如何使用定量和定性方法处理复杂数据，以开发以不同方式收集数据的NSF HSI计划资助的赠款的标准化和可比性测量和分析。结果将是(1)用于受赠者评估的数据库平台，(2)标准化评估框架，(3)受赠者使用评估数据库和框架的专业发展，(4)关于NSF HSI计划组合整体有效性的影响报告，以及(5)改进HSI内外以股权为中心的STEM方法的研究框架。HSI-CERS节点的目标是(1)创建一个框架来评估NSF HSI计划资助的资助组合的影响，(2)建设现有的和潜在的NSF HSI计划受赠者进行评估的能力，(3)加强和完善对高等学校及以上STEM股权的评估和研究。这些目标将通过五个目标实现：(1)创建关于NSF HSI计划受资助者活动的数据库；(2)分析该数据库以制定受赠者的评估框架；(3)使用评估框架和数据库为受赠者提供专业发展；(4)生成影响报告，以评估整个NSF HSI计划组合的有效性；以及(5)生成关于HSIS和以股权为中心的STEM方法的评估和研究的可适应和可转让的知识。利用定量和定性的研究方法，该项目将产生文化支持的HSI STEM评估方法，以及考虑到HSI不同的机构和组织背景的精细化的服务性研究框架。这些评估和研究方法将通过专业协会、期刊和项目网站等场所传播。影响报告将阐述NSF HSI计划在实现其预期目标方面的集体有效性。项目成果将告知NSF和其他联邦机构如何通过支持与HSI的多机构伙伴关系来实现劳动力多样化。从长远来看，这些好处将增加小规模科学家在国家中的代表性。HSI计划旨在加强本科生STEM教育和HSI的能力建设。HSI计划支持的项目也将产生关于如何实现这些目标的新知识。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

This project aims to build capacity for HSIs to conduct evaluation and research to strengthen and document the effectiveness of NSF-HSI funded projects. With six years of congressional investment, now is the opportune time to build capacity for evaluation and research on these projects’ contributions to improving STEM learning environments and outcomes. Yet, HSIs have historically lacked capacity to conduct evaluation and research about their equity-centered STEM approaches, and do not have a standard, culturally relevant approach to follow. Building such capacity requires novel, rigorous evaluation and research approaches that map new territory to assess fairly and with integrity how these projects are serving Hispanic and other minoritized students in STEM fields. As an interdisciplinary effort to integrate database creation and analysis techniques from both educational research and data science, Network Opportunities for Developing Equitable and Effective Evaluation at HSIs (NODE) project will generate a model of how to address complex data using quantitative and qualitative methods to develop standardized and comparable measures and analyses of NSF HSI Program-funded grants that collect their data in different ways. The outcomes will be (1) a database platform for grantees’ evaluations, (2) a standardized evaluation framework, (3) professional development for grantees to use the evaluation database and framework, (4) impact reports about the NSF HSI Program portfolio overall effectiveness, and (5) research frameworks to improve equity-centered STEM approaches in HSIs and beyond.The goals of HSI-CERS NODE are to (1) create a framework to evaluate the impact of the NSF HSI Program’s funded grant portfolio, (2) build capacity of current and potential NSF HSI Program grantees in conducting evaluation, and (3) strengthen and refine assessment and research about STEM equity in HSIs and beyond. These goals will be accomplished by five objectives: (1) create a database about NSF HSI Program grantees’ activities; (2) analyze this database to develop an evaluation framework for grantees; (3) provide professional development using the evaluation framework and database to grantees; (4) generate impact reports to assess the effectiveness of the overall NSF HSI Program portfolio; and (5) generate adaptable and transferable knowledge about evaluation and research concerning HSIs and equity-centered STEM approaches. Using quantitative and qualitative research methods, the project will yield culturally sustaining HSI STEM evaluation approaches and a refined research framework of servingness that account for HSIs’ diverse institutional and organizational contexts. These evaluation and research approaches will be disseminated through venues like professional associations, journal outlets, and a project website. Impact reports will address the collective effectiveness of the NSF HSI Program in meeting its intended goals. Project results will inform NSF and other federal agencies about how to diversify the workforce through supporting multi-institutional partnerships with HSIs. In the longer term, these many benefits will yield an increase in the representation of minoritized scientists in the nation. The HSI Program aims to enhance undergraduate STEM education and build capacity at HSIs. Projects supported by the HSI Program will also generate new knowledge on how to achieve these aims.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.