NODE - Network Opportunities for Developing Equitable and Effective Evaluation at HSIs

该项目旨在为HSI进行评估和研究的能力建设，以加强和记录NSF-HSI资助项目的有效性。经过六年的国会投资，现在是建立评估和研究这些项目对改善STEM学习环境和成果的贡献的能力的适当时机。然而，HSIs在历史上缺乏对其以股权为中心的STEM方法进行评估和研究的能力，并且没有标准的，文化相关的方法可供遵循。建立这样的能力需要新的，严格的评估和研究方法，绘制新的领域，以公平和完整地评估这些项目是如何服务于西班牙裔和其他少数民族学生在STEM领域。作为一个跨学科的努力，整合数据库创建和分析技术从教育研究和数据科学，网络机会发展公平和有效的评估在HSI（NODE）项目将产生一个模型，如何处理复杂的数据，使用定量和定性的方法来开发标准化和可比的措施和分析NSF HSI计划资助的赠款，以不同的方式收集他们的数据。其成果将是（1）一个数据库平台，用于受资助者的评估，（2）一个标准化的评估框架，（3）专业发展的受资助者使用评估数据库和框架，（4）影响报告的NSF HSI计划组合的整体效果，和（5）研究框架，以改善HSIs及其他领域以公平为中心的STEM方法。HSI-CERS NODE的目标是（1）创建一个框架，以评估NSF HSI计划资助的赠款组合的影响，（2）建立当前和潜在的NSF HSI计划受助人进行评估的能力，以及（3）加强和完善评估和研究有关STEM在HSI及以后的公平性。这些目标将通过五个目标来实现：（1）创建一个关于NSF HSI计划受资助者活动的数据库;（2）分析该数据库，为受资助者制定一个评估框架;（3）使用评估框架和数据库为受资助者提供专业发展;（4）生成影响报告，以评估整个NSF HSI计划组合的有效性;以及（5）生成关于HSIs和以股权为中心的STEM方法的评估和研究的适应性和可转移的知识。使用定量和定性的研究方法，该项目将产生文化上可持续的HSI STEM评估方法和一个精细的服务性研究框架，该框架考虑了HSI不同的制度和组织背景。这些评价和研究方法将通过专业协会、期刊和项目网站等渠道传播。影响报告将说明NSF HSI计划在实现其预期目标方面的集体有效性。项目结果将告知NSF和其他联邦机构如何通过支持与HSI的多机构伙伴关系来实现劳动力的多样化。从长远来看，这些好处将增加少数民族科学家在全国的代表性。HSI计划旨在加强本科STEM教育，并建立HSI的能力。HSI计划支持的项目也将产生关于如何实现这些目标的新知识。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

This project aims to build capacity for HSIs to conduct evaluation and research to strengthen and document the effectiveness of NSF-HSI funded projects. With six years of congressional investment, now is the opportune time to build capacity for evaluation and research on these projects’ contributions to improving STEM learning environments and outcomes. Yet, HSIs have historically lacked capacity to conduct evaluation and research about their equity-centered STEM approaches, and do not have a standard, culturally relevant approach to follow. Building such capacity requires novel, rigorous evaluation and research approaches that map new territory to assess fairly and with integrity how these projects are serving Hispanic and other minoritized students in STEM fields. As an interdisciplinary effort to integrate database creation and analysis techniques from both educational research and data science, Network Opportunities for Developing Equitable and Effective Evaluation at HSIs (NODE) project will generate a model of how to address complex data using quantitative and qualitative methods to develop standardized and comparable measures and analyses of NSF HSI Program-funded grants that collect their data in different ways. The outcomes will be (1) a database platform for grantees’ evaluations, (2) a standardized evaluation framework, (3) professional development for grantees to use the evaluation database and framework, (4) impact reports about the NSF HSI Program portfolio overall effectiveness, and (5) research frameworks to improve equity-centered STEM approaches in HSIs and beyond.The goals of HSI-CERS NODE are to (1) create a framework to evaluate the impact of the NSF HSI Program’s funded grant portfolio, (2) build capacity of current and potential NSF HSI Program grantees in conducting evaluation, and (3) strengthen and refine assessment and research about STEM equity in HSIs and beyond. These goals will be accomplished by five objectives: (1) create a database about NSF HSI Program grantees’ activities; (2) analyze this database to develop an evaluation framework for grantees; (3) provide professional development using the evaluation framework and database to grantees; (4) generate impact reports to assess the effectiveness of the overall NSF HSI Program portfolio; and (5) generate adaptable and transferable knowledge about evaluation and research concerning HSIs and equity-centered STEM approaches. Using quantitative and qualitative research methods, the project will yield culturally sustaining HSI STEM evaluation approaches and a refined research framework of servingness that account for HSIs’ diverse institutional and organizational contexts. These evaluation and research approaches will be disseminated through venues like professional associations, journal outlets, and a project website. Impact reports will address the collective effectiveness of the NSF HSI Program in meeting its intended goals. Project results will inform NSF and other federal agencies about how to diversify the workforce through supporting multi-institutional partnerships with HSIs. In the longer term, these many benefits will yield an increase in the representation of minoritized scientists in the nation. The HSI Program aims to enhance undergraduate STEM education and build capacity at HSIs. Projects supported by the HSI Program will also generate new knowledge on how to achieve these aims.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.