NODE - Network Opportunities for Developing Equitable and Effective Evaluation at HSIs

该项目旨在为科学与科学研究院开展评估和研究的能力建设，以加强和记录科学与科学研究院资助项目的有效性。经过六年的国会投资，现在是建立评估和研究这些项目对改善STEM学习环境和成果的贡献的能力的时机。然而，从历史上看，hsi缺乏对其以股权为中心的STEM方法进行评估和研究的能力，并且没有标准的、与文化相关的方法可以遵循。建立这种能力需要新颖、严格的评估和研究方法，绘制新的领域，公平、公正地评估这些项目如何为STEM领域的西班牙裔和其他少数族裔学生提供服务。作为一项跨学科的努力，整合了来自教育研究和数据科学的数据库创建和分析技术，在HSI中发展公平和有效评估的网络机会（NODE）项目将产生一个如何使用定量和定性方法处理复杂数据的模型，以开发标准化和可比较的措施，并分析NSF HSI计划资助的赠款，以不同的方式收集数据。结果将是(1)受助者评估的数据库平台，(2)标准化评估框架，(3)受助者使用评估数据库和框架的专业发展，(4)关于NSF HSI项目组合整体有效性的影响报告，以及(5)研究框架，以改善HSI及其他领域以公平为中心的STEM方法。HSI- cers节点的目标是：(1)创建一个框架来评估NSF HSI计划资助的资助组合的影响，(2)建立当前和潜在的NSF HSI计划受助人进行评估的能力，以及(3)加强和完善HSI及其他领域STEM公平的评估和研究。这些目标将通过以下五个目标来实现：(1)建立一个关于NSF HSI项目受助者活动的数据库；(2)分析该数据库，为受资助者制定评估框架；(3)利用评估框架和数据库为受资助者提供专业发展；(4)生成影响报告，以评估NSF HSI项目整体组合的有效性；(5)产生有关hsi和以公平为中心的STEM方法的评估和研究的适应性和可转移知识。使用定量和定性研究方法，该项目将产生文化上可持续的HSI STEM评估方法和服务性的精细研究框架，以解释HSI不同的机构和组织背景。这些评估和研究方法将通过专业协会、期刊网点和项目网站等渠道传播。影响报告将说明NSF HSI项目在实现其预期目标方面的集体有效性。项目结果将告知NSF和其他联邦机构如何通过支持与hsi的多机构合作使劳动力多样化。从长远来看，这些好处将使少数民族科学家在美国的代表性增加。HSI计划旨在加强HSI的本科STEM教育和能力建设。HSI计划支持的项目也将产生关于如何实现这些目标的新知识。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

This project aims to build capacity for HSIs to conduct evaluation and research to strengthen and document the effectiveness of NSF-HSI funded projects. With six years of congressional investment, now is the opportune time to build capacity for evaluation and research on these projects’ contributions to improving STEM learning environments and outcomes. Yet, HSIs have historically lacked capacity to conduct evaluation and research about their equity-centered STEM approaches, and do not have a standard, culturally relevant approach to follow. Building such capacity requires novel, rigorous evaluation and research approaches that map new territory to assess fairly and with integrity how these projects are serving Hispanic and other minoritized students in STEM fields. As an interdisciplinary effort to integrate database creation and analysis techniques from both educational research and data science, Network Opportunities for Developing Equitable and Effective Evaluation at HSIs (NODE) project will generate a model of how to address complex data using quantitative and qualitative methods to develop standardized and comparable measures and analyses of NSF HSI Program-funded grants that collect their data in different ways. The outcomes will be (1) a database platform for grantees’ evaluations, (2) a standardized evaluation framework, (3) professional development for grantees to use the evaluation database and framework, (4) impact reports about the NSF HSI Program portfolio overall effectiveness, and (5) research frameworks to improve equity-centered STEM approaches in HSIs and beyond.The goals of HSI-CERS NODE are to (1) create a framework to evaluate the impact of the NSF HSI Program’s funded grant portfolio, (2) build capacity of current and potential NSF HSI Program grantees in conducting evaluation, and (3) strengthen and refine assessment and research about STEM equity in HSIs and beyond. These goals will be accomplished by five objectives: (1) create a database about NSF HSI Program grantees’ activities; (2) analyze this database to develop an evaluation framework for grantees; (3) provide professional development using the evaluation framework and database to grantees; (4) generate impact reports to assess the effectiveness of the overall NSF HSI Program portfolio; and (5) generate adaptable and transferable knowledge about evaluation and research concerning HSIs and equity-centered STEM approaches. Using quantitative and qualitative research methods, the project will yield culturally sustaining HSI STEM evaluation approaches and a refined research framework of servingness that account for HSIs’ diverse institutional and organizational contexts. These evaluation and research approaches will be disseminated through venues like professional associations, journal outlets, and a project website. Impact reports will address the collective effectiveness of the NSF HSI Program in meeting its intended goals. Project results will inform NSF and other federal agencies about how to diversify the workforce through supporting multi-institutional partnerships with HSIs. In the longer term, these many benefits will yield an increase in the representation of minoritized scientists in the nation. The HSI Program aims to enhance undergraduate STEM education and build capacity at HSIs. Projects supported by the HSI Program will also generate new knowledge on how to achieve these aims.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.