EAGER: Creating a STEM Evaluation Community of Practice to use Culturally Responsive Evaluation (CRE) in Broadening participation (BP) Programs and Projects

目的。该项目的目的是开展探索性研究，以评估使用文化响应性评估（CRE）方法的跨学科和变革潜力，为共同问责机制的总体发展提供信息，以扩大STEM劳动力的参与。此外，该研究将增加评估知识/实践基础，特别是关于实习经历在为有色人种评估专业人员制定更有效的招聘策略、教育/培训和职业道路方面的功效。这个项目建立在美国评估协会所表达的需求之上。美国的国家竞争性博士前研究生教育多样性实习（GEDI）计划，旨在引入和推进CRE在联邦STEM评估中的应用。实践社区。该项目将创建一个实践社区，每年在美国国家科学基金会安排两名GEDI实习生，参与CRE在正在进行的联邦STEM教育和研究评估项目中的应用，同时也为伊利诺伊大学香槟分校文化响应性评估和评估中心（CREA）开展的基于他们经验的CRE在STEM教育和研究评估中的应用做出贡献。研究活动。该研究将发现推动可持续代际评估途径成功发展的因素，以促进STEM评估的广泛参与。资料收集方法包括文献回顾法、参与式观察法、行政记录及其他资料二次分析法、调查法、访谈法。这些数据将用于加强现有的GEDI变革理论框架和课程，方法是将实习经验的发现和教训融入到CRE的使用中，并扩大对STEM评估的参与。传播。在项目的第二年举行的研讨会将召集CRE、STEM BP和评估方面的专家，对研究成果进行审查，并得出对推进评估投资的科学和实践的影响，以扩大STEM研究人员的参与。这两年都计划进行传播活动和产品，如期刊文章、会议发言和专业发展讲习班。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

Purpose. The purpose of this project is to conduct exploratory research to gauge the interdisciplinary and transformative potential of using culturally responsive evaluation (CRE) methods to inform the general development of shared accountability mechanisms for broadening participation in the STEM workforce. In addition, the research will add to the evaluation knowledge/practice base, specifically on the efficacy of internship experiences in the creation of more effective recruitment strategies, education/training, and career pathways for evaluation professionals of color. This project builds on a need expressed by the American Evaluation Association?s national competitive pre-doctoral Graduate Education Diversity Internship (GEDI) program to introduce and advance the utilization of CRE in Federal STEM evaluation.Community of Practice. This project will create a community of practice that places two GEDI interns annually at the National Science Foundation to engage in both the application of CRE to ongoing contracted Federal STEM education and research evaluation projects, but also to contribute to research conducted by the Center for Culturally Responsive Evaluation and Assessment (CREA) at the University of Illinois- Champaign-Urbana on the use of CRE in STEM education and research evaluation based on their experience. Research Activities. The research will discover the factors that drive the successful development of sustainable, intergenerational evaluation pathways to promote broadening participation in STEM evaluation. Data collection methods include literature review, participant observation, secondary analysis of administrative records and other data, surveys, and interviews. These data will be used to strengthen the existing GEDI theory of change framework and curricula by infusing findings and lessons learned from the internship experience about the use of CRE and broadening participation in STEM evaluation. Dissemination. A symposium held during the second year of the project will convene experts in CRE, STEM BP, and evaluation to review the research findings and derive implications for to advancing the science and practice of evaluating investments in broadening participation across the STEM research workforce. Dissemination activities and products such as journal articles, conference presentations, and professional development workshops are planned for both years.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.