EAGER: Creating a STEM Evaluation Community of Practice to use Culturally Responsive Evaluation (CRE) in Broadening participation (BP) Programs and Projects

目的。该项目的目的是进行探索性研究，以评估使用文化响应性评估(CRE)方法的跨学科和变革潜力，为扩大STEM工作人员参与的共同问责机制的总体发展提供信息。此外，这项研究将增加评价知识/实践基础，特别是关于实习经验在为有色人种评价专业人员制定更有效的招聘战略、教育/培训和职业道路方面的效力。该项目建立在美国评估协会--S国家竞争性博士前研究生教育多元化实习计划--的基础上，旨在引入和推进CRE在联邦STEM评估中的应用。该项目将创建一个实践社区，每年在国家科学基金会安排两名GEDI实习生参与将CRE应用于正在进行的签约联邦STEM教育和研究评估项目，并根据他们的经验为伊利诺伊大学香槟-厄巴纳大学文化响应性评估中心(CREA)进行的关于在STEM教育和研究评估中使用CRE的研究做出贡献。研究活动。这项研究将发现推动可持续、代际评估路径成功发展的因素，以促进更广泛地参与STEM评估。数据收集方法包括文献综述、参与观察、行政记录和其他数据的二次分析、调查和访谈。这些数据将被用来加强现有的GEDI改革框架和课程，方法是吸收关于使用CRE的实习经验和经验教训，并扩大对STEM评估的参与。传播。在项目第二年期间举行的研讨会将召集CRE、STEM BP和评估方面的专家，审查研究结果，并得出结论，以促进评估投资的科学和实践，以扩大STEM研究队伍的参与。传播活动和产品，如期刊文章、会议报告和专业发展研讨会都计划在两年内进行。这一奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

Purpose. The purpose of this project is to conduct exploratory research to gauge the interdisciplinary and transformative potential of using culturally responsive evaluation (CRE) methods to inform the general development of shared accountability mechanisms for broadening participation in the STEM workforce. In addition, the research will add to the evaluation knowledge/practice base, specifically on the efficacy of internship experiences in the creation of more effective recruitment strategies, education/training, and career pathways for evaluation professionals of color. This project builds on a need expressed by the American Evaluation Association?s national competitive pre-doctoral Graduate Education Diversity Internship (GEDI) program to introduce and advance the utilization of CRE in Federal STEM evaluation.Community of Practice. This project will create a community of practice that places two GEDI interns annually at the National Science Foundation to engage in both the application of CRE to ongoing contracted Federal STEM education and research evaluation projects, but also to contribute to research conducted by the Center for Culturally Responsive Evaluation and Assessment (CREA) at the University of Illinois- Champaign-Urbana on the use of CRE in STEM education and research evaluation based on their experience. Research Activities. The research will discover the factors that drive the successful development of sustainable, intergenerational evaluation pathways to promote broadening participation in STEM evaluation. Data collection methods include literature review, participant observation, secondary analysis of administrative records and other data, surveys, and interviews. These data will be used to strengthen the existing GEDI theory of change framework and curricula by infusing findings and lessons learned from the internship experience about the use of CRE and broadening participation in STEM evaluation. Dissemination. A symposium held during the second year of the project will convene experts in CRE, STEM BP, and evaluation to review the research findings and derive implications for to advancing the science and practice of evaluating investments in broadening participation across the STEM research workforce. Dissemination activities and products such as journal articles, conference presentations, and professional development workshops are planned for both years.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.