CISE REU Evaluation Toolkit Expansion Project

该项目将为计算与信息科学和本科生工程研究经验(CEISE REU)社区的外部评估活动和服务提供长期支持。这个项目将通过提供一个评估工具包，在加强对本科生研究计划结果的研究的同时，促进评估报告，以满足正在完成CEISE REU现场计划评估工作的主要研究人员的持续需求。评估工具包的主要目的是为高质量的计划评估提供有针对性的教学资源和工具，以平衡标准化评估的愿望和考虑个别计划背景的责任。工具包的内容包括关于评估实践的指导材料、标准化的申请者管理工具和经过验证的调制结果衡量标准。与工具包相关的服务包括提供现场招聘通用申请、供主要调查员在各地点共享申请者的共享申请库、提供名为点菜学生调查的在线学生调查，以及对REU现场主要调查员的相应答复。项目扩展将继续这些工具和服务，并扩大到包括教师职业影响调查、学生REU校友调查和现场组织特征研究。该工具包的好处在于提供了具有成本效益的、可持续的评估工具、一个用于项目评估的社区论坛以及对国家项目的关键项目成果指标的综合衡量。评估工具包项目平衡了对单个站点背景评估的需求和对更广泛、可概括的计划影响评估的需求。智力价值这个项目的智力价值在于有助于理解本科生计算机研究项目对学生和教师参与者的影响。综合项目评估将为集体努力招收本科生攻读博士学位提供信息。项目评估将产生关于REU网站结构特征的知识，以提高学生的学习成果，并激励个人在研究领域追求更高的学位和职业。这项研究产生的知识也将提供关于教师如何参与REU网站以及对他们职业生涯的影响的见解。广泛的影响该项目的更广泛的影响将通过该项目开发的工具和在线工具来证明，这将使参与支持本科生研究经验的任何研究人员受益。这将促进许多REU项目的形成性改进，丰富本科生的REU经验，并增强教师领导成功的REU项目的能力，从而加强研究生院渠道和教师职业发展。此外，拟议项目的成果将有助于多地点方案评估的评估能力建设研究。

This project will provide long-term support for external evaluation activities and services for the Computing and Information Sciences and Engineering Research Experiences for Undergraduates (CISE REU) community. This project will address the ongoing need among principal investigators who are fulfilling CISE REU Site program evaluation efforts by providing an evaluation toolkit that facilitates evaluation reporting while strengthening research about undergraduate research program outcomes. The primary purpose of the evaluation toolkit is to provide targeted instructional resources and tools for quality program evaluation that balance the desire for standardized assessment along with the responsibility to account for individual program contexts. Toolkit contents include instructional materials about evaluation practice, a standardized applicant management tool, and a validated modulated outcomes measure. Services associated with the toolkit are providing a Common Application for site recruiting, a Shared Applicant Pool for principal investigators to share applicants across sites, delivery of an online student survey known as the A la Carte Student Survey, and corresponding responses to REU Site principle investigators. Project expansion will continue these tools and services as well as expand to include a Faculty Career Impact Survey, Student REU Alumni Survey, and a study of site organizational characteristics. The benefits of the toolkit are in providing cost effective, sustainable evaluation tools, a community forum for program evaluation, and aggregate measurement of key program outcomes indicators for the national program. The evaluation toolkit project balances the need for individual site context evaluation with the need for broader, generalizable program impact evaluation. Intellectual MeritThe intellectual merit of this project resides in the contributions to understanding the impact of undergraduate computing research programs for both students and faculty participants. The comprehensive program evaluation will inform collective efforts to recruit undergraduate students to doctoral programs. The program evaluation will generate knowledge about features of REU Site structure for enhancing student learning outcomes and motivating individuals to pursue advanced degrees and careers in research. The knowledge generated by this study will also provide insights about how faculty engage in REU Sites and the impact on their careers.Broader ImpactsThe broader impact of the project will be evidenced by the instruments and online tools developed by this project that will benefit any researcher involved in supporting research experiences for undergraduates. This will enable formative improvements for numerous REU programs, enrich REU experiences for undergraduate students, and augment faculty capacity for leading successful REU programs, thereby enhancing the graduate school pipeline and faculty career development. In addition, the outcomes of the proposed project will contribute to evaluation capacity building research for multi-site program assessment.