CISE REU Evaluation Toolkit Expansion Project

该项目将为计算机和信息科学以及本科生工程研究经验（CISE REU）社区的外部评估活动和服务提供长期支持。该项目将通过提供一个评估工具包，促进评估报告，同时加强对本科生研究计划成果的研究，来解决正在履行CISE REU网站计划评估工作的主要研究者之间的持续需求。评估工具包的主要目的是为质量计划评估提供有针对性的教学资源和工具，以平衡标准化评估沿着的愿望和对个别计划环境负责的责任。工具包的内容包括关于评价做法的教学材料、标准化的申请人管理工具和经过验证的调整后的成果衡量标准。与该工具包相关的服务包括：为研究中心招聘提供通用应用程序;为主要研究者提供共享申请人库，以便在研究中心之间共享申请人;提供在线学生调查（称为A la Carte Student Survey）;以及向REU研究中心主要研究者提供相应的回复。项目扩展将继续这些工具和服务，以及扩大到包括教师职业影响调查，学生REU校友调查，并研究现场组织特征。该工具包的好处是提供了具有成本效益的可持续评估工具，为方案评估提供了一个社区论坛，并为国家方案提供了关键方案成果指标的综合衡量。评估工具包项目平衡了对单个场地环境评估的需要和对更广泛的、可推广的项目影响评估的需要。 这个项目的智力价值在于理解本科计算研究项目对学生和教师参与者的影响。综合方案评估将通知集体努力招收本科生博士课程。该计划的评估将产生有关REU网站结构的功能知识，以提高学生的学习成果，并激励个人追求高级学位和研究职业。本研究所产生的知识也将提供有关教师如何从事REU网站和对他们的职业生涯的影响的见解。更广泛的影响该项目的更广泛的影响将证明由本项目开发的工具和在线工具，将有利于任何研究人员参与支持本科生的研究经验。这将使许多REU课程的形成性改进，丰富本科生的REU经验，并增强教师领导成功REU课程的能力，从而增强研究生院的管道和教师的职业发展。此外，拟议项目的成果将有助于多地点方案评估的评估能力建设研究。

This project will provide long-term support for external evaluation activities and services for the Computing and Information Sciences and Engineering Research Experiences for Undergraduates (CISE REU) community. This project will address the ongoing need among principal investigators who are fulfilling CISE REU Site program evaluation efforts by providing an evaluation toolkit that facilitates evaluation reporting while strengthening research about undergraduate research program outcomes. The primary purpose of the evaluation toolkit is to provide targeted instructional resources and tools for quality program evaluation that balance the desire for standardized assessment along with the responsibility to account for individual program contexts. Toolkit contents include instructional materials about evaluation practice, a standardized applicant management tool, and a validated modulated outcomes measure. Services associated with the toolkit are providing a Common Application for site recruiting, a Shared Applicant Pool for principal investigators to share applicants across sites, delivery of an online student survey known as the A la Carte Student Survey, and corresponding responses to REU Site principle investigators. Project expansion will continue these tools and services as well as expand to include a Faculty Career Impact Survey, Student REU Alumni Survey, and a study of site organizational characteristics. The benefits of the toolkit are in providing cost effective, sustainable evaluation tools, a community forum for program evaluation, and aggregate measurement of key program outcomes indicators for the national program. The evaluation toolkit project balances the need for individual site context evaluation with the need for broader, generalizable program impact evaluation. Intellectual MeritThe intellectual merit of this project resides in the contributions to understanding the impact of undergraduate computing research programs for both students and faculty participants. The comprehensive program evaluation will inform collective efforts to recruit undergraduate students to doctoral programs. The program evaluation will generate knowledge about features of REU Site structure for enhancing student learning outcomes and motivating individuals to pursue advanced degrees and careers in research. The knowledge generated by this study will also provide insights about how faculty engage in REU Sites and the impact on their careers.Broader ImpactsThe broader impact of the project will be evidenced by the instruments and online tools developed by this project that will benefit any researcher involved in supporting research experiences for undergraduates. This will enable formative improvements for numerous REU programs, enrich REU experiences for undergraduate students, and augment faculty capacity for leading successful REU programs, thereby enhancing the graduate school pipeline and faculty career development. In addition, the outcomes of the proposed project will contribute to evaluation capacity building research for multi-site program assessment.