CISE REU Evaluation Toolkit Expansion Project

该项目将为计算机与信息科学与工程本科生研究经验（CISE REU）社区的外部评估活动和服务提供长期支持。该项目将通过提供一个评估工具包，促进评估报告，同时加强对本科生研究项目成果的研究，解决正在履行CISE REU网站项目评估工作的主要研究人员的持续需求。评估工具包的主要目的是为质量项目评估提供有针对性的教学资源和工具，以平衡标准化评估的愿望以及对单个项目环境的责任。工具包内容包括关于评估实践的指导材料，标准化的申请人管理工具，以及经过验证的调制结果测量。与该工具包相关的服务包括：为站点招聘提供通用应用程序、为主要研究人员提供共享申请人池，以便跨站点共享申请人、提供在线学生调查（称为点菜学生调查）以及对REU站点主要研究人员的相应响应。项目扩展将继续这些工具和服务，并扩展到包括教师职业影响调查，学生REU校友调查和网站组织特征研究。该工具包的好处在于提供具有成本效益的、可持续的评估工具、项目评估的社区论坛，以及对国家项目的关键项目成果指标进行汇总衡量。评估工具包项目平衡了对个别地点环境评估的需要和对更广泛、可推广的项目影响评估的需要。智力价值本项目的智力价值在于有助于理解本科生计算研究项目对学生和教师参与者的影响。全面的项目评估将为集体努力招收本科生攻读博士学位提供信息。项目评估将产生关于REU网站结构特征的知识，以提高学生的学习成果，并激励个人追求更高的学位和研究事业。本研究所产生的知识还将提供有关教师如何参与REU网站及其职业影响的见解。更广泛的影响项目的更广泛的影响将通过该项目开发的仪器和在线工具来证明，这将使任何参与支持本科生研究经验的研究人员受益。这将使众多REU项目的形成性改进，丰富本科学生的REU经验，并增强教师领导成功REU项目的能力，从而加强研究生院的管道和教师的职业发展。此外，本项目的研究成果将有助于开展多站点项目评估的评估能力建设研究。

This project will provide long-term support for external evaluation activities and services for the Computing and Information Sciences and Engineering Research Experiences for Undergraduates (CISE REU) community. This project will address the ongoing need among principal investigators who are fulfilling CISE REU Site program evaluation efforts by providing an evaluation toolkit that facilitates evaluation reporting while strengthening research about undergraduate research program outcomes. The primary purpose of the evaluation toolkit is to provide targeted instructional resources and tools for quality program evaluation that balance the desire for standardized assessment along with the responsibility to account for individual program contexts. Toolkit contents include instructional materials about evaluation practice, a standardized applicant management tool, and a validated modulated outcomes measure. Services associated with the toolkit are providing a Common Application for site recruiting, a Shared Applicant Pool for principal investigators to share applicants across sites, delivery of an online student survey known as the A la Carte Student Survey, and corresponding responses to REU Site principle investigators. Project expansion will continue these tools and services as well as expand to include a Faculty Career Impact Survey, Student REU Alumni Survey, and a study of site organizational characteristics. The benefits of the toolkit are in providing cost effective, sustainable evaluation tools, a community forum for program evaluation, and aggregate measurement of key program outcomes indicators for the national program. The evaluation toolkit project balances the need for individual site context evaluation with the need for broader, generalizable program impact evaluation. Intellectual MeritThe intellectual merit of this project resides in the contributions to understanding the impact of undergraduate computing research programs for both students and faculty participants. The comprehensive program evaluation will inform collective efforts to recruit undergraduate students to doctoral programs. The program evaluation will generate knowledge about features of REU Site structure for enhancing student learning outcomes and motivating individuals to pursue advanced degrees and careers in research. The knowledge generated by this study will also provide insights about how faculty engage in REU Sites and the impact on their careers.Broader ImpactsThe broader impact of the project will be evidenced by the instruments and online tools developed by this project that will benefit any researcher involved in supporting research experiences for undergraduates. This will enable formative improvements for numerous REU programs, enrich REU experiences for undergraduate students, and augment faculty capacity for leading successful REU programs, thereby enhancing the graduate school pipeline and faculty career development. In addition, the outcomes of the proposed project will contribute to evaluation capacity building research for multi-site program assessment.