Developing Integrated Evaluation Capacity for DSU RISE Programs

点击翻译按钮获取中文摘要

Developing Integrated Evaluation Capacity for DSU RISE Programs PROJECT DESCRIPTION In response to a call for supplemental funding to support evaluation capacity building within the NIH student training programs, we are proposing a project, referred to as Integrated Student Training Evaluation Program (IREP), designed to integrate our U-RISE program evaluation with the INBRE program evaluation to strengthen and align both efforts, increasing DSU’s evaluation capacity and sustainability. Although the U-RISE program has an evaluation component, the resources are not sufficient to integrate INBRE evaluation tools and processes into the DSU evaluation process nor is the current evaluation effort sustainable. The proposed evaluation integration process will include three phases. Phase 1 will be a four- month planning and development process in which an integrated mixed methods evaluation process and tools will be created. The INBRE Director of Evaluation, the ISTEP graduate student, and the ISTEP Project Director will share evaluation tools and processes and develop an integrated evaluation plan. Phase 2 is a four-month period of piloting the tools and processes. During this phase the ISTEP Project Director will train the graduate student on piloting procedures. The evaluation tools and processes will be reviewed by U-RISE staff and mentors and their feedback and suggestions will guide finalization. The data collected during the piloting phase will be used to evaluate the current U-RISE program. The ISTEP Project Director and graduate student will work with the U-RISE program staff to create a program improvement plan based on the evaluation findings, establishing an actionable feedback process.The final phase, Phase 3, is four-month process of revising and finalizing tools and processes and developing procedural manuals. Processes to seamlessly integrate the U-RISE evaluation and reporting requirements will be described and mechanisms to sustain the evaluation processes will be established. An internal data sharing process will be established so that the robust data produced through the ISTEP process continues to be shared at the faculty, department, College, and institutional levels. During Phase 3 the ISTEP process will be assessed to determine effectiveness. A summative evaluation of ISTEP goals will be conducted and will include evidence to support the assessment of each goal. The process established in this project will be maintained as part of the Center for Neighborhood Revitalization and Research responsibility to increase meaningful research opportunities for undergraduate and graduate students. Annually, the CNRR will recruit, train, and supervise a graduate student to conduct the DSU RISE program evaluations. The CNRR Director, also the proposed ISTEP Project Director, will continue to serve as liaison to the INBRE Evaluation to ensure data sharing and evaluation alignment. Information about the process to create an integrated evaluation model, impact of the model, and how to develop an integrated evaluation model will be disseminated through peer reviewed journals and practice journals and at professional meetings and conferences. The proposed effort will benefit the U-RISE program by creating a comprehensive, robust evaluation strategy that aligns seamlessly and directly with the INBRE program and with university assessment requirements. It will benefit the University by providing more accurate and detailed student success data as well as provide a model to systematically assess student achievements, success, and graduate school pipeline. Finally, it will benefit INBRE by providing more robust information about the training program and by providing an integrated evaluation model to replicate with other network institutions.