Building Capacity for Course, Program, and Department Evaluation: Improving and Expanding the Student Assessment of Learning Gains Site

评估/研究(91)学生学习收获评估(SALG)工具已被证明是教师寻求形成性反馈以衡量学生学习进展和改进他们的教学的特别有效的工具。一个相关的网站极大地促进了SALG的使用，该网站使教师能够定制SALG仪器，让学生在线完成仪器，接收原始数据和简单的统计分析，并保持对他们数据的档案访问。在过去的5年里，超过1,000名本科生教师在3,000多门课程中使用了SALG，为超过65,000名学生提供了服务。为了响应日益增长的使用SALG的需求，该项目正在提高SALG网站的性能和可用性，并扩展该网站的能力，以满足过去、现在和未来教师对新的和更多样化的功能的要求。具体地说，(1)正在为项目评估员设计一个可广泛使用的工具和网站的原型版本，以支持NSF以成本效益改善对资助项目的评估的目标；(2)正在开发、评估和实施适合于部门和其他学术单位的版本，以用于项目评估、教师发展和认证；(3)SALG的机构实施正在进行试点测试，所获得的知识用于准备路线图，供未来在高等教育机构内使用。多学科项目团队包括SALG工具和网站的创建者。它为该项目带来了在使用SALG、STEM教育倡议的项目评估、STEM学院教学、教师专业发展、专业网站开发和项目管理方面的丰富经验。这个项目是一个以研究为基础的过程。它包括需求评估、与当前和未来的讲师用户、评估员和部门的咨询。它正在创建新的SALG仪器和网站功能，并将研究工具纳入SALG网站，使研究人员能够研究SALG的使用情况以及更广泛的国家评价趋势。更广泛的影响。升级后的SALG将教师直接置于形成性评估过程的中心，从而确保他们直接参与形成性反馈的过程和好处。让SALG可用于系项目评估，应该会将全国更多的教师与SALG和形成性评估联系起来。预计SALG的扩大使用将导致全国STEM教师的观点和活动发生根本性变化--即，更多地使用以学生学习成果为中心的形成性课堂评估，作为改善整个美国STEM高等教育的教师教学、课程活动和系级项目的一种手段。

Assessment/Research (91)The Student Assessment of Learning Gains (SALG) instrument has proven to be a particularly effective tool for faculty seeking formative feedback to gauge progress in student learning and improve their instruction. Use of the SALG is greatly facilitated by an associated Web site that enables instructors to customize the SALG instrument, have students complete the instrument online, receive raw data and simple statistical analyses, and maintain archival access to their data. In the past 5 years, over 1,000 undergraduate instructors in over 3,000 courses serving more than 65,000 students have used the SALG.In response to ever-increasing demand for use of the SALG, this project is increasing the performance and usability of the SALG site and also expanding the site's capabilities to meet past, present, and future instructor requests for new and more diverse functionalities. In particular, (1) a broadly usable prototyped version of the instrument and site is being designed for project evaluators to support the NSF goal of improved evaluation of funded projects with cost efficiency, (2) a version appropriate for departments and other academic units is being developed, evaluated, and implemented for use in program evaluation, faculty development, and accreditation, and (3) an institutional implementation of the SALG is being pilot tested, and the knowledge gained used to prepare a road map for future use within institutions of higher education.The multidisciplinary project team includes the creators of the SALG instrument and Web site. It brings to the project extensive experience in SALG use, program evaluation of STEM educational initiatives, STEM college teaching, faculty professional development, professional Web site development, and project management.Intellectual merit. This project is a research-grounded process. It includes needs assessments, consultation with current and prospective instructor users, evaluators, and departments. It is creating new SALG instruments and Web site functions, and integrating research tools into the SALG site that will enable researchers to study SALG use and, more broadly, national evaluation trends. Broader impacts. The upgraded SALG places instructors squarely at the center of the formative evaluation process, thus ensuring their direct engagement with the processes and benefits of formative feedback. Making the SALG available for department program evaluations should connect even more faculty across the nation with the SALG and formative evaluation. This expanded use of the SALG is expected to lead to fundamental changes in the perspectives and activities of the national STEM faculty - namely, increased use of formative classroom assessment centered on student learning gains as a means of improving faculty teaching, course activities, and departmental programs throughout STEM higher education in the United States.