Community Resources for Automated Grading

该项目扩展并完全实现了基于Web的自动化测试中心Web-CAT。Web-CAT是一个创新的自动化评分平台，专注于学生测试自己的代码，而不是评估程序输出的正确性。Web-CAT鼓励学生练习理解、分析和评估技能，迫使他们不断表达自己对代码行为的理解。学生们练习写下关于他们的代码应该如何运行的假设，然后通过执行他们的测试来实验性地验证这种理解。Web-CAT已在一个机构得到正式评估，并已被另外三个机构成功采用。该项目有四个目标：扩大网络CAT从概念证明的状态，它可以被广泛分布和应用，无论是最终用户谁希望自动化他们的作业评分的做法，并通过教育研究人员谁希望建立在这个平台上开发和评估自己的自动化评估技术。为希望使用Web-CAT的教师开发教育材料，包括一本综合性的教学手册，其中包含最佳实践、示例作业、如何调整现有作业以进行自动评估以及为采用者举办的研讨会。开发一个希望使用、扩展和支持Web-CAT及其教学策略的教育工作者社区。该社区由维基和邮件列表以及SIGCSE研讨会等专业活动中的羽毛风格会议提供支持。评估Web-CAT在不同背景下的有效性。

This project expands and fully implements Web-CAT, the Web-based Center for Automated Testing. Web-CAT is an innovative automated grading platform that focuses on how well students test their own code, rather than assessing the correctness of a program's output. Web-CAT encourages students to practice comprehension, analysis, and evaluation skills by forcing them to continually articulate their own understanding of how their code should behave. Students practice writing down hypotheses about how their code should behave, and then experimentally validate this understanding by executing their tests. Web-CAT has been formally evaluated at one institution and has been successfully adopted by three others. This project has four objectives:To expand Web-CAT from a proof of concept to a state where it can be distributed and applied widely, both by end-users who wish to automate their assignment grading practices, and by educational researchers who wish to build on this platform to develop and evaluate their own automated assessment techniques. To develop educational materials for instructors who want to use Web-CAT, including a comprehensive teaching manual capturing best practices, example assignments, how-to's on adapting existing assignments for automated assessment, and workshops for adopters. To develop a community of educators who want to use, extend, and support Web-CAT and the teaching strategies it enables. The community is supported by a wiki and a mailing list, together with birds of-a-feather-style meetings at professional events such as the SIGCSE Symposium. To evaluate the effectiveness of Web-CAT in a diverse set of contexts.