Using Behavioral Nudges in Peer Review to Improve Critical Analysis in STEM Courses

这个项目旨在通过提高学生的同行评议质量来服务于国家利益。同行评议，即学生有机会分析和评估他们的同班同学所做的项目，是一种被广泛认可的吸引学生的教学方法，并已成为本科教育的标准做法。同行评议最常用于人数众多的班级，以便及时提供对学生作业的反馈。然而，同行评审的好处远远超出了可伸缩性。同行评议收集不同的反馈，提高学生在专业环境中对自己的工作进行评估的舒适度，最重要的是，进行同行评议的行动往往比接受同行评议更有价值。目前使用的支持同行评议的软件平台近几十年来创新有限，提高学生成绩的潜在改进还没有得到彻底评估。本项目计划开发和研究一个创新的同行评议系统，该系统使用行为督促，一种微妙地强化积极习惯的方法，以提高学生的评估技能和他们在同行评议中提供的反馈的质量。本项目建议1)创建一个支持同行评议的软件系统，其中包括引导同行评议过程以磨练学生的评价和批判性分析技能的行为督促，以及2)研究行为督促的使用如何提高学生的参与度。该方法将使用四种不同的可视化课程进行评估，这些课程每年为大约800名学生提供服务。将对两组学生进行研究。控制组将使用同行评议，带有额外的反馈模式，但没有催促；而测试组将使用同行评议，具有相同的反馈模式，但也包括催促。常用的统计检验，如单因素方差分析、t检验和相关性，将被用来验证结果。由此产生的系统可以在利用不同STEM学科同行审查的课程结果方面提供显着和可衡量的改进。由此产生的技术将作为开放源码传播，以使人们能够广泛采用。NSF IUSE：EHR计划支持研究和开发项目，以提高所有学生的STEM教育的有效性。通过参与的学生学习路径，该计划支持有前景的实践和工具的创建、探索和实施。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

This project aims to serve the national interest by increasing the quality of peer reviews given by students. Peer reviews, in which students have the opportunity to analyze and evaluate projects made by their classroom peers, are a widely acknowledged pedagogical method for engaging students and have become a standard practice in undergraduate education. Peer review is most often used in classes with large number of students to provide timely feedback on student assignments. However, peer review has benefits far beyond scalability. Peer review gathers diverse feedback, raises students’ comfort level with having their work evaluated in a professional setting, and most importantly, the action of giving a peer review is often more valuable than receiving a peer review. The software platforms in current use that support peer review have seen limited innovation in recent decades, and potential improvements to enhance student outcomes have not been thoroughly evaluated. This project plans to develop and study an innovative peer review system that uses behavioral nudges, a method of subtlety reinforcing positive habits, to improve the evaluation skills of students and the quality of the feedback they provide in peer reviews.This project proposes to 1) create a software system supporting peer review that includes behavioral nudges for guiding the peer review process to hone students’ evaluation and critical analysis skills and 2) study how the use of behavioral nudges improves student engagement. The approach will be evaluated using four different visualization courses that serve approximately 800 students per year. Two groups of students will be studied. The control group will utilize peer review with additional feedback modalities but no nudges, while the test group will use peer review with the same feedback modalities but also include nudges. Common statistical tests such as, ANOVA, t-tests, and correlations, will be used to validate the results. The resulting system could provide a significant and measurable improvement in outcomes in courses that utilize peer review across different STEM disciplines. The resulting technologies will be disseminated as open source to enable widespread adoption. The NSF IUSE: EHR Program supports research and development projects to improve the effectiveness of STEM education for all students. Through the Engaged Student Learning track, the program supports the creation, exploration, and implementation of promising practices and tools.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.