Using Anchoring Vignettes to Improve Measures of Teaching Practice

使用锚定小插图改进教学实践措施

• 批准号: 1237543
• 负责人: John Engberg
• 金额: $ 78.63万
• 依托单位: Rand Corporation
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2012
• 资助国家: 美国
• 起止时间: 2012-09-15 至 2017-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1237543&HistoricalAwards=false
• 关键词: Using; Anchoring; Vignettes; Improve; Measures

The accuracy of self report of teachers' perceptions of their instructional practices has been a limitation in research and evaluation in education. This project is using a mixed methodological approach to address the extent to which the use of vignettes of teachers engaging in six different instructional practices lead to more accurate teacher self-report on their own practices. Researchers from the Rand Corporation and others in partnership with the Bill and Melinda Gates Foundation Measures of Effective Teaching Extension study will work with 220 teachers in grades 4-9. Research questions address the extent to which teachers understand the instructional practices being portrayed at different levels in the vignettes, the extent to which the use of anchoring vignettes improve teacher self-report , the extent to which information in the teachers' ratings of the vignettes can be used to improve the alignment of teachers' self-rating and expertly-trained raters observations of videos of these teachers, and how the vignette-calibrated teacher self-reports correlate with estimates of other outcomes of teaching such as student achievement or ratings of teachers. The research findings inform the research on the conditions of instructional practices and hold promise for effective feedback to teachers.Researchers in this project have identified important instructional practices and have developed expert-vetted vignettes that describe several levels of the quality of the instantiation of these practices. This project leverages the work conducted in the Gates MET project and collects survey data and video of classroom teaching from a sample of those teachers. The teachers rank the teaching as described in the vignettes and this ranking is used to calibrate their self-reported rating of their own teaching from surveys. The analysis of teacher videos is be used to provide another measure of teachers' practices. The researchers use the calibrated survey ratings of teaching to correlate with outcomes of teaching including value-added models of student achievement and student and principal ratings to examine the extent to which the calibrated surveys can be used as robust measures of teaching. Teacher evaluation as a policy area is an increasingly important theme in educational reform. The evaluation methodology that can provide more valid and reliable measures of teaching than simple self-report provides better evidence of the current educational practices. Better evidence of improvements in teaching practices as a result of selected professional development for teachers results in more-informed selection of those offerings. The findings from this study identify ways that robust information about teaching practices can been identified in cost-efficient ways that supplement the use of classroom observations.

教师对其教学实践感知的自我报告的准确性一直是教育研究和评估的一个限制。该项目使用混合方法来解决教师参与六种不同教学实践的小片段的使用在多大程度上导致教师对自己的实践更准确的自我报告。来自兰德公司和其他与比尔和梅琳达·盖茨基金会有效教学推广措施研究合作的研究人员将与4-9年级的220名教师合作。研究问题涉及教师对小视频中不同层次的教学实践的理解程度，锚定小视频的使用在多大程度上改善了教师的自我报告，教师对小视频的评分信息在多大程度上可以用来改善教师自我评分和经过专业培训的评分者对这些教师视频的观察的一致性。以及小插曲校准的教师自我报告如何与其他教学成果（如学生成绩或教师评分）的估计相关联。研究结果为教学实践条件的研究提供了信息，并有望有效地反馈给教师。该项目的研究人员已经确定了重要的教学实践，并开发了专家审查的小片段，描述了这些实践实例的几个质量水平。这个项目利用了盖茨MET项目中所做的工作，并从这些教师的样本中收集调查数据和课堂教学视频。教师按照小品中所描述的对教学进行排名，这个排名用于校准他们从调查中对自己教学的自我报告评级。对教师视频的分析可以为教师实践提供另一种衡量标准。研究人员使用校准的教学调查评级与教学结果相关联，包括学生成绩的增值模型和学生和校长评级，以检查校准调查在多大程度上可以用作教学的有力措施。教师评价作为一个政策领域，在教育改革中日益成为一个重要的主题。这种评价方法比简单的自我报告更能提供有效和可靠的教学衡量标准，为当前的教育实践提供了更好的证据。有更好的证据表明，教师选择专业发展的结果是教学实践的改进，结果是这些课程的选择更加明智。本研究的发现确定了一些关于教学实践的可靠信息可以以一种成本效益高的方式确定，这种方式补充了课堂观察的使用。