Integration of Computer-Assisted Methods and Human Interactions to Understand Lesson Plan Quality and Teaching to Advance Middle-Grade Mathematics Instruction

教材的设计与选择是数学教学中最复杂、最重要的组成部分之一。随着在线教学材料的不断扩散，学校和教育工作者除了教科书外，还依赖于它们。虽然免费开放教育资源有其优势，但确保其质量和对教师和学生的效用仍然是最重要的问题。这项研究的一个重要贡献是确定如何使用先进的机器学习技术，有效的数学教育知识和人类反馈的整合来衡量大量课程计划的质量。该项目的后期阶段包括采访教师的规划实践，测量教案质量，并分析学生的工作，提供在中年级数学教案质量的多个角度。使用机器学习来衡量课程计划质量对数学教育领域具有变革潜力。该项目将确定使用自然语言处理和人类编码的混合方法来分析大量数学课程计划的方法。该项目的重点是中年级数学课，包括教师和学生的数据以及教案文件本身。本研究有三个研究目的。第一，制定一个共享的概念框架，并通过组织领先的研究人员和熟练的教师的专家计划，为中年级数学质量的课程计划的具体尺寸。第二，通过采用最先进的计算机辅助方法（例如，机器学习）和人工编码来分析根据知识共享许可证获得的大量数字课程计划。第三，进行探索性的顺序混合方法的研究，教师如何参加，解释和选择信息，以创建自己的教案，以及如何教案质量与学生完成的数学作业。混合方法的教案质量评价方法是推进数学教学研究的一项重要创新。该项目由NSF的EDU核心研究（ECR）计划支持。ECR计划强调基础STEM教育研究，产生该领域的基础知识。该奖项反映了NSF的法定使命，并通过使用基金会的智力价值和更广泛的影响力审查标准进行评估，被认为值得支持。

Planning and selecting instructional materials is one of the most complex and important components of mathematics teaching. As online instructional materials continue to proliferate, schools and educators are relying on them in addition to textbooks. While there are advantages to open educational resources that are freely available, questions about ensuring their quality and utility to teachers and students remain paramount. An important contribution of this study is identifying ways to measure the quality of large quantities of lesson plans using an integration of cutting-edge machine learning techniques, knowledge of effective mathematics education, and human feedback. Later phases of the project include interviewing teachers about their planning practices, measuring lesson plan quality, and analyzing students' work to provide multiple perspectives on mathematics lesson plan quality in the middle grades. The use of machine learning to measure lesson plan quality holds transformative potential for the field of mathematics education. The project will identify ways to analyze large numbers of mathematics lesson plans using a mixed methods approach of natural language processing and human coding. The project focuses on middle grades mathematics lesson and includes data from teachers and students as well as the lesson plan documents themselves. The study has three research aims. First, to develop a shared conceptual framework and specify dimensions of quality lesson plans for middle-grades mathematics by organizing an expert plan of leading researchers and skilled teachers. Second, to develop and validate measures to capture the key dimensions by applying state-of-the-art computer-assisted approaches (e.g., machine learning) and human coding to analyzing a large volume of digital lesson plans obtained under Creative Commons Licenses. Third, to conduct an exploratory sequential mixed-methods study of how teachers attend to, interpret, and select information to create their own lesson plans, and how lesson plan quality is related to students' completed mathematical work. The mixed methods approach to examining lesson plan quality is an important innovation for advancing research about mathematics teaching and learning. This project is supported by NSF's EDU Core Research (ECR) Program. The ECR program emphasizes fundamental STEM education research that generates foundational knowledge in the field. Investments are made in critical areas that are essential, broad and enduring: STEM learning and STEM learning environments, broadening participation in STEM, and STEM workforce development.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.