An Explanatory Machine Learning Framework for Teacher Effectiveness in STEM Education

该项目旨在通过开发解释性机器学习方法来研究STEM教育的教学效果，从而服务于国家利益。有一致的证据表明，教师的效率差异很大，但传统的分析方法在很大程度上无法解释为什么以及在什么情况下，教学和教师会有所不同。解释性机器学习方法在发展公平和有效的STEM教学的基本知识和理论方面具有巨大的潜力，因为它们可以跟踪教学理论固有的和隐含的复杂特征、过程和模式，而传统方法无法做到这一点。在这个项目中，我们考察了我们可以在多大程度上利用机器学习方法来识别和解释产生学生学习的概况、途径和做法(例如，谁是教师，教师知道什么，教师相信什么，感知和经历什么，教师做什么)，以及这些概况和做法在STEM教育背景下有何不同。该项目的成果有可能加速有效教学、教师培训、教师发展和学生学习的理论和实践研究。这是一个为期三年的BCSER：STEM教育研究中的个人研究者发展项目，在STEM学习和学习环境研究中。STEM教育和教师发展领域在发展复杂的教学和学习理论以及支持和实施这些理论研究(例如，教师知识、对文化反应的教师自我效能、课堂观察)的工具和措施方面取得了实质性进展。然而，最近的文献指出，我们在有效教师和教学理论中发现的复杂性与我们用来分析这些理论的主流方法之间存在着不匹配。例如，理论认为教学是一种高度互动、自适应、非线性和依赖于背景的实践；然而，该领域几乎完全依赖于简单的线性回归模型，无法容易地检测和分析这些复杂的模式。越来越多的人认识到，有必要制定、发展和发展专门针对科技教育和教育研究目的的方法。该项目旨在通过开发和调整解释性机器学习方法(例如，神经网络)来分析教学有效性的研究，并检查这些方法在多大程度上能够以优于传统方法的方式预测、解释有效教学并将其联系起来，从而填补这一空白。这些成果有可能通过确定在各种背景下和跨背景下有效教学的复杂特征和概况，以及开发广泛适用于STEM教育研究的可扩展的机器学习方法，来广泛地建设能力并影响该领域。该项目通过与比尔和梅琳达·盖茨基金会、施密特期货公司和沃尔顿家庭基金会的合作伙伴关系得到支持。该项目还得到了NSF的STEM教育研究EDU核心研究能力建设计划(ECR：BCSER)的支持，该计划旨在建设研究人员在STEM学习和学习环境、扩大STEM领域的参与和STEM劳动力发展等核心领域开展高质量STEM教育研究的能力。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

This project aims to serve the national interest by developing explanatory machine learning methods for the study of teaching effectiveness in STEM education. There is consistent evidence that teachers vary widely in their effectiveness but conventional analytic methods have largely failed to explain why and under what contexts teaching and teachers vary. Explanatory machine learning methods hold significant potential in developing fundamental knowledge and theories of equitable and effective STEM teaching because they can track complex features, processes and patterns inherent in and implied by theories of teaching in ways where conventional methods fall short. In this project, we examine the extent to which we can leverage machine learning methods to identify and explain profiles, pathways and practices (e.g., who teachers are, what teachers know, what teachers believe, perceive and experience, what teachers do) that produce student learning and how these profiles and practices vary across STEM education contexts. The outcomes of this project have the potential to accelerate research on the theory and practice of effective teaching, teacher preparation, teacher development and student learning. This is a three-year BCSER: Individual Investigator Development project in STEM Education Research within Research on STEM Learning and Learning Environments.The fields of STEM education and teacher development have made substantial progress in developing sophisticated theories of teaching and learning and instruments and measures that support and operationalize research on those theories (e.g., teacher knowledge, culturally responsive teacher self-efficacy, classroom observations). Recent literature has, however, noted that there is a mismatch between the complexity found in our theories of effective teachers and teaching and the prevailing methods we use to analyze those theories. For example, theories suggest that teaching is a highly interactive, adaptive, nonlinear and context-dependent practice; yet the field has almost exclusively drawn on simple linear regression models that cannot readily detect and analyze these complex patterns. There is a growing recognition of the need to craft, develop and grow methodologies specific to the purposes of STEM teaching and learning research. This project aims to fill this gap by developing and adapting explanatory machine learning methods (e.g., neural networks) to analyze studies of teaching effectiveness and examining the extent to which these methods can predict, explain and contextualize effective teaching in ways that outperform conventional methods. The results have the potential to broadly build capacity and impact the field by identifying complex features and profiles of effective teaching within and across contexts and developing scalable machine learning methods that are broadly applicable to STEM education studies. This project is supported through a partnership with the Bill & Melinda Gates Foundation, Schmidt Futures, and the Walton Family Foundation. This project is also supported by NSF's EDU Core Research Building Capacity in STEM Education Research (ECR: BCSER) program, which is designed to build investigators' capacity to carry out high-quality STEM education research in the core areas of STEM learning and learning environments, broadening participation in STEM fields, and STEM workforce development.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.