Analyzing Student Usage and Outcome Data from a Randomized Experiment of Cognitive Tutor Algebra

代数解决数学，这是至关重要的进一步研究STEM概念和工作在许多技术职业。 然而，许多高中生努力通过代数。认知导师代数1（CTA1）是一门课程，包括教科书组件和自动化的计算机应用程序，旨在为学生提供个性化的指导。该项目将建立在一个随机对照实验的结果，检查CTA1的有效性。研究人员将通过检查学生在使用该程序时的行动和进展日志、教师调查数据和学生成绩数据中的模式，研究CTA1实现其效果的机制。该项目将使用贝叶斯统计模型来推断是否存在因果模型，解释积极的学习成果和课程使用之间的关系。PI将使用一种特殊形式的中介分析，鲁宾因果模型，来开发和测试假设，即学生在使用CTA1时会经历什么，而在没有CTA1的情况下会经历什么。 该分析方法支持识别治疗分配（CTA1）和结果（学生成绩）之间关系的中介变量。这项研究还测试使用一种特殊形式的调解分析，主要分层，以确定其效用进行这种分析。多个中介模型将被检查，以确定教育研究人员如何开发更好的实验研究。

Algebra addresses mathematics that is crucial for further study of STEM concepts and for work in many technical careers. Yet many high school students struggle to pass Algebra. Cognitive Tutor Algebra 1 (CTA1) is a curriculum that includes both textbook components and an automated computer application that is designed to deliver individualized instructions to students. This project will build on the findings of a randomized control experiment that examined the effectiveness of CTA1. The researchers will study the mechanisms by which CTA1 achieves its effect by examining patterns in logs of students' actions and progress while they use the program, teacher survey data and student achievement data. The project will employ Bayesian statistical models to infer if causal models exist that explain the relationship between positive learning outcomes and the use of the curriculum.The PIs will use a specific form of mediation analysis, the Rubin Causal Model, to develop and test hypotheses about what the students would have experienced with CTA1 versus what they would have experienced in its absence. This analysis methodology supports the identification of mediating variables on the relationship between a treatment assignment (CTA1) and an outcome (student achievement). The study also tests the use of a particular form of mediation analysis, principal stratification, to determine its utility in conducting such analyses. Multiple mediation models will be examined to determine how educational researchers might develop better experimental research studies.