Meta-Analysis of Effectiveness of Simulation and Adaptive Learning Systems in STEM Education

该提案是为了响应EHR核心研究（ECR）计划公告NSF 15-509而提交的。在STEM教育的基础研究ECR计划提供资金在关键的研究领域是必不可少的，广泛的和持久的。EHR寻求有助于综合，建立和/或扩大以下重点领域研究基础的建议：STEM学习，STEM学习环境，STEM劳动力发展和扩大STEM参与。ECR计划的特点是强调积累强有力的证据，为以下努力提供信息：（a）理解，（B）建立理论解释，（c）提出干预措施（和创新），以解决STEM兴趣，教育，学习和参与方面的持续挑战。模拟和自适应学习系统是从K-12到研究生水平的STEM教育中广泛使用的教学技术。它们的使用得到了美国教育部在其2016年国家技术计划中的认可。使用模拟提供丰富的学习经验和及时的形成性评估是符合趋势的能力为基础的教育和国家科学基金会的工作，在推进网络学习。然而，缺乏使用这两种技术来吸引学习者和提高学习成果的循证实践。为了满足这一迫切需求，该项目将综合现有的关于两种技术在STEM教育中的有效性的知识，并确定基于证据的技术使用实践。这些努力将产生关于如何有效利用技术改变STEM教育的新知识，为美国建立更大更强的STEM劳动力，并最终确保国家未来的繁荣、创新潜力和全球经济竞争力。项目团队将进行两项独立的荟萃分析，以量化模拟和自适应学习系统对STEM学习和参与的影响。荟萃分析是一种强大的方法，可以综合多项研究的结果，并产生强大的累积证据，为未来的研究和实践提供信息。该项目将侧重于评估模拟和自适应学习系统在STEM教育中的有效性的研究。对于元分析中包含的每项研究，技术使用对学习者参与度的影响大小（例如，参与、享受、兴趣）和成就（例如，分数）将被计算。效应量是一个标准化的统计指标，它量化了效应的大小，并允许在研究中比较效应。将汇总所有纳入研究的效应量，以估计每种技术的总体效应量以及不同研究的效应量差异程度。还将进行分析，以确定效应量与技术使用方式的相关程度（即，教育学）以及效果大小是否随学习者特征而变化（例如，性别、年龄、种族）和学习环境（例如，提供模式、课程、设置、机构）。该项目将提供有关每种技术的有效性的及时和强有力的证据，为STEM学习，教学，未来研究和技术开发提供信息。

This proposal was submitted in response to EHR Core Research (ECR) program announcement NSF 15-509. The ECR program of fundamental research in STEM education provides funding in critical research areas that are essential, broad and enduring. EHR seeks proposals that will help synthesize, build and/or expand research foundations in the following focal areas: STEM learning, STEM learning environments, STEM workforce development, and broadening participation in STEM. The ECR program is distinguished by its emphasis on the accumulation of robust evidence to inform efforts to (a) understand, (b) build theory to explain, and (c) suggest interventions (and innovations) to address persistent challenges in STEM interest, education, learning, and participation.Simulation and adaptive learning systems are widely used instructional technologies in STEM education from K-12 to graduate levels. Their use was endorsed by the U.S. Department of Education in its 2016 national technology plan. Using simulation to provide rich learning experiences and timely formative assessment is aligned with the trend towards competency-based education and the NSF's work in advancing cyberlearning. However, evidence-based practices for using the two technologies to engage learners and enhance learning outcomes are lacking. To address this urgent need, this project will synthesize existing knowledge on the effectiveness of two technologies in STEM education and identify evidence-based practices of technology use. These efforts will generate new knowledge about how to use technology effectively to transform STEM education, build a larger and stronger STEM workforce for the U.S., and ultimately ensure the nation's future prosperity, innovation potential, and global economic competitiveness. The project team will conduct two separate meta-analyses to quantify the effects of simulation and adaptive learning systems on STEM learning and engagement. Meta-analysis is a powerful method to synthesize findings from multiple research studies and produce robust and accumulative evidence to inform future research and practice. This project will focus on research studies that evaluated the effectiveness of simulation and adaptive learning systems in STEM education. For each study included in meta-analyses, effect sizes of technology use on learners' engagement (e.g., participation, enjoyment, interest) and achievement (e.g., grades) will be calculated. Effect size is a standardized statistical measure that quantifies the magnitude of effects and allows comparison of effects across research studies. Effect sizes from all included studies will be pooled to estimate an overall effect size for each technology and the degree to which effect sizes vary from one study to another. Analyses will also be conducted to determine the extent to which effect sizes are related to how technology was used (i.e., pedagogy) and whether effect sizes vary by learner characteristics (e.g., gender, age, ethnicity) and learning environments (e.g., delivery modes, courses, settings, institutions). This project will provide timely and robust evidence regarding the effectiveness of each technology to inform STEM learning, teaching, future research, and technology development