Using Augmented Reality and Artificial Intelligence to Improve Teaching and Learning Spatial Transformations in STEM Disciplines

用来描述空间变换的数学对本科生来说是非常困难的。虽然在物理世界中移动某物可能很容易理解，但在数字世界中用数学描述相同的操作可能会令人望而生畏。该项目将开发使用增强现实（AR）和人工智能（AI）的新技术，以改善STEM学科中这些困难概念的教学和学习以及创造性的努力。该项目将测试使用新的AR/AI技术来增强学生对空间转换背后的数学的学习。这将改善AR/ ai驱动的精确运动跟踪对象的使用，可以收集高分辨率的原位运动和场景数据，以增强学习分析。该项目将确定AR功能，帮助学生构思、连接和比较运动的数学表示，以克服学生在学习空间转换时面临的充分记录的困难。加强这一技能将支持他们在许多STEM学科的持续发展。将开发AR/ ai驱动的创新学习环境，并评估其对欧几里得空间中主要旋转和方向表示的教学和学习的影响。不同层次的抽象，包括轴角，欧拉角，矩阵和四元数将被测试。在研讨会上，参与者将使用和转换3d打印的几何模型，以评估AR/AI技术的有效性。该项目将通过比较研讨会前和研讨会后测试中的数学技能，与没有使用AR/AI技术的学生完成相同任务的情况下的数学技能，来评估学生的学习成果。该项目将通过探索：a)新型AR交互的作用，允许物理和虚拟操作之间的相互作用，使学生参与具体化学习；b)增强现实的能力，使困难的无形概念可见，以支持对空间推理和数学公式的直观和正式理解；c) AR的特点，帮助学生看到空间操作和数学运算之间的关系；d)使用ar辅助数学学习时，个体差异对空间转换的潜在影响。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

The mathematics that are used to describe spatial transformations can be very difficult for undergraduate students. While moving something in the physical world may be easy to understand, describing the same operation with math in the digital world can be daunting. This project will develop new technology using Augmented Reality (AR) and Artificial Intelligence (AI) to improve the teaching and learning of these difficult concepts in STEM disciplines as well as creative endeavors. The project will test the use of new AR/AI technology to enhance students’ learning of the mathematics behind spatial transformations. This will improve the use of AR/AI-powered precise motion tracking of objects that can collect high resolution in-situ motion and scene data to enhance learning analytics. The project will identify the AR capabilities that can help students conceive, connect, and compare mathematical representations of motion to overcome the well-documented difficulties students face when learning spatial transformations. Strengthening this skill will support their continued development across many STEM disciplines.An AR/AI-powered innovative learning environment will be developed and evaluated for its effects on teaching and learning major rotation and orientation representations in the Euclidean space. Different levels of abstraction, including Axis-Angle, Euler Angles, Matrices, and Quaternions will be tested. In workshops participants will play with and transform 3D-printed geometry models to evaluate the effectiveness of the AR/AI technology. The project will assess student learning outcomes by comparing math skills in pre- and post-workshop tests compared to students working through the same tasks without the use of the AR/AI technology. The project will contribute to advancing knowledge across disciplines of spatial and mathematical pedagogies, by exploring: a) the role of novel AR interaction that allows the interplay between physical and virtual manipulatives to engage students in embodied learning; b) the capabilities of AR to make difficult invisible concepts visible for supporting an intuitive and formal understanding of spatial reasoning and mathematical formulation; c) the features of AR that help students see relationships between spatial manipulations and mathematical operations; and d) the potential impact of individual differences in spatial transformations when using AR-assisted mathematical learning.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.