Using Augmented Reality and Artificial Intelligence to Improve Teaching and Learning Spatial Transformations in STEM Disciplines

利用增强现实和人工智能改善 STEM 学科的教学空间转换

• 批准号: 2119549
• 负责人: Wei Yan
• 金额: $ 85万
• 依托单位: Texas A&M University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-10-01 至 2024-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2119549&HistoricalAwards=false
• 关键词: Using; Augmented; Reality; Artificial; Intelligence

The mathematics that are used to describe spatial transformations can be very difficult for undergraduate students. While moving something in the physical world may be easy to understand, describing the same operation with math in the digital world can be daunting. This project will develop new technology using Augmented Reality (AR) and Artificial Intelligence (AI) to improve the teaching and learning of these difficult concepts in STEM disciplines as well as creative endeavors. The project will test the use of new AR/AI technology to enhance students’ learning of the mathematics behind spatial transformations. This will improve the use of AR/AI-powered precise motion tracking of objects that can collect high resolution in-situ motion and scene data to enhance learning analytics. The project will identify the AR capabilities that can help students conceive, connect, and compare mathematical representations of motion to overcome the well-documented difficulties students face when learning spatial transformations. Strengthening this skill will support their continued development across many STEM disciplines.An AR/AI-powered innovative learning environment will be developed and evaluated for its effects on teaching and learning major rotation and orientation representations in the Euclidean space. Different levels of abstraction, including Axis-Angle, Euler Angles, Matrices, and Quaternions will be tested. In workshops participants will play with and transform 3D-printed geometry models to evaluate the effectiveness of the AR/AI technology. The project will assess student learning outcomes by comparing math skills in pre- and post-workshop tests compared to students working through the same tasks without the use of the AR/AI technology. The project will contribute to advancing knowledge across disciplines of spatial and mathematical pedagogies, by exploring: a) the role of novel AR interaction that allows the interplay between physical and virtual manipulatives to engage students in embodied learning; b) the capabilities of AR to make difficult invisible concepts visible for supporting an intuitive and formal understanding of spatial reasoning and mathematical formulation; c) the features of AR that help students see relationships between spatial manipulations and mathematical operations; and d) the potential impact of individual differences in spatial transformations when using AR-assisted mathematical learning.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

用于描述空间变换的数学对于本科生来说可能非常困难。 虽然在物理世界中移动东西可能很容易理解，但在数字世界中用数学描述同样的操作可能会令人望而生畏。 该项目将使用增强现实（AR）和人工智能（AI）开发新技术，以改善STEM学科中这些困难概念的教学和学习以及创造性的努力。 该项目将测试新的AR/AI技术的使用，以增强学生对空间变换背后的数学的学习。 这将改善AR/AI驱动的对象精确运动跟踪的使用，可以收集高分辨率的原位运动和场景数据，以增强学习分析。该项目将确定AR功能，可以帮助学生构思，连接和比较运动的数学表示，以克服学生在学习空间变换时面临的有据可查的困难。 加强这一技能将支持他们在许多STEM学科的持续发展。将开发一个AR/AI驱动的创新学习环境，并评估其对欧几里德空间中主要旋转和方向表示的教学和学习效果。 不同层次的抽象，包括轴角，欧拉角，矩阵和四元数将被测试。在研讨会上，参与者将使用和转换3D打印的几何模型，以评估AR/AI技术的有效性。该项目将通过比较研讨会前和研讨会后测试中的数学技能与在不使用AR/AI技术的情况下完成相同任务的学生来评估学生的学习成果。该项目将有助于推进空间和数学知识的跨学科，通过探索：a）新的AR交互的作用，允许物理和虚拟操作之间的相互作用，使学生参与具体学习; B）AR的能力，使难以无形的概念可见，以支持空间推理和数学公式的直观和正式的理解; c）增强现实的功能，帮助学生看到空间操作和数学运算之间的关系; d）使用增强现实辅助数学学习时，空间转换中的个体差异的潜在影响。该奖项反映了NSF的法定使命，并已被认为是值得通过使用基金会的智力价值和更广泛的影响审查标准进行评估的支持。

项目成果

Design and Evaluation of an Augmented Reality App for Learning Spatial Transformations and their Mathematical Representations

用于学习空间变换及其数学表示的增强现实应用程序的设计和评估

• DOI: 10.1109/vrw55335.2022.00155
• 发表时间: 2022
• 期刊: 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW
• 作者: Shaghaghian, Zohreh;Burte, Heather;Song, Dezhen;Yan, Wei
• 通讯作者: Yan, Wei

3D-Model-Based Augmented Reality for Enhancing Physical Architectural Models

基于 3D 模型的增强现实增强物理建筑模型

• 发表时间: 2022
• 期刊: Proceedings of the 40th Conference on Education and Research in Computer Aided Architectural Design in Europe (eCAADe 2022
• 作者: Tuzun Canadinc, Seda;Yan, Wei
• 通讯作者: Yan, Wei

An Augmented Reality Application and User Study for Understanding and Learning Architectural Representations

用于理解和学习建筑表示的增强现实应用程序和用户研究

• DOI: 10.1109/vrw58643.2023.00241
• 发表时间: 2023
• 期刊: 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW
• 作者: Ashour, Ziad;Shaghaghian, Zohreh;Yan, Wei
• 通讯作者: Yan, Wei

Learning Spatial Transformations and their Math Representations through Embodied Learning in Augmented Reality

通过增强现实中的具身学习来学习空间变换及其数学表示

• DOI: 10.1007/978-3-031-05675-8_10
• 发表时间: 2022
• 期刊: Learning and Collaboration Technologies. Novel Technological Environments. HCII 2022. Lecture Notes in Computer Science.
• 作者: Shaghaghian, Z.;Burte, H.;Song, D.;Yan, W.
• 通讯作者: Yan, W.