Collaborative Research: An Extended Reality Factory Innovation for Adaptive Problem-solving and Personalized Learning in Manufacturing Engineering

技术的快速进步增加了工业中问题及其解决方案的复杂性和动态特征。解决问题被理解为在不确定的环境中实现目标所需的过程。理解问题解决需要探索问题概念化和从初始状态到目标的过程。传统的问题解决方法更侧重于在静态情况下开发解决方案，而不太关注动态变化和技术中断的速度，这需要适应性问题解决技能（APS）。因此，为了在这种环境中取得成功，未来的工程师应该具备APS技能。该项目将设计和开发一个带有物理传感器的虚拟工厂，以研究技术进步对解决问题能力的影响，并为制造业教育开发一个个性化的学习平台，以满足学习者和教育者的需求。首先，将设计与制造业的过去、现在和未来相关的适应性问题情境。其次，将开发扩展现实（xR）环境，并将其与眼动跟踪相结合，以提供对学习行为和动态的实时监控。第三，建立分析模型，提高APS能力的熟练程度。研究成果将通过学术出版物和教育推广计划进行评估和传播。该项目将物理、虚拟现实和增强现实制造模拟与传感技术相结合，以表征和量化APS技能。该项目通过模拟工业发展和制造环境的动态变化，将对APS的教学产生直接的积极影响。通过眼睛、面部和动作跟踪收集的丰富数据将用于分析人类的非线性行为，从而提供动态模型，以改善用户的学习体验，优化APS技能。本研究将以以下问题为指导：(1)异构学习模式（物理、虚拟、混合）在多大程度上增强了解决问题的体验？(2)人工智能与虚拟代理的融合对个性化学习的影响是什么？(3)如何利用传感器信号对APS技能的发展过程进行建模和分析？本研究还将描述分析和解决问题的多种途径，以及驱动这些途径的因素。该项目将为xR模拟提供实用工具，以补充课堂教学，并帮助教育工作者根据学习者的需求进行诊断和定制教学。项目成果将为包括本科生和研究生在内的不同学习者提供动手和身临其境的体验，并为下一次工业革命做好更好的准备。传感技术与xR环境的集成也将促进各种学习者的交流和解决问题。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

Rapid advances in technology increase the complexity and dynamic characteristics of problems and their solutions in industry. Problem solving is understood as the process required to achieve a goal in an uncertain environment. Understanding problem-solving entails exploring the processes used in conceptualizing the problem and in moving from the initial state to the goal. Traditional problem-solving approaches focus more on developing solutions in static situations, and are less concerned about the pace of dynamic changes and technological disruptions, which require adaptive problem-solving skills (APS). Thus, to succeed in this environment, future engineers should be equipped with APS skills. This project will design and develop a virtual factory, with physical sensors, to investigate the impact of technological advances on problem-solving skills and develop a personalized learning platform for manufacturing education to meet the needs of learners and educators. First, adaptive problem situations that relate to the past, present, and future of manufacturing will be designed. Second, extended reality (xR) environments will be developed and integrated with eye and motion tracking to provide real-time monitoring of learning behavior and dynamics. Third, analytical models will be created to enhance the proficiency of APS abilities. Research outcomes will be evaluated and disseminated via scholarly publications and educational outreach programs.This project integrates physical, virtual reality and augmented reality manufacturing simulations with sensing technology to characterize and quantify APS skills. The project will have a direct positive impact on teaching and learning of APS by simulating the industrial evolutions and dynamical changes in manufacturing settings. Rich data collected through eye, facial and motion tracking will be utilized to analyze nonlinear human behaviors, thereby providing dynamic models to improve the user learning experience and optimize APS skills. The research will be guided by the following questions: (1) To what extent do heterogeneous learning modes (physical, virtual, mixed) enhance the problem-solving experience? (2) What is the impact of integrating artificial intelligence and virtual agents on personalized learning? and, (3) How to leverage sensor signals to model and analyze the development process of APS skills? This research will also characterize multiple pathways of analyzing and solving problems, as well as the factors driving these pathways. The project will provide practical tools for xR simulations that will complement classroom instruction and help educators diagnose and tailor instruction to learner needs. Project outcomes will provide hands-on and immersive experiences to diverse learners, including undergraduate and graduate students, and better prepare them for the next industrial revolution. Integration of sensing technologies with xR environments will also facilitate communication and problem-solving for a diversity of learners.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.