Collaborative Research: An Extended Reality Factory Innovation for Adaptive Problem-solving and Personalized Learning in Manufacturing Engineering

技术的快速发展增加了工业问题及其解决方案的复杂性和动态化特征。问题解决被理解为在不确定的环境中实现目标所需的过程。理解问题解决需要探索将问题概念化和从初始状态转移到目标所使用的过程。传统的问题解决方法更注重在静态情况下开发解决方案，而不是关注动态变化和技术中断的速度，这需要适应性问题解决技能(AP)。因此，要在这种环境中取得成功，未来的工程师应该具备APS技能。该项目将设计和开发一个带有物理传感器的虚拟工厂，以调查技术进步对解决问题技能的影响，并开发一个个性化的制造业教育学习平台，以满足学习者和教育工作者的需求。首先，将设计与制造业的过去、现在和未来相关的适应性问题情景。其次，将开发扩展现实(XR)环境，并将其与眼睛和运动跟踪相结合，以提供对学习行为和动态的实时监控。第三，将创建分析模型，以提高APS能力。研究成果将通过学术出版物和教育推广计划进行评估和传播。该项目将物理、虚拟现实和增强现实制造模拟与传感技术相结合，以表征和量化APS技能。该项目将通过模拟工业演变和制造环境的动态变化，对APS的教与学产生直接的积极影响。通过眼睛、面部和运动跟踪收集的丰富数据将被用于分析人类的非线性行为，从而提供动态模型，以改善用户的学习体验，优化APS技能。本研究将以以下问题为指导：(1)异质学习模式(物理、虚拟、混合)在多大程度上提升了问题解决体验？(2)人工智能和虚拟代理的整合对个性化学习有何影响？以及，(3)如何利用传感器信号来模拟和分析APS技能的发展过程？这项研究还将描述分析和解决问题的多种途径，以及驱动这些途径的因素。该项目将为XR模拟提供实用工具，以补充课堂教学，并帮助教育工作者诊断和定制教学以满足学习者的需求。项目成果将为包括本科生和研究生在内的不同学习者提供实践和身临其境的体验，并为他们为下一次工业革命做好更好的准备。传感技术与XR环境的集成也将促进不同学习者的交流和问题解决。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

Rapid advances in technology increase the complexity and dynamic characteristics of problems and their solutions in industry. Problem solving is understood as the process required to achieve a goal in an uncertain environment. Understanding problem-solving entails exploring the processes used in conceptualizing the problem and in moving from the initial state to the goal. Traditional problem-solving approaches focus more on developing solutions in static situations, and are less concerned about the pace of dynamic changes and technological disruptions, which require adaptive problem-solving skills (APS). Thus, to succeed in this environment, future engineers should be equipped with APS skills. This project will design and develop a virtual factory, with physical sensors, to investigate the impact of technological advances on problem-solving skills and develop a personalized learning platform for manufacturing education to meet the needs of learners and educators. First, adaptive problem situations that relate to the past, present, and future of manufacturing will be designed. Second, extended reality (xR) environments will be developed and integrated with eye and motion tracking to provide real-time monitoring of learning behavior and dynamics. Third, analytical models will be created to enhance the proficiency of APS abilities. Research outcomes will be evaluated and disseminated via scholarly publications and educational outreach programs. This project integrates physical, virtual reality and augmented reality manufacturing simulations with sensing technology to characterize and quantify APS skills. The project will have a direct positive impact on teaching and learning of APS by simulating the industrial evolutions and dynamical changes in manufacturing settings. Rich data collected through eye, facial and motion tracking will be utilized to analyze nonlinear human behaviors, thereby providing dynamic models to improve the user learning experience and optimize APS skills. The research will be guided by the following questions: (1) To what extent do heterogeneous learning modes (physical, virtual, mixed) enhance the problem-solving experience? (2) What is the impact of integrating artificial intelligence and virtual agents on personalized learning? and, (3) How to leverage sensor signals to model and analyze the development process of APS skills? This research will also characterize multiple pathways of analyzing and solving problems, as well as the factors driving these pathways. The project will provide practical tools for xR simulations that will complement classroom instruction and help educators diagnose and tailor instruction to learner needs. Project outcomes will provide hands-on and immersive experiences to diverse learners, including undergraduate and graduate students, and better prepare them for the next industrial revolution. Integration of sensing technologies with xR environments will also facilitate communication and problem-solving for a diversity of learners.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.