Collaborative Research: An Extended Reality Factory Innovation for Adaptive Problem-solving and Personalized Learning in Manufacturing Engineering

协作研究：制造工程中自适应问题解决和个性化学习的扩展现实工厂创新

• 批准号: 2302834
• 负责人: Hui Yang
• 金额: $ 38万
• 依托单位: Pennsylvania State Univ University Park
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-08-01 至 2026-07-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2302834&HistoricalAwards=false
• 关键词: Collaborative; Research; Extended; Reality; Factory

Rapid advances in technology increase the complexity and dynamic characteristics of problems and their solutions in industry. Problem solving is understood as the process required to achieve a goal in an uncertain environment. Understanding problem-solving entails exploring the processes used in conceptualizing the problem and in moving from the initial state to the goal. Traditional problem-solving approaches focus more on developing solutions in static situations, and are less concerned about the pace of dynamic changes and technological disruptions, which require adaptive problem-solving skills (APS). Thus, to succeed in this environment, future engineers should be equipped with APS skills. This project will design and develop a virtual factory, with physical sensors, to investigate the impact of technological advances on problem-solving skills and develop a personalized learning platform for manufacturing education to meet the needs of learners and educators. First, adaptive problem situations that relate to the past, present, and future of manufacturing will be designed. Second, extended reality (xR) environments will be developed and integrated with eye and motion tracking to provide real-time monitoring of learning behavior and dynamics. Third, analytical models will be created to enhance the proficiency of APS abilities. Research outcomes will be evaluated and disseminated via scholarly publications and educational outreach programs. This project integrates physical, virtual reality and augmented reality manufacturing simulations with sensing technology to characterize and quantify APS skills. The project will have a direct positive impact on teaching and learning of APS by simulating the industrial evolutions and dynamical changes in manufacturing settings. Rich data collected through eye, facial and motion tracking will be utilized to analyze nonlinear human behaviors, thereby providing dynamic models to improve the user learning experience and optimize APS skills. The research will be guided by the following questions: (1) To what extent do heterogeneous learning modes (physical, virtual, mixed) enhance the problem-solving experience? (2) What is the impact of integrating artificial intelligence and virtual agents on personalized learning? and, (3) How to leverage sensor signals to model and analyze the development process of APS skills? This research will also characterize multiple pathways of analyzing and solving problems, as well as the factors driving these pathways. The project will provide practical tools for xR simulations that will complement classroom instruction and help educators diagnose and tailor instruction to learner needs. Project outcomes will provide hands-on and immersive experiences to diverse learners, including undergraduate and graduate students, and better prepare them for the next industrial revolution. Integration of sensing technologies with xR environments will also facilitate communication and problem-solving for a diversity of learners.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

技术的快速进步增加了工业中问题及其解决方案的复杂性和动态特性。问题解决被理解为在不确定的环境中实现目标所需的过程。理解问题解决需要探索概念化问题和从初始状态到目标的过程。传统的问题解决方法更多地关注在静态情况下开发解决方案，而不太关心动态变化和技术中断的速度，这需要适应性问题解决技能（APS）。因此，为了在这种环境中取得成功，未来的工程师应该具备APS技能。该项目将设计和开发一个带有物理传感器的虚拟工厂，以调查技术进步对解决问题技能的影响，并为制造业教育开发一个个性化的学习平台，以满足学习者和教育者的需求。首先，将设计与制造业的过去、现在和未来相关的自适应问题情境。其次，将开发延展实境（xR）环境，并将其与眼睛和运动跟踪相结合，以提供对学习行为和动态的实时监控。第三，建立分析模型，以提高APS能力的熟练程度。研究成果将通过学术出版物和教育推广计划进行评估和传播。该项目将物理，虚拟现实和增强现实制造模拟与传感技术相结合，以表征和量化APS技能。该项目将通过模拟制造环境中的工业演变和动态变化，对APS的教学产生直接的积极影响。通过眼睛，面部和运动跟踪收集的丰富数据将用于分析非线性人类行为，从而提供动态模型，以改善用户学习体验并优化APS技能。本研究将围绕以下问题展开：（1）异质性学习模式（实体、虚拟、混合）在多大程度上增强了问题解决体验？(2)集成人工智能和虚拟代理对个性化学习有什么影响？（3）如何利用传感器信号对APS技能的发展过程进行建模和分析？这项研究还将描述分析和解决问题的多种途径，以及驱动这些途径的因素。该项目将为xR模拟提供实用工具，以补充课堂教学，并帮助教育工作者诊断和定制教学以满足学习者的需求。项目成果将为包括本科生和研究生在内的不同学习者提供动手和身临其境的体验，并为下一次工业革命做好更好的准备。将传感技术与xR环境相结合也将促进学习者的沟通和解决问题的多样性。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。