FW-HTF-RL/Collaborative Research: The Future of Aviation Inspection: Artificial Intelligence and Mixed Reality as Agents of Transformation

在全球范围内，经济依赖于安全的航空旅行;然而，由于人为错误占飞机事故的70%，因此需要重点帮助那些负责确保现代和未来飞机安全性和可靠性的人。航空维修技术人员经常努力跟上航空业的需求，因为他们受到危险的工作环境，高认知负荷，复杂的任务和日益严重的工人短缺的影响，而且这种斗争只会随着未来对他们的需求的增加而增长。人类技术前沿工作的未来-研究：大型（FW-HTF-RL）奖支持一个合作研究项目，以应对这一挑战，由一组大学，专业组织和行业合作伙伴领导：克莱姆森大学，普渡大学，格林维尔技术学院，SA技术，国家自主技术中心，航空技术员教育理事会，ChooseAerospace，Frontier Airlines，AAR，共和航空公司、阿特拉斯航空公司、史蒂文斯航空公司、Vericor公司、AMFA公司和洛克希德·马丁公司。该研究项目的目标是融合人工智能（AI）和延展实境（XR）技术的专业知识和技术进步，以提高航空维修技术人员在检查任务中的认知能力。 中心思想是，这种增强可以提高他们的检查能力，减少工作量，并最终减少因维护错误造成的航空事故数量。从长远来看，这些努力将不断改善未来航空维修技术人员和机队的整体健康状况。此外，虽然这项工作优先考虑航空维修部门的立即探索，但利用信息丰富的任务，目视检查和日常维护的类似领域将受益于所展示的技术集成。该项目汇集了多个学科，包括人因工程，计算机科学，人机交互，行为和社会科学，经济学和航空维修。调查员团队的结构是为了实现多个趋同目标。首先，这项工作利用人为因素、行为科学和人机交互学科来了解合并的AI和XR技术对航空维修技术人员认知过程的影响，以及将这些技术整合到这支劳动力队伍中的潜在风险。其次，该研究项目利用计算机科学和人机交互来设计和开发新的人工智能模型，这些模型可以根据通过XR技术收集的信息进行飞机检查并提出维护建议。研究团队将帮助设计沟通和互动模式，以便未来的航空维修技术人员能够理解和接受这些建议。第三，该项目可以在航空维修领域提供人工智能和XR技术的突破性整合，以帮助航空维修技术人员真实的时间。最后，这一努力将其他三个目标的结果与社会和劳动力数据相结合，以量化人工智能和XR技术对航空维修领域和邻近工作场所的经济可行性和影响。该项目由人类技术前沿跨部门计划的未来工作资助，以促进对相互依赖的人类的更深入的基本理解。该奖项反映了NSF的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准。

Globally, economies rely on safe air travel; however, with human error accounting for 70% of aircraft accidents, an emphasis needs to be placed on helping those responsible for ensuring the safety and reliability of modern and future aircrafts. Aviation maintenance technicians routinely struggle to keep pace with the needs of the aviation industry as they are impacted by a hazardous work environment, high cognitive load, a complex task, and growing worker shortages, and this struggle is only poised to grow as the need for them is slated to increase in the future. This Future of Work at the Human-Technology Frontier - Research: Large (FW-HTF-RL) award supports a collaborative research project to address this challenge, led by a group of universities, professional organizations and industry partners: Clemson University, Purdue University, Greenville Technical College, SA Technologies, National Center for Autonomous Technologies, Aviation Technician Education Council, ChooseAerospace, Frontier Airlines, AAR, Republic Airways, Atlas Air, Stevens Aerospace, Vericor, AMFA, and Lockheed Martin. The goal of this research project is to merge expertise and technological advancements in Artificial Intelligence (AI) and Extended Reality (XR) technologies to enhance the cognitive capabilities of aviation maintenance technicians during inspection tasks. The central idea is that this augmentation could increase their inspection capabilities, reduce workload, and ultimately reduce the number of aviation accidents caused by maintenance errors. In the long term, these efforts will continuously improve the overall health of both future aviation maintenance technicians and aircraft fleets. Furthermore, while this work has prioritized the immediate exploration of the aviation maintenance sector, similar domains that leverage information-rich tasks, visual inspection, and routine maintenance stand to benefit from the demonstrated technological integrations. This project brings together several disciplines, including Human Factors Engineering, Computer Science, Human-Computer Interaction, Behavioral and Social Science, Economics, and Aviation Maintenance. The investigator team is structured to achieve multiple convergent goals. First, this work leverages human factors, behavioral science, and human-computer interaction disciplines to understand the impacts that merged AI and XR technologies will have on the cognitive process of aviation maintenance technicians and the potential risks associated with the integration of these technologies into this workforce. Second, this research project leverages computer science and human-computer interaction to design and develop novel AI models that perform aircraft inspections and make maintenance recommendations based on information gathered through XR technologies. The research team will help design communication and interaction paradigms so future aviation maintenance technicians can understand and accept these recommendations. Third, the project could provide the breakthrough integration of AI and XR technology within the aviation maintenance field to help aviation maintenance technicians in real time. Finally, this effort continuously synthesizes the results of the other three goals with society and workforce-derived data to quantify the economic feasibility and impact that AI and XR technologies will have on the aviation maintenance domain and adjacent workplace sectors. This project has been funded by the Future of Work at the Human-Technology Frontier cross-directorate program to promote a deeper fundamental understanding of the interdependent human-technology partnership in work contexts by advancing the design of intelligent work technologies that operate in harmony with human workers.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.