CAREER: Using virtual reality to advance research and learning and promote positive skill transfer in complex environments with applications in enhanced flight training

虚拟现实（VR）可以模拟在物理世界中不安全甚至不可能的沉浸式场景。沉浸对于飞行员来说尤其重要，他们依靠模拟来训练日常操作，但也用于紧急情况。虽然专用的、高保真的和经过批准的飞行模拟器已经被用作飞行训练的一部分，但它们的成本和空间要求阻止了它们的广泛使用。连接到计算机模拟器设置的VR耳机可以增强在家和飞行训练计划中的训练。尽管航空旅行很受欢迎，航空业也需要飞行员，但成为一名飞行员是大多数人在童年后放弃的梦想，要么是为了追求其他激情，要么是因为其在成本和时间上的初始投资令人望而却步，导致全国范围内的飞行员短缺。本项目将研究从基于VR的模拟到真实的世界的技能转移，通过评估模拟的物理，功能和认知特征，这些特征影响学员的学习能力，有效地，适用于飞行训练环境。该项目将通过使用虚拟现实飞行模拟器，使飞行更容易成为职业和研究领域。此外，它还将通过在当地机场开展外联活动，并为未来的飞行员提供在线模块，帮助他们开始培训，扩大对航空职业和兴趣的参与。飞行模拟表演和应急反应比赛将使那些已经在训练中的人能够测试他们的技能，并教育他们使用飞行模拟进行自己的实践。该项目将加强飞行训练，从而减少飞行训练事故，缩短获得认证的时间，从而提高我们应对飞行员短缺的能力。该项目将通过评估模拟的物理、功能和认知逼真度特征，研究从虚拟现实到物理世界的技能转移，这些特征影响实习飞行员高效学习的能力。两个实验将测量技能转移。第一个将完全在虚拟现实中训练新手飞行员，并评估他们在飞机上的能力。第二个将跟随一组飞行员，他们在整个训练过程中都在追求仪表证书，并在传统模拟器和虚拟现实飞行模拟器上使用模拟场景来补充他们的训练。用模拟补充飞行训练将调查虚拟现实干预对技能获取和心理负荷管理的影响。通过这两个实验收集的数据将用于评估和验证虚拟现实在研究和培训中的使用，作为物理模拟器的替代品。这项工作将通过机载飞行数据记录器和模拟软件收集飞行数据，通过眼动跟踪和心率监测收集生理数据，通过移动的调查收集心理测量数据。评分算法将检测和评估人类在一系列演习中的表现。该项目将推进我们对人类如何在复杂的虚拟现实环境中学习的理解，例如飞行训练，验证虚拟现实系统作为培训设备选项，从而减少需要同时使用多种技能的领域的高级培训的成本和时间。该研究将确定哪些类型的技能转移，使用数据驱动的指标来衡量技能的获取和转移，验证眼动跟踪和听力指标在虚拟现实中的使用，并开发一个框架，以评估现代模拟器如何解决学习成果，为政策和法规提供信息。本建议中教育和研究的结合侧重于三个层面的方法：（i）通过外联活动引起兴趣;（ii）通过在线培训模块和使用虚拟现实飞行模拟增强行动能力;（三）通过自我实践和半该奖项反映了NSF的法定使命，并通过使用基金会的学术价值和更广泛的影响审查标准。

Virtual reality (VR) can simulate immersive scenarios that are unsafe or even impossible in the physical world. Immersion is especially important for pilots, who rely on simulation to train for routine operations, but also for emergencies. While dedicated, high-fidelity, and approved flight simulators are already used as part of flight training, their cost and space requirements prohibit their wider use. VR headsets connected to a computer simulator setup can enhance training both at home and within a flight training program. Despite the popularity of air travel and the need for pilots in the aviation industry, becoming a pilot is a dream that most abandon after childhood, either in pursuit of other passions or because of its prohibitive initial investment in cost and time, resulting in a nationwide pilot shortage. This project will study skill transfer from VR-based simulation to the real world by evaluating the physical, functional, and cognitive characteristics of simulation which impact a trainee’s ability to learn efficiently and effectively, as applied to the flight training environment. This project will make flight more accessible as a career and field of study through the use of virtual reality flight simulators. Additionally, it will broaden participation in aviation-careers and interests through outreach activities at local airports and by providing future pilots with online modules to help them initiate their training. Flight simulation performance-based and emergency response competitions will allow those already in training to test their skills and educate them on using flight simulation for their own practice. This award will enhance flight training, resulting in reduced flight training accidents and decreased time to certification, thus improving our ability to respond to the pilot shortage.This project will study skill transfer from virtual reality to the physical world by evaluating the physical, functional, and cognitive fidelity characteristics of simulation that impact a trainee pilot’s ability to learn efficiently and effectively. Two experiments will measure skill transfer. The first will train novice pilots completely in virtual reality and evaluate their abilities in the aircraft. The second will follow a group of pilots who are pursuing an instrument certificate throughout their training and complement their training with simulation scenarios on both traditional simulators and a virtual reality flight simulator. Complementing flight training with simulation will investigate the impact of virtual reality interventions on skill acquisition and mental workload management. The data collected through both experiments will be used to evaluate and validate the use of virtual reality in both research and training as an alternative to physical simulators. This work will collect flight data through on-board flight data recorders and simulation software, physiological data through eye tracking and heart rate monitoring, and psychometric data through mobile surveys. Scoring algorithms will detect and evaluate human performance on a series of maneuvers. This project will advance our understanding of how humans learn in complex virtual reality environments such as flight training, validating virtual reality systems as a training device option, and therefore reducing the cost and time of highly advanced training in fields, which require the use of multiple skills simultaneously. The research will identify which types of skills transfer, use data-driven metrics to measure skill acquisition and transfer, validate the use of eye tracking and hear rate metrics in virtual reality, and develop a framework to assess modern simulators based on how they address learning outcomes, informing policy and regulation. The integration of education and research in this proposal is focused on a three-level approach: (i) creating interest through outreach activities; (ii) empowering actions through online training modules and the use of VR-based flight simulation; (iii) advancing training through self-practice and semi-annual competitive flight simulation events.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.