CAREER: Using virtual reality to advance research and learning and promote positive skill transfer in complex environments with applications in enhanced flight training

虚拟现实(VR)可以模拟物理世界中不安全甚至不可能发生的身临其境的场景。沉浸对于飞行员来说尤其重要，他们依靠模拟来训练日常操作，但也是在紧急情况下。虽然专用的、高保真的和经过批准的飞行模拟器已经被用作飞行训练的一部分，但它们的成本和空间要求阻碍了它们的更广泛使用。连接到计算机模拟器设置的VR耳机可以增强在家中和飞行训练计划中的训练。尽管航空旅行很受欢迎，航空业也需要飞行员，但成为飞行员是大多数人在童年后放弃的梦想，要么是为了追求其他激情，要么是因为它在成本和时间上的初始投资令人望而却步，导致了全国范围内的飞行员短缺。这个项目将通过评估模拟的物理、功能和认知特征来研究从基于VR的模拟到真实世界的技能转移，这些特征影响受训者有效和有效地学习的能力，如应用于飞行训练环境。该项目将通过使用虚拟现实飞行模拟器，使飞行更容易成为一种职业和研究领域。此外，它还将通过在当地机场开展外联活动，并为未来的飞行员提供在线模块，帮助他们开始培训，从而扩大对航空职业和兴趣的参与。飞行模拟性能和应急反应比赛将允许那些已经接受训练的人测试他们的技能，并教育他们如何将飞行模拟用于自己的实践。该奖项将加强飞行训练，从而减少飞行训练事故和缩短认证时间，从而提高我们应对飞行员短缺的能力。这个项目将通过评估影响见习飞行员有效学习能力的物理、功能和认知逼真度特征来研究从虚拟现实到物理世界的技能转移。两个实验将测量技能转移。第一个项目将完全在虚拟现实中培训新手飞行员，并评估他们在飞机上的能力。第二个项目将跟踪一组飞行员，他们在整个培训过程中都在追求仪表证书，并在传统模拟器和虚拟现实飞行模拟器上用模拟场景来补充他们的培训。作为飞行训练与模拟的补充，将调查虚拟现实干预对技能获取和脑力工作负荷管理的影响。通过这两个实验收集的数据将用于评估和验证在研究和培训中使用虚拟现实作为物理模拟器的替代方案。这项工作将通过机载飞行数据记录器和模拟软件收集飞行数据，通过眼动跟踪和心率监测收集生理数据，通过移动调查收集心理测量数据。评分算法将检测和评估人类在一系列动作中的表现。该项目将增进我们对人类如何在复杂的虚拟现实环境中学习的理解，如飞行训练，验证虚拟现实系统作为培训设备选项，从而减少现场高级培训的成本和时间，这些培训需要同时使用多种技能。这项研究将确定哪些类型的技能转移，使用数据驱动的指标来衡量技能的获得和转移，验证眼球跟踪和听力指标在虚拟现实中的使用，并开发一个框架，根据现代模拟器如何处理学习结果、为政策和法规提供信息来评估它们。这项提议中的教育和研究的整合侧重于三个层面的方法：(I)通过外展活动创造兴趣；(Ii)通过在线培训模块和使用基于VR的飞行模拟来增强行动能力；(Iii)通过自我练习和每半年一次的竞争性飞行模拟活动来推进培训。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

Virtual reality (VR) can simulate immersive scenarios that are unsafe or even impossible in the physical world. Immersion is especially important for pilots, who rely on simulation to train for routine operations, but also for emergencies. While dedicated, high-fidelity, and approved flight simulators are already used as part of flight training, their cost and space requirements prohibit their wider use. VR headsets connected to a computer simulator setup can enhance training both at home and within a flight training program. Despite the popularity of air travel and the need for pilots in the aviation industry, becoming a pilot is a dream that most abandon after childhood, either in pursuit of other passions or because of its prohibitive initial investment in cost and time, resulting in a nationwide pilot shortage. This project will study skill transfer from VR-based simulation to the real world by evaluating the physical, functional, and cognitive characteristics of simulation which impact a trainee’s ability to learn efficiently and effectively, as applied to the flight training environment. This project will make flight more accessible as a career and field of study through the use of virtual reality flight simulators. Additionally, it will broaden participation in aviation-careers and interests through outreach activities at local airports and by providing future pilots with online modules to help them initiate their training. Flight simulation performance-based and emergency response competitions will allow those already in training to test their skills and educate them on using flight simulation for their own practice. This award will enhance flight training, resulting in reduced flight training accidents and decreased time to certification, thus improving our ability to respond to the pilot shortage.This project will study skill transfer from virtual reality to the physical world by evaluating the physical, functional, and cognitive fidelity characteristics of simulation that impact a trainee pilot’s ability to learn efficiently and effectively. Two experiments will measure skill transfer. The first will train novice pilots completely in virtual reality and evaluate their abilities in the aircraft. The second will follow a group of pilots who are pursuing an instrument certificate throughout their training and complement their training with simulation scenarios on both traditional simulators and a virtual reality flight simulator. Complementing flight training with simulation will investigate the impact of virtual reality interventions on skill acquisition and mental workload management. The data collected through both experiments will be used to evaluate and validate the use of virtual reality in both research and training as an alternative to physical simulators. This work will collect flight data through on-board flight data recorders and simulation software, physiological data through eye tracking and heart rate monitoring, and psychometric data through mobile surveys. Scoring algorithms will detect and evaluate human performance on a series of maneuvers. This project will advance our understanding of how humans learn in complex virtual reality environments such as flight training, validating virtual reality systems as a training device option, and therefore reducing the cost and time of highly advanced training in fields, which require the use of multiple skills simultaneously. The research will identify which types of skills transfer, use data-driven metrics to measure skill acquisition and transfer, validate the use of eye tracking and hear rate metrics in virtual reality, and develop a framework to assess modern simulators based on how they address learning outcomes, informing policy and regulation. The integration of education and research in this proposal is focused on a three-level approach: (i) creating interest through outreach activities; (ii) empowering actions through online training modules and the use of VR-based flight simulation; (iii) advancing training through self-practice and semi-annual competitive flight simulation events.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.