CAREER: Using virtual reality to advance research and learning and promote positive skill transfer in complex environments with applications in enhanced flight training

职业：利用虚拟现实推进研究和学习，并在复杂环境中促进积极的技能转移，并应用于增强飞行训练

• 批准号: 2237851
• 负责人: Nicoletta Fala
• 金额: $ 56.48万
• 依托单位: Oklahoma State University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-09-01 至 2028-08-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2237851&HistoricalAwards=false
• 关键词: CAREER; Using; virtual; reality; advance

Virtual reality (VR) can simulate immersive scenarios that are unsafe or even impossible in the physical world. Immersion is especially important for pilots, who rely on simulation to train for routine operations, but also for emergencies. While dedicated, high-fidelity, and approved flight simulators are already used as part of flight training, their cost and space requirements prohibit their wider use. VR headsets connected to a computer simulator setup can enhance training both at home and within a flight training program. Despite the popularity of air travel and the need for pilots in the aviation industry, becoming a pilot is a dream that most abandon after childhood, either in pursuit of other passions or because of its prohibitive initial investment in cost and time, resulting in a nationwide pilot shortage. This project will study skill transfer from VR-based simulation to the real world by evaluating the physical, functional, and cognitive characteristics of simulation which impact a trainee’s ability to learn efficiently and effectively, as applied to the flight training environment. This project will make flight more accessible as a career and field of study through the use of virtual reality flight simulators. Additionally, it will broaden participation in aviation-careers and interests through outreach activities at local airports and by providing future pilots with online modules to help them initiate their training. Flight simulation performance-based and emergency response competitions will allow those already in training to test their skills and educate them on using flight simulation for their own practice. This award will enhance flight training, resulting in reduced flight training accidents and decreased time to certification, thus improving our ability to respond to the pilot shortage.This project will study skill transfer from virtual reality to the physical world by evaluating the physical, functional, and cognitive fidelity characteristics of simulation that impact a trainee pilot’s ability to learn efficiently and effectively. Two experiments will measure skill transfer. The first will train novice pilots completely in virtual reality and evaluate their abilities in the aircraft. The second will follow a group of pilots who are pursuing an instrument certificate throughout their training and complement their training with simulation scenarios on both traditional simulators and a virtual reality flight simulator. Complementing flight training with simulation will investigate the impact of virtual reality interventions on skill acquisition and mental workload management. The data collected through both experiments will be used to evaluate and validate the use of virtual reality in both research and training as an alternative to physical simulators. This work will collect flight data through on-board flight data recorders and simulation software, physiological data through eye tracking and heart rate monitoring, and psychometric data through mobile surveys. Scoring algorithms will detect and evaluate human performance on a series of maneuvers. This project will advance our understanding of how humans learn in complex virtual reality environments such as flight training, validating virtual reality systems as a training device option, and therefore reducing the cost and time of highly advanced training in fields, which require the use of multiple skills simultaneously. The research will identify which types of skills transfer, use data-driven metrics to measure skill acquisition and transfer, validate the use of eye tracking and hear rate metrics in virtual reality, and develop a framework to assess modern simulators based on how they address learning outcomes, informing policy and regulation. The integration of education and research in this proposal is focused on a three-level approach: (i) creating interest through outreach activities; (ii) empowering actions through online training modules and the use of VR-based flight simulation; (iii) advancing training through self-practice and semi-annual competitive flight simulation events.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

虚拟现实（VR）可以模拟在物理世界中不安全甚至不可能的沉浸式场景。对于飞行员来说，沉浸式训练尤为重要，他们不仅要依靠模拟训练进行日常操作，而且还要应对紧急情况。虽然专用的、高保真的、经过批准的飞行模拟器已经被用作飞行训练的一部分，但它们的成本和空间要求禁止它们更广泛地使用。连接到计算机模拟器设置的VR头显可以增强在家和飞行训练计划中的训练。尽管航空旅行很受欢迎，航空业也需要飞行员，但成为一名飞行员是大多数人在童年后放弃的梦想，要么是为了追求其他爱好，要么是因为它在成本和时间上的初始投资过高，导致全国范围内的飞行员短缺。该项目将通过评估模拟的物理、功能和认知特征来研究从基于vr的模拟到现实世界的技能转移，这些特征会影响学员在飞行训练环境中高效学习的能力。该项目将通过使用虚拟现实飞行模拟器使飞行更容易成为一种职业和研究领域。此外，它还将通过在当地机场开展外展活动，并为未来的飞行员提供在线模块，帮助他们开始培训，从而扩大他们对航空事业和兴趣的参与。基于飞行模拟性能和应急反应的比赛将允许那些已经接受培训的人测试他们的技能，并教育他们在自己的实践中使用飞行模拟。这项奖励将加强飞行训练，减少飞行训练事故，缩短认证时间，从而提高我们应对飞行员短缺的能力。该项目将通过评估模拟的物理、功能和认知保真度特征来研究从虚拟现实到物理世界的技能转移，这些特征会影响见习飞行员高效学习的能力。两个实验将测量技能转移。第一个项目将完全在虚拟现实中训练新手飞行员，并评估他们在飞机上的能力。第二组将跟随一组在整个培训过程中攻读仪表证书的飞行员，并通过传统模拟器和虚拟现实飞行模拟器的模拟场景来补充他们的培训。以模拟辅助飞行训练将研究虚拟现实干预对技能习得和心理负荷管理的影响。通过这两个实验收集的数据将用于评估和验证在研究和培训中使用虚拟现实作为物理模拟器的替代品。这项工作将通过机载飞行数据记录器和模拟软件收集飞行数据，通过眼动追踪和心率监测收集生理数据，通过移动调查收集心理测量数据。评分算法将检测和评估人类在一系列动作中的表现。该项目将推进我们对人类如何在复杂的虚拟现实环境（如飞行训练）中学习的理解，验证虚拟现实系统作为一种训练设备选项，从而减少需要同时使用多种技能的领域的高度先进训练的成本和时间。该研究将确定哪些类型的技能转移，使用数据驱动的指标来衡量技能获取和转移，验证虚拟现实中眼动追踪和听力指标的使用，并根据现代模拟器如何解决学习成果，为政策和法规提供信息，开发一个框架来评估它们。本提案将教育和研究结合起来，重点放在三个层次的方法上：(i)通过外展活动创造兴趣；（ii）通过在线培训模块和使用基于vr的飞行模拟来授权行动；（三）通过自我练习和半年度竞争性飞行模拟活动推进培训。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。