Virtual reality training of non-technical skills: The case of interoperability for first responders

在这个项目中，我们采用了一种结合实验心理学和认知神经工效学的跨学科方法，以确保对危机管理中的互操作性有一个透彻的了解和评估，这反过来将被用来开发和验证一个创新的、完整的沉浸式虚拟现实培训系统，供急救人员使用。虚拟现实模拟为培训人员提供了一个经济高效的平台，使用的模拟场景在事件、时间进程和情绪状态方面是真实的。StellarX是由我们的行业合作伙伴OVA开发的虚拟和增强现实平台，将被改造成一个针对不同服务(警察、消防员、护理人员和公共安全)的响应人员的培训系统。首先，将确定行为标记物，并定义与认知和团队合作相关的指标，以评估需要在危机管理方面得到支持和培训的非技术技能的获得，以便最大限度地提高互操作性和绩效。其次，将确定生理和眼球测量标记作为受训人员在危机管理期间的功能(认知和情感)状态的指示器。我们提出的训练系统依赖于行为、生理和眼球测量数据，而这种系统的效率很大程度上依赖于对不同度量进行采样和组合的能力。所生产的终极培训平台将支持公共安全和加拿大公民的福祉，而根据经验建立的一套经过验证的行为和生物标记物也将产生深远的好处，并使加拿大在ICT和综合生物识别设备方面的进步方面具有优势。此外，该项目的成果将确定设计智能、自适应虚拟现实培训系统的指导方针和建议，其中包括基于生物特征和行为标记对用户的认知和情感状态进行在线监测。

In this project, we adopt an interdisciplinary approach that combines experimental psychology and cognitive neuroergonomics, to ensure a thorough understanding and assessment of interoperability in crisis management, which in turn will be used to develop and validate an innovative and complete immersive virtual reality training system for first responders. Virtual reality simulations provide a cost-effective platform for training personnel, using simulated scenarios that are realistic in terms of their events, time course and emotional states. StellarX, a virtual and augmented reality platform, developed by OVA -our industry partner- will be adapted into a training system for responders of different services (police, firefighters, paramedics and public safety). First, behavioral markers will be identified and cognitive and teamwork-related metrics will be defined to evaluate the acquisition of non-technical skills that need to be supported and trained in crisis management in order to maximize interoperability and performance. Second, physiological and oculometric markers will be identified to act as indicators of the trainee's functional (cognitive and affective) states during crisis management. The training system we propose relies on behavioral, physiological and oculometric data, and the efficiency of such a system strongly depends upon the ability to sample and combine the different metrics. The ultimate training platform produced will support public safety and the well-being of Canadian citizens, while the set of validated behavioral and biomarkers empirically established will also have far-reaching benefits and give Canada an edge in terms of advances in ICT and integrative biometric devices. In addition, the outcomes of this project will define guidelines and recommendations for designing intelligent, adaptive virtual reality training systems that include the online monitoring of users' cognitive and affective state based on biometric and behavioral markers.**