Virtual reality training of non-technical skills: The case of interoperability for first responders

在这个项目中，我们采用跨学科的方法，结合实验心理学和认知神经工程学，以确保全面了解和评估危机管理中的互操作性，进而用于开发和验证一个创新的、完整的沉浸式虚拟现实培训系统。虚拟现实模拟为培训人员提供了一个具有成本效益的平台，使用的模拟场景在事件、时间过程和情绪状态方面都是真实的。StellarX是一个虚拟和增强现实平台，由我们的行业合作伙伴OVA开发，将被改编为不同服务部门（警察、消防员、护理人员和公共安全）的培训系统。首先，行为标记将被识别，认知和与团队工作相关的度量将被定义，以评估非技术技能的获得，这些非技术技能需要在危机管理中得到支持和培训，以便最大限度地提高互操作性和性能。其次，生理和眼视指标将被确定为学员在危机管理期间的功能（认知和情感）状态的指标。我们提出的训练系统依赖于行为、生理和视觉数据，而这种系统的效率很大程度上取决于采样和组合不同指标的能力。最终的培训平台将支持公共安全和加拿大公民的福祉，而经验建立的一套经过验证的行为和生物标志物也将产生深远的好处，并使加拿大在信息通信技术和综合生物识别设备的进步方面具有优势。此外，该项目的成果将定义设计智能、自适应虚拟现实训练系统的指南和建议，其中包括基于生物识别和行为标记的用户认知和情感状态的在线监测

In this project, we adopt an interdisciplinary approach that combines experimental psychology and cognitive neuroergonomics, to ensure a thorough understanding and assessment of interoperability in crisis management, which in turn will be used to develop and validate an innovative and complete immersive virtual reality training system for first responders. Virtual reality simulations provide a cost-effective platform for training personnel, using simulated scenarios that are realistic in terms of their events, time course and emotional states. StellarX, a virtual and augmented reality platform, developed by OVA -our industry partner- will be adapted into a training system for responders of different services (police, firefighters, paramedics and public safety). First, behavioral markers will be identified and cognitive and teamwork-related metrics will be defined to evaluate the acquisition of non-technical skills that need to be supported and trained in crisis management in order to maximize interoperability and performance. Second, physiological and oculometric markers will be identified to act as indicators of the trainee's functional (cognitive and affective) states during crisis management. The training system we propose relies on behavioral, physiological and oculometric data, and the efficiency of such a system strongly depends upon the ability to sample and combine the different metrics. The ultimate training platform produced will support public safety and the well-being of Canadian citizens, while the set of validated behavioral and biomarkers empirically established will also have far-reaching benefits and give Canada an edge in terms of advances in ICT and integrative biometric devices. In addition, the outcomes of this project will define guidelines and recommendations for designing intelligent, adaptive virtual reality training systems that include the online monitoring of users' cognitive and affective state based on biometric and behavioral markers.**