Virtual reality training of non-technical skills: The case of interoperability for first responders

点击翻译按钮获取中文摘要

In this project, we adopt an interdisciplinary approach that combines experimental psychology and cognitive neuroergonomics, to ensure a thorough understanding and assessment of interoperability in crisis management, which in turn will be used to develop and validate an innovative and complete immersive virtual reality training system for first responders. Virtual reality simulations provide a cost-effective platform for training personnel, using simulated scenarios that are realistic in terms of their events, time course and emotional states. StellarX, a virtual and augmented reality platform, developed by OVA -our industry partner- will be adapted into a training system for responders of different services (police, firefighters, paramedics and public safety). First, behavioral markers will be identified and cognitive and teamwork-related metrics will be defined to evaluate the acquisition of non-technical skills that need to be supported and trained in crisis management in order to maximize interoperability and performance. Second, physiological and oculometric markers will be identified to act as indicators of the trainee's functional (cognitive and affective) states during crisis management. The training system we propose relies on behavioral, physiological and oculometric data, and the efficiency of such a system strongly depends upon the ability to sample and combine the different metrics. The ultimate training platform produced will support public safety and the well-being of Canadian citizens, while the set of validated behavioral and biomarkers empirically established will also have far-reaching benefits and give Canada an edge in terms of advances in ICT and integrative biometric devices. In addition, the outcomes of this project will define guidelines and recommendations for designing intelligent, adaptive virtual reality training systems that include the online monitoring of users' cognitive and affective state based on biometric and behavioral markers.