Maximizing the VR experience : testing new ways to integrate 3D sound and eye-tracking

最大化 VR 体验：测试集成 3D 声音和眼动追踪的新方法

• 批准号: 513938-2017
• 负责人: Vachon, François
• 金额: $ 1.81万
• 依托单位: Université Laval
• 依托单位国家: 加拿大
• 项目类别: Engage Grants Program
• 财政年份: 2017
• 资助国家: 加拿大
• 起止时间: 2017-01-01 至 2018-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=639716
• 关键词: Maximizing; VR; experience; testing; new

This Engage project aims to contribute to the enhancement of a virtual reality (VR) system for traininginteroperability between first responders involved in crisis management and emergency response byimplementing natural 3D sound within the StellarX platform. The main premise of VR is to create an alternatereality, but without the right audio cues to match the visuals, the brain does not buy into the illusion. Recentstudies indicate that adding 3D sound to a VR environment offers a greater sense of presence, can improveskills acquisition and task performance, and facilitate attention redirection to relevant aspects. Our approachcombines experimental psychology and cognitive neuroergonomics to turn OVA's platform StellarX into apowerful training system optimized with natural 3D sound. This will be done by recording a set of sounds thatmatch the virtual environment using a binaural recording technique in order to accurately capture sonicinformation coming from all directions and produce extremely realistic recordings. In addition, we plan toverify whether the beneficial aspects associated with natural 3D sound in VR can be observed in a jointinteroperability-training context. This will be done by assessing the sense of presence, skills acquisition, andtask performance, as well as trainees' capacity to redirect attention to relevant 3D sounds. The combination ofsubjective and objective (behavioral and ocular) metrics to evaluate these benefits represents a key innovationof this project. Results and outcomes will provide an advanced VR training method and a better tool for theformation of staff, thus allowing targeted techniques to be employed to improve individual or teamperformance. Moreover, this type of training will improve learning since the trainee's sense of presence in thesimulation will be maximized through visual and aural immersion and the simulation content can easily beadapted to reflect specific needs. Therefore, this project will positively influence the Canadian technological,financial and education sectors, as well as other areas such as public security, intelligent tutoring and thegaming industry.

该Engage项目旨在通过在StellarX平台内实现自然的3D声音，促进虚拟现实（VR）系统的增强，以培训参与危机管理和应急响应的第一响应者之间的互操作性。虚拟现实的主要前提是创造一个替代现实，但如果没有正确的音频提示来匹配视觉效果，大脑就不会接受这种错觉。最近的研究表明，将3D声音添加到VR环境中可以提供更大的存在感，可以提高技能获取和任务性能，并有助于将注意力重新定向到相关方面。我们的方法结合了实验心理学和认知神经人体工程学，将OVA的平台StellarX变成了一个功能强大的训练系统，优化了自然的3D声音。这将通过使用双耳录音技术记录一组与虚拟环境相匹配的声音来完成，以便准确地捕捉来自各个方向的声音信息并产生非常逼真的录音。此外，我们计划验证是否可以在联合互操作性培训环境中观察到与VR中自然3D声音相关的有益方面。这将通过评估存在感，技能获取和任务表现以及学员将注意力重新引导到相关3D声音的能力来完成。结合主观和客观（行为和视觉）指标来评估这些好处代表了该项目的一个关键创新。结果和成果将提供一种先进的虚拟现实培训方法和更好的工具，为员工的形成，从而允许有针对性的技术，以提高个人或团队的表现。此外，这种类型的培训将改善学习，因为受训者在模拟中的存在感将通过视觉和听觉沉浸最大化，模拟内容可以很容易地适应，以反映特定的需求。因此，该项目将对加拿大的技术、金融和教育部门以及公共安全、智能辅导和游戏行业等其他领域产生积极影响。