Development of virtual acoustics for a renewed practice of acoustical engineering and sound quality studies

声音在我们的日常体验中会带来各种消极或积极的影响。在机械工程中，对声音的研究有两个视角：1)声学，侧重于物理；2)声音质量(SQ)，用于研究人类对产品声音的反应。 声学和SQ包括从建模、实验方法到听力测试的科学方法。这些都是被广泛接受的方法。然而，数字和移动时代的环境技术趋势表明了声学和SQ的大量潜在的新方法、技术、科学和工程实践。对于这个研究项目，研究机会和问题是如何使用虚拟和增强现实来重新定义和改进以听众体验为中心的声学工程实践。在这个项目中，重点放在虚拟内容的物理准确性上：由模型和测量驱动的虚拟声学，两者都来自声学科学。这就是提出的研究计划的独到之处。例如，不是在实验室使用耳机对给定产品进行音质聆听测试，而是可以使用活动耳机在现实环境中进行相同的测试，虚拟模拟，并使用基于音频的增强现实和移动设备进行渲染。这代表着一项潜在的改进：有了增强现实，音质研究可以在真实和具有代表性的背景下进行。虚拟和增强现实对于虚拟声学的未来是相辅相成的。 目前的一个限制是，大多数正在进行的虚拟和增强现实研究工作都是针对娱乐或营销的。很少有人致力于为虚拟声学开发和应用物理上精确的虚拟和增强现实。因此，研究项目的目标是发展虚拟声学的新方法和科学知识。我们将开发从声学理论模型和麦克风阵列录音生成虚拟内容的新方法。在虚拟声学的渲染方面，我们将开发在实验室条件下使用扬声器阵列(虚拟现实)和现场使用移动技术(增强现实)进行渲染的新方法。科学成果将与声场再现、多声道信号处理和交互加本地化虚拟声学的进步相对应。 在影响方面，该研究计划将通过三名博士生和两名本科生培训高素质人才(HQP)。此外，该研究计划将有助于在蓬勃发展的数字和移动时代，在工业和工程部门的虚拟和增强现实技术方面，加拿大的研究和HQP的定位。

Sounds lead to various negative or positive effects in our daily experiences. In mechanical engineering, two perspectives are used in the study of sound: 1) Acoustics with a focus on physics; 2) Sound quality (SQ) for the study of human reaction to sounds of products. Acoustics and SQ include scientific methods ranging from modelling, experimental methods to listening tests. These are widely accepted methods. However, the ambient technological trends in the digital and mobile era suggest a vast amount of potential new methods, technologies, scientific and engineering practices of acoustics and SQ. For this research program, the research opportunities and questions are how virtual and augmented reality can be used to redefine and improve the practices of acoustical engineering centered on the listener's experience. In this program, the focus is on the physical accuracy of the virtual content: virtual acoustics driven by models and measurements, both derived from acoustical sciences. This is the originality of the proposed research program. For example, instead of a sound quality listening test for a given product using headphones in a laboratory, the same test could be conducted in a realistic context using active headset, virtual simulations, and rendered using audio-based augmented reality with a mobile device. This represents a potential improvement: with augmented reality, sound quality studies could be performed in real and representative contexts. Virtual and augmented reality are complementary for the future of virtual acoustics. A current limitation is that most of the ongoing research work in virtual and augmented reality is aimed at entertainment or marketing. Little work has been dedicated to the development and application of physically-accurate virtual and augmented reality for virtual acoustics. Therefore, the research program objectives are the developments of new methods and scientific knowledge in virtual acoustics. We will develop new methods for virtual content generation from theoretical models in acoustics and from microphone array recordings. On the rendering side of virtual acoustics, we will develop new methods for rendering in laboratory conditions using loudspeaker arrays (virtual reality) and in situ with mobile technology (augmented reality). Scientific outcomes will correspond to advances in sound field reproduction, multichannel signal processing, and interactive plus localized virtual acoustics. In terms of impact, this research program will contribute to the training of highly qualified individuals (HQP) through three PhD students and two undergraduate trainees. Furthermore, the research program will contribute to the positioning of Canadian research and HQPs with respect to virtual and augmented reality technology in the industrial and engineering sectors within the burgeoning digital and mobile era.