Development of virtual acoustics for a renewed practice of acoustical engineering and sound quality studies

声音会在我们的日常生活中产生各种负面或正面的影响。在机械工程中，声音的研究使用两个角度：1）以物理为重点的声学; 2）用于研究人类对产品声音反应的声音质量（SQ）。 声学和SQ包括从建模，实验方法到听力测试的科学方法。这些都是被广泛接受的方法。然而，数字和移动的时代的环境技术趋势表明了大量潜在的声学和SQ的新方法、技术、科学和工程实践。对于这个研究项目，研究机会和问题是如何虚拟和增强现实可以用来重新定义和改善声学工程的做法为中心的听众的经验。 在这个项目中，重点是虚拟内容的物理精度：由模型和测量驱动的虚拟声学，两者都来自声学科学。这是所提出的研究方案的独创性。例如，代替在实验室中使用耳机对给定产品进行声音质量收听测试，可以在现实环境中使用有源耳机、虚拟模拟进行相同的测试，并且使用基于音频的增强现实与移动终端进行渲染。这代表了一种潜在的改进：通过增强现实，可以在真实的和有代表性的环境中进行音质研究。虚拟现实和增强现实是虚拟声学未来的补充。 目前的一个限制是，大多数正在进行的虚拟和增强现实研究工作都是针对娱乐或营销。很少有工作致力于物理精确的虚拟和增强现实的虚拟声学的开发和应用。因此，研究计划的目标是开发虚拟声学的新方法和科学知识。我们将从声学理论模型和麦克风阵列录音中开发虚拟内容生成的新方法。在虚拟声学的渲染方面，我们将开发在实验室条件下使用扬声器阵列（虚拟现实）和现场使用移动的技术（增强现实）进行渲染的新方法。科学成果将与声场再现、多通道信号处理和交互式加局部虚拟声学的进步相对应。 在影响方面，这项研究计划将有助于通过三名博士生和两名本科生培养高素质的个人（HQP）。此外，该研究计划将有助于加拿大研究和HQP在新兴的数字和移动的时代的工业和工程领域的虚拟和增强现实技术的定位。

Sounds lead to various negative or positive effects in our daily experiences. In mechanical engineering, two perspectives are used in the study of sound: 1) Acoustics with a focus on physics; 2) Sound quality (SQ) for the study of human reaction to sounds of products. Acoustics and SQ include scientific methods ranging from modelling, experimental methods to listening tests. These are widely accepted methods. However, the ambient technological trends in the digital and mobile era suggest a vast amount of potential new methods, technologies, scientific and engineering practices of acoustics and SQ. For this research program, the research opportunities and questions are how virtual and augmented reality can be used to redefine and improve the practices of acoustical engineering centered on the listener's experience. In this program, the focus is on the physical accuracy of the virtual content: virtual acoustics driven by models and measurements, both derived from acoustical sciences. This is the originality of the proposed research program. For example, instead of a sound quality listening test for a given product using headphones in a laboratory, the same test could be conducted in a realistic context using active headset, virtual simulations, and rendered using audio-based augmented reality with a mobile device. This represents a potential improvement: with augmented reality, sound quality studies could be performed in real and representative contexts. Virtual and augmented reality are complementary for the future of virtual acoustics. A current limitation is that most of the ongoing research work in virtual and augmented reality is aimed at entertainment or marketing. Little work has been dedicated to the development and application of physically-accurate virtual and augmented reality for virtual acoustics. Therefore, the research program objectives are the developments of new methods and scientific knowledge in virtual acoustics. We will develop new methods for virtual content generation from theoretical models in acoustics and from microphone array recordings. On the rendering side of virtual acoustics, we will develop new methods for rendering in laboratory conditions using loudspeaker arrays (virtual reality) and in situ with mobile technology (augmented reality). Scientific outcomes will correspond to advances in sound field reproduction, multichannel signal processing, and interactive plus localized virtual acoustics. In terms of impact, this research program will contribute to the training of highly qualified individuals (HQP) through three PhD students and two undergraduate trainees. Furthermore, the research program will contribute to the positioning of Canadian research and HQPs with respect to virtual and augmented reality technology in the industrial and engineering sectors within the burgeoning digital and mobile era.