Development of virtual acoustics for a renewed practice of acoustical engineering and sound quality studies

在我们的日常生活中，声音会产生各种消极或积极的影响。在机械工程中，两种观点被用于声音的研究：1)声学与物理学的重点；2)音质（SQ）用于研究人类对产品声音的反应。声学和声学包括从建模、实验方法到听力测试的科学方法。这些是被广泛接受的方法。然而，数字和移动时代的环境技术趋势表明，声学和声学有大量潜在的新方法、新技术、科学和工程实践。对于这个研究项目，研究的机会和问题是如何使用虚拟和增强现实来重新定义和改进以听众体验为中心的声学工程实践。在这个程序中，重点是虚拟内容的物理准确性：由模型和测量驱动的虚拟声学，两者都来源于声学科学。这就是所提议的研究计划的原创性。例如，与在实验室中使用耳机对给定产品进行音质聆听测试不同，相同的测试可以在现实环境中使用有源耳机、虚拟模拟进行，并使用基于音频的增强现实与移动设备进行渲染。这代表了一个潜在的改进：有了增强现实，音质研究可以在真实和有代表性的环境中进行。虚拟现实和增强现实是未来虚拟声学的互补。目前的一个限制是，大多数正在进行的虚拟现实和增强现实研究工作都是针对娱乐或营销的。很少有人致力于开发和应用物理精确的虚拟和增强现实的虚拟声学。因此，研究计划的目标是开发虚拟声学的新方法和科学知识。我们将从声学理论模型和麦克风阵列录音中开发虚拟内容生成的新方法。在虚拟声学的渲染方面，我们将开发使用扬声器阵列（虚拟现实）和移动技术（增强现实）在实验室条件下渲染的新方法。科学成果将对应于声场再现、多通道信号处理以及交互式和本地化虚拟声学方面的进步。在影响方面，该研究项目将通过三名博士生和两名本科生为高素质人才（HQP）的培养做出贡献。此外，该研究项目将有助于加拿大研究和hqp在新兴数字和移动时代的工业和工程领域对虚拟和增强现实技术的定位。

Sounds lead to various negative or positive effects in our daily experiences. In mechanical engineering, two perspectives are used in the study of sound: 1) Acoustics with a focus on physics; 2) Sound quality (SQ) for the study of human reaction to sounds of products.Acoustics and SQ include scientific methods ranging from modelling, experimental methods to listening tests. These are widely accepted methods. However, the ambient technological trends in the digital and mobile era suggest a vast amount of potential new methods, technologies, scientific and engineering practices of acoustics and SQ. For this research program, the research opportunities and questions are how virtual and augmented reality can be used to redefine and improve the practices of acoustical engineering centered on the listener's experience. In this program, the focus is on the physical accuracy of the virtual content: virtual acoustics driven by models and measurements, both derived from acoustical sciences. This is the originality of the proposed research program. For example, instead of a sound quality listening test for a given product using headphones in a laboratory, the same test could be conducted in a realistic context using active headset, virtual simulations, and rendered using audio-based augmented reality with a mobile device. This represents a potential improvement: with augmented reality, sound quality studies could be performed in real and representative contexts. Virtual and augmented reality are complementary for the future of virtual acoustics.A current limitation is that most of the ongoing research work in virtual and augmented reality is aimed at entertainment or marketing. Little work has been dedicated to the development and application of physically-accurate virtual and augmented reality for virtual acoustics. Therefore, the research program objectives are the developments of new methods and scientific knowledge in virtual acoustics. We will develop new methods for virtual content generation from theoretical models in acoustics and from microphone array recordings. On the rendering side of virtual acoustics, we will develop new methods for rendering in laboratory conditions using loudspeaker arrays (virtual reality) and in situ with mobile technology (augmented reality). Scientific outcomes will correspond to advances in sound field reproduction, multichannel signal processing, and interactive plus localized virtual acoustics.In terms of impact, this research program will contribute to the training of highly qualified individuals (HQP) through three PhD students and two undergraduate trainees. Furthermore, the research program will contribute to the positioning of Canadian research and HQPs with respect to virtual and augmented reality technology in the industrial and engineering sectors within the burgeoning digital and mobile era.