WEb Audio Virtual Environment Rendering (WEAVER): Online Virtual Acoustics for Sonic Art, Digital Heritage, and Broadcast

WEb 音频虚拟环境渲染 (WEAVER)：用于声音艺术、数字遗产和广播的在线虚拟声学

• 批准号: AH/N00356X/1
• 负责人: Damian Murphy
• 金额: $ 9.6万
• 依托单位: University of York
• 依托单位国家: 英国
• 项目类别: Research Grant
• 财政年份: 2016
• 资助国家: 英国
• 起止时间: 2016 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=AH%2FN00356X%2F1
• 关键词: WEb; Audio; Virtual; Environment; Rendering

Auralisation, the audio equivalent of visualization, enables us to audition virtual acoustic environments that once existed, will exist or that are purely fictional. Auralisation is based on obtaining the acoustic room impulse response (RIR) of a space, through measurement if the building already exists, or otherwise via simulation using computational modelling. The result is a 3D acoustic rendering of any sound we wish to hear within the auralised environment. This research plays a key role in architecture, environmental noise assessment, recreating past environments in digital heritage, as well as enabling creativity in music production, broadcast and computer gaming.The WEb Audio Virtual Environment Rendering (WEAVER) project will revisit the concept of spatial audio composition and rendering in relation to the last ten years of development in auralisation and virtual acoustics research. Since this research started in 2004, the specialised audio technology required to explore spatial composition using virtual acoustics, auralisation, acoustic measurement and modelling is now commonplace in most creative computer music software applications. Acoustic RIR measurements from various sites, buildings and venues, many of significant heritage value or interest have also been gathered and disseminated over this ten-year period via the online Open Acoustic Impulse Response Library (OpenAIR: www.openairlib.net). Over this time OpenAIR has become a key resource for electronic musicians, sound designers, software and computer game developers.Much of the functionality required to explore and audition spatial audio content and virtual acoustic environments can now, in fact, be offered via a standard web browser and mobile device - additional acoustic RIR data is still needed to auralise these virtual spaces, but the ability to use or listen to these results is now carried by millions of potential users worldwide. WEAVER will use the Web Audio API to deliver interactive virtual acoustic environments via a web browser, and to further realise some of the creative research aims first articulated over ten years ago. In combination with the research and resources related to OpenAIR, that was also an outcome from this initial work, WEAVER will develop impact and engagement in online sonic art, digital heritage and broadcast.WEAVER will create novel online sonic art from OpenAIR data. We will scope the Web Audio API to detail its capabilities for developing creative virtual acoustics applications informed by existing examples and current practice, and provide a route to impact through the development of new user contacts for OpenAIR content.We will work with York Theatre Royal, a regional producing theatre based on a historic site that has hosted a working theatre since 1744, to develop a web resource to engage new audiences with the redevelopment and heritage of the theatre's auditorium space. This presents a unique opportunity to apply our virtual acoustics research in a culturally and historically significant venue during its refurbishment. We will help York Theatre Royal to tell their story and engage new audiences using our expertise in acoustic heritage, auralisation and sound design, brought together through the development of novel, interactive online content.With BBC Audio Research we will investigate how virtual acoustic rendering informs the experience of listening to audio broadcast material. WEAVER will expand on existing BBC spatial audio rendering for broadcast to include differently rendered virtual acoustic and playback listening environments, and will make use of BBC facilities and test platforms for reaching audiences in order to gain feedback on the effectiveness and future viability of this presentation technology.At all stages data and code developed will be disseminated by open-source/open-access means, encouraging maximum potential impact for WEAVER and the resources it creates.

听觉化，相当于视觉化的音频，使我们能够试听曾经存在的虚拟声学环境，将存在或纯粹是虚构的。可听化基于获得空间的声学房间脉冲响应（RIR），如果建筑物已经存在，则通过测量，或者通过使用计算建模的模拟。其结果是我们希望在可听化环境中听到的任何声音的3D声学渲染。这项研究在建筑、环境噪声评估、数字遗产中重现过去的环境以及音乐制作、广播和计算机游戏中的创造力方面发挥着关键作用。WEb音频虚拟环境渲染（WEAVER）项目将重新审视空间音频合成和渲染的概念，并与过去十年的可听化和虚拟声学研究发展有关。自2004年这项研究开始以来，使用虚拟声学、可听化、声学测量和建模来探索空间作曲所需的专业音频技术现在已在大多数创意计算机音乐软件应用中司空见惯。在这十年期间，还通过在线开放式声学脉冲响应图书馆（OpenAIR：www.openairlib.net）收集和传播了来自各种遗址、建筑物和场地的声学RIR测量结果，其中许多具有重要的遗产价值或兴趣。OpenAIR已经成为电子音乐家、声音设计师、软件和电脑游戏开发者的重要资源。事实上，探索和试听空间音频内容和虚拟声学环境所需的大部分功能现在可以通过标准的Web浏览器和移动终端提供-仍然需要额外的声学RIR数据来可听化这些虚拟空间，但现在全世界数百万潜在用户都有使用或收听这些结果的能力。WEAVER将使用Web Audio API通过Web浏览器提供交互式虚拟声学环境，并进一步实现十多年前首次提出的一些创造性研究目标。结合OpenAIR相关的研究和资源，这也是这项初步工作的成果，WEAVER将发展在线声音艺术，数字遗产和广播的影响和参与。WEAVER将根据OpenAIR数据创建新颖的在线声音艺术。我们将对Web Audio API的范围进行界定，以详细说明其开发基于现有示例和当前实践的创意虚拟声学应用程序的功能，并通过开发OpenAIR内容的新用户联系人提供影响力的途径。我们将与约克皇家剧院（皇家剧院）合作，这是一家基于历史遗址的区域制作剧院，自1744年以来一直是一家工作剧院，开发一个网络资源，让新观众参与剧院礼堂空间的重建和遗产。这提供了一个独特的机会，将我们的虚拟声学研究应用于一个具有文化和历史意义的场地。我们将帮助约克剧院皇家讲述他们的故事，并利用我们在声学遗产，可听化和声音设计方面的专业知识吸引新的观众，通过开发新颖，互动的在线内容聚集在一起。与BBC Audio Research一起，我们将调查虚拟声学渲染如何告知收听音频广播材料的体验。WEAVER将扩展现有的BBC广播空间音频渲染，以包括不同渲染的虚拟声学和回放收听环境，并将利用BBC的设施和测试平台来接触观众，以获得对这种演示技术的有效性和未来可行性的反馈。在所有阶段，开发的数据和代码将通过开源/开放访问方式传播，鼓励WEAVER及其创造的资源产生最大的潜在影响。

项目成果

Viking VR: Designing a Virtual Reality Experience for a Museum

Viking VR：为博物馆设计虚拟现实体验

• 发表时间: 2018
• 作者: Schofield, G

Augmented Reality, Virtual Reality, and Computer Graphics - 7th International Conference, AVR 2020, Lecce, Italy, September 7-10, 2020, Proceedings, Part II

增强现实、虚拟现实和计算机图形学 - 第七届国际会议，AVR 2020，意大利莱切，2020 年 9 月 7-10 日，会议记录，第二部分

• DOI: 10.1007/978-3-030-58468-9_7
• 发表时间: 2020
• 作者: Katz B

OpenAirLib: A JavaScript library for the Acoustics of Spaces

OpenAirLib：用于空间声学的 JavaScript 库

• 发表时间: 2017
• 作者: Brown KI

Exploring cultural heritage through acoustic digital reconstructions

通过声学数字重建探索文化遗产

• DOI: 10.1063/pt.3.4633
• 发表时间: 2020
• 期刊: Physics Today
• 影响因子: 3.5
• 作者: Katz B