WEb Audio Virtual Environment Rendering (WEAVER): Online Virtual Acoustics for Sonic Art, Digital Heritage, and Broadcast
WEb Audio Virtual Environment Rendering (WEAVER): Online Virtual Acoustics for Sonic Art, Digital Heritage, and Broadcast
批准号:
AH/N00356X/1
负责人:
Damian Murphy
金额:
$9.6万
依托单位:
依托单位国家:
英国
项目类别:
Research Grant
财政年份:
2016
资助国家:
英国
项目状态:
已结题
起止时间:
2016 至 --
中文摘要
可听化,相当于音频的可视化,使我们能够试听曾经存在的、将存在的或纯粹是虚构的虚拟声学环境。可听化是基于获得空间的声学房间脉冲响应(RIR),如果建筑物已经存在,则通过测量,否则通过使用计算模型进行模拟。结果是我们希望在可听化环境中听到的任何声音的3D声学渲染。这项研究在建筑、环境噪声评估、在数字遗产中重现过去的环境,以及在音乐制作、广播和电脑游戏中发挥创造力方面发挥着关键作用。网络音频虚拟环境渲染(Weaver)项目将重新审视空间音频合成和渲染的概念,与过去十年可听化和虚拟声学研究的发展有关。自2004年开始这项研究以来,使用虚拟声学、可听化、声学测量和建模来探索空间构图所需的专业音频技术现在在大多数创造性的计算机音乐软件应用程序中司空见惯。在这十年期间,还通过在线开放式声学脉冲响应图书馆(OpenAIR:www.Openairlib.net)收集和传播了来自不同地点、建筑物和场馆的声学RIR测量结果,其中许多具有重大遗产价值或兴趣。在这段时间里,Openair已经成为电子音乐家、音响设计师、软件和电脑游戏开发商的关键资源。探索和试听空间音频内容和虚拟声学环境所需的许多功能现在实际上可以通过标准的网络浏览器和移动设备提供--仍然需要额外的声学RIR数据来使这些虚拟空间可听化,但使用或收听这些结果的能力现在被全球数百万潜在用户所携带。Weaver将使用Web Audio API通过Web浏览器提供交互式虚拟声学环境,并进一步实现十多年前首次提出的一些创造性研究目标。与Openair相关的研究和资源相结合,这也是这项初步工作的成果,Weaver将在在线声音艺术、数字遗产和广播方面产生影响和参与。WEAVER将根据Openair数据创建新的在线声音艺术。我们将介绍Web Audio API的范围,以详细说明其根据现有实例和当前实践开发创造性虚拟声学应用程序的能力,并通过开发Openair内容的新用户联系人来提供影响的途径。我们将与地区制作剧院York Theatre Royal合作开发网络资源,以吸引新观众参与剧院观众席空间的重新开发和遗产。York Theatre Royal是一家地区性制作剧院,基于历史遗址,自1744年以来一直是工作剧院。这为我们提供了一个独特的机会,在翻新期间将我们的虚拟声学研究应用于一个具有文化和历史意义的场所。我们将通过开发新颖、互动的在线内容,帮助约克皇家剧院讲述他们的故事,并利用我们在声学遗产、可听化和声音设计方面的专业知识吸引新的观众。通过BBC音频研究,我们将调查虚拟声学渲染如何带来收听音频广播材料的体验。Weaver将扩展现有BBC用于广播的空间音频渲染,以包括不同渲染的虚拟声学和回放收听环境,并将利用BBC的设施和测试平台接触观众,以获得对这种演示技术的有效性和未来可行性的反馈。在所有阶段,开发的数据和代码将通过开源/开放获取的方式传播,鼓励对Weaver及其创建的资源产生最大的潜在影响。
英文摘要
Auralisation, the audio equivalent of visualization, enables us to audition virtual acoustic environments that once existed, will exist or that are purely fictional. Auralisation is based on obtaining the acoustic room impulse response (RIR) of a space, through measurement if the building already exists, or otherwise via simulation using computational modelling. The result is a 3D acoustic rendering of any sound we wish to hear within the auralised environment. This research plays a key role in architecture, environmental noise assessment, recreating past environments in digital heritage, as well as enabling creativity in music production, broadcast and computer gaming.The WEb Audio Virtual Environment Rendering (WEAVER) project will revisit the concept of spatial audio composition and rendering in relation to the last ten years of development in auralisation and virtual acoustics research. Since this research started in 2004, the specialised audio technology required to explore spatial composition using virtual acoustics, auralisation, acoustic measurement and modelling is now commonplace in most creative computer music software applications. Acoustic RIR measurements from various sites, buildings and venues, many of significant heritage value or interest have also been gathered and disseminated over this ten-year period via the online Open Acoustic Impulse Response Library (OpenAIR: www.openairlib.net). Over this time OpenAIR has become a key resource for electronic musicians, sound designers, software and computer game developers.Much of the functionality required to explore and audition spatial audio content and virtual acoustic environments can now, in fact, be offered via a standard web browser and mobile device - additional acoustic RIR data is still needed to auralise these virtual spaces, but the ability to use or listen to these results is now carried by millions of potential users worldwide. WEAVER will use the Web Audio API to deliver interactive virtual acoustic environments via a web browser, and to further realise some of the creative research aims first articulated over ten years ago. In combination with the research and resources related to OpenAIR, that was also an outcome from this initial work, WEAVER will develop impact and engagement in online sonic art, digital heritage and broadcast.WEAVER will create novel online sonic art from OpenAIR data. We will scope the Web Audio API to detail its capabilities for developing creative virtual acoustics applications informed by existing examples and current practice, and provide a route to impact through the development of new user contacts for OpenAIR content.We will work with York Theatre Royal, a regional producing theatre based on a historic site that has hosted a working theatre since 1744, to develop a web resource to engage new audiences with the redevelopment and heritage of the theatre's auditorium space. This presents a unique opportunity to apply our virtual acoustics research in a culturally and historically significant venue during its refurbishment. We will help York Theatre Royal to tell their story and engage new audiences using our expertise in acoustic heritage, auralisation and sound design, brought together through the development of novel, interactive online content.With BBC Audio Research we will investigate how virtual acoustic rendering informs the experience of listening to audio broadcast material. WEAVER will expand on existing BBC spatial audio rendering for broadcast to include differently rendered virtual acoustic and playback listening environments, and will make use of BBC facilities and test platforms for reaching audiences in order to gain feedback on the effectiveness and future viability of this presentation technology.At all stages data and code developed will be disseminated by open-source/open-access means, encouraging maximum potential impact for WEAVER and the resources it creates.
期刊论文(4)
专著(0)
科研奖励(0)
会议论文
登录
查看更多内容
Viking VR: Designing a Virtual Reality Experience for a Museum
Viking VR:为博物馆设计虚拟现实体验
DOI:
--
发表时间:
2018
期刊:
影响因子:
--
作者:
[Schofield, G]
通讯作者:
Schofield, G
Augmented Reality, Virtual Reality, and Computer Graphics - 7th International Conference, AVR 2020, Lecce, Italy, September 7-10, 2020, Proceedings, Part II
增强现实、虚拟现实和计算机图形学 - 第七届国际会议,AVR 2020,意大利莱切,2020 年 9 月 7-10 日,会议记录,第二部分
DOI:
10.1007/978-3-030-58468-9_7
发表时间:
2020
期刊:
影响因子:
--
作者:
[Katz B]
通讯作者:
Katz B
OpenAirLib: A JavaScript library for the Acoustics of Spaces
OpenAirLib:用于空间声学的 JavaScript 库
DOI:
--
发表时间:
2017
期刊:
影响因子:
--
作者:
[Brown KI]
通讯作者:
Brown KI
DOI:
10.1063/pt.3.4633
发表时间:
2020
期刊:
Physics Today
影响因子:
3.5
作者:
[Katz B]
通讯作者:
Katz B
XR Network+ : Virtual Production in the Digital Economy
-
批准号:EP/W020602/1
-
项目类别:Research Grant
-
资助金额:$338.91万
-
财政年份:2022
-
负责人:Damian Murphy
-
依托单位:
The Past Has Ears (PHE)
-
批准号:AH/V001094/1
-
项目类别:Research Grant
-
资助金额:$15.97万
-
财政年份:2020
-
负责人:Damian Murphy
-
依托单位:
Creative Media Labs: Innovations in Screen Storytelling in the Age of Interactivity and Immersion
-
批准号:AH/S002839/1
-
项目类别:Research Grant
-
资助金额:$827.46万
-
财政年份:2018
-
负责人:Damian Murphy
-
依托单位:
Room Acoustics Prediction and Auralisation: Verification and Testing of New Methods in Room Acoustics Modelling.
-
批准号:EP/J000108/1
-
项目类别:Research Grant
-
资助金额:$3.15万
-
财政年份:2012
-
负责人:Damian Murphy
-
依托单位:
From OpenAIR to the Open Air: The Application of Virtual Acoustic Techniques in Landscapes and Novel Environments for Computer Games
-
批准号:AH/J013838/1
-
项目类别:Research Grant
-
资助金额:$12.16万
-
财政年份:2012
-
负责人:Damian Murphy
-
依托单位:
The Virtual Acoustics and Auralization Database
-
批准号:AH/H036938/1
-
项目类别:Research Grant
-
资助金额:$13.97万
-
财政年份:2010
-
负责人:Damian Murphy
-
依托单位:
I-HE(AR)^2 [I Hear Too] - Improving Heritage Experience through Acoustic Reality and Audio Research
-
批准号:AH/G015104/1
-
项目类别:Research Grant
-
资助金额:$3.13万
-
财政年份:2009
-
负责人:Damian Murphy
-
依托单位:
Acoustic Realities: Collaborations in Creative Acoustics Research
-
批准号:EP/F013078/1
-
项目类别:Research Grant
-
资助金额:$8.32万
-
财政年份:2007
-
负责人:Damian Murphy
-
依托单位:
SpACE-Net - The Spatial Audio Creative Engineering Network
-
批准号:GR/T21387/01
-
项目类别:Research Grant
-
资助金额:$5.47万
-
财政年份:2006
-
负责人:Damian Murphy
-
依托单位:
海外基金