3D 5G Immersive Audio for Urban Outdoor Heritage Contexts

该项目将解决有关如何结合使用3D和5G技术来吸引文物观众的研究空白。该项目将结合3D沉浸式音频和5G技术，创造特定于遗产的内容，并为遗产行业开发新的受众，这在方法上是新颖的。它将为遗产特定3D音频的创作、管理和传播创造一个原型环境。为此，它将结合创新英国资助的布莱顿数字弹射器5G测试平台，用于高速内容流和低延迟，谷歌共振音频工具用于3D声音，回声创造者用于地理位置声音和布莱顿的户外遗产地点。这将与立体声、用户定位、头部相关传递功能（HRTF）、环境建模一起工作，以提供精确的卷积混响，从而提供沉浸式体验、流媒体多声道双声音频、5G技术以及其他新兴的相关音频和移动技术。它将推进科学的解决方案，以实现5G低延迟空间音频。在整个设计、制作和评估过程中，共同创造的方法将吸引观众和遗产合作伙伴。该项目将分析用户在城市户外遗址（例如布莱顿的不伦瑞克广场）行走时的遗产内容体验，并将特定的耳机连接到智能手机。他们会听一段3D声音体验，旨在传达有关特定遗产背景的信息（包括声音、音乐和口语），这可以想象成一种体验，包括3D电脑游戏声音、GPS声音漫步、有导游的遗产之旅和沉浸式AR/VR体验。这是基于在布莱顿进行的3D沉浸式音频技术、遗产领域的GPS音频、5G沉浸式体验、增强现实和通过移动/数字技术（例如NetPark）发展的文化/遗产受众的现有研究。研究问题srq1：通过在5G测试平台上进行3D沉浸式音频实验，会出现什么样的传统特定内容？RQ2：这将如何帮助遗产机构吸引新的受众，并详细了解他们在文化遗产附近的行为（用户移动、位置、互动数据）？RQ3：当在公共/城市空间通过沉浸式3D音频传递时，观众如何体验遗产参与？RQ4：一个用于创作、策划和传播3D沉浸式音频的原型公共实验室是什么样子的？遗产部门可以从中学到什么？

This project will address a research gap concerning the understanding of the combined use of 3D and 5G technologies to engage heritage audiences. The project will be novel in approach in that it will use a combination of 3D immersive audio and 5G technology to create heritage-specific content and to develop new audiences for the heritage sector. It will create a prototype environment for the creation, curation and dissemination of heritage-specific 3D audio. For this, it will combine the Innovate UK funded Brighton Digital Catapult 5G testbed for high-speed content streaming and low latency, Google Resonance Audio tools for 3D sound, the Echoes Creator for geolocative sound and outdoor Heritage locations in Brighton. This will work with ambisonics, user location, head-related transfer function (HRTF), environmental modelling to provide accurate convolution reverbs to provide immersive experiences, streaming multi-channel ambisonic audio, 5G technology and other emerging relevant audio and mobile technology. It will advance scientific solutions for achieving low latency spatial audio with 5G. A co-creation methodology will engage audiences and heritage partners throughout the design, production and evaluation process.The project will analyse the user experience of heritage content when walking around urban outdoor heritage sites (e.g. Brunswick Square in Brighton) with specific headphones linked to a smartphone. They would listen a 3D sonic experience designed to convey information about the specific heritage context (including sounds, music and spoken words), something that could be imagined as an experience that includes features of 3D computer game sound, GPS sound walks, guided heritage tours and immersive AR/VR experiences.This builds on existing research undertaken at Brighton on 3D immersive audio technology, GPS audio for heritage sector, 5G immersive experiences, augmented reality and cultural/heritage audience development though mobile/digital technologies (e.g. NetPark).3. Research questionsRQ1: What kind of heritage-specific content emerges through experimentation with 3D immersive audio in a 5G testbed?RQ2: How could this help heritage institutions to engage new audiences and to understand in detail how they behave near cultural heritage (user movement, location, interaction data)?RQ3: How do audiences experience heritage engagement when delivered through immersive 3D audio in public/urban spaces?RQ4: What does a prototype public lab for the creation, curation and dissemination of 3D immersive audio look like and what can the heritage sector learn from it?