3D 5G Immersive Audio for Urban Outdoor Heritage Contexts

点击翻译按钮获取中文摘要

This project will address a research gap concerning the understanding of the combined use of 3D and 5G technologies to engage heritage audiences. The project will be novel in approach in that it will use a combination of 3D immersive audio and 5G technology to create heritage-specific content and to develop new audiences for the heritage sector. It will create a prototype environment for the creation, curation and dissemination of heritage-specific 3D audio. For this, it will combine the Innovate UK funded Brighton Digital Catapult 5G testbed for high-speed content streaming and low latency, Google Resonance Audio tools for 3D sound, the Echoes Creator for geolocative sound and outdoor Heritage locations in Brighton. This will work with ambisonics, user location, head-related transfer function (HRTF), environmental modelling to provide accurate convolution reverbs to provide immersive experiences, streaming multi-channel ambisonic audio, 5G technology and other emerging relevant audio and mobile technology. It will advance scientific solutions for achieving low latency spatial audio with 5G. A co-creation methodology will engage audiences and heritage partners throughout the design, production and evaluation process.The project will analyse the user experience of heritage content when walking around urban outdoor heritage sites (e.g. Brunswick Square in Brighton) with specific headphones linked to a smartphone. They would listen a 3D sonic experience designed to convey information about the specific heritage context (including sounds, music and spoken words), something that could be imagined as an experience that includes features of 3D computer game sound, GPS sound walks, guided heritage tours and immersive AR/VR experiences.This builds on existing research undertaken at Brighton on 3D immersive audio technology, GPS audio for heritage sector, 5G immersive experiences, augmented reality and cultural/heritage audience development though mobile/digital technologies (e.g. NetPark).3. Research questionsRQ1: What kind of heritage-specific content emerges through experimentation with 3D immersive audio in a 5G testbed?RQ2: How could this help heritage institutions to engage new audiences and to understand in detail how they behave near cultural heritage (user movement, location, interaction data)?RQ3: How do audiences experience heritage engagement when delivered through immersive 3D audio in public/urban spaces?RQ4: What does a prototype public lab for the creation, curation and dissemination of 3D immersive audio look like and what can the heritage sector learn from it?