S3A: Future Spatial Audio for an Immersive Listener Experience at Home

3D声音可以给听众提供“身临其境”的现场活动体验，比如逍遥音乐会（Proms）或奥林匹克100米运动会（Olympic 100m），但目前需要高度控制的收听空间和扬声器设置。S3A的目标是为普通大众实现实用的3D音频，以便在家中或移动中实现身临其境的体验。几乎所有的英国人都在消费音频。S3A旨在释放3D声音的创造潜力，并为听众提供身临其境的体验。这需要一种全新的以听众为中心的音频方法，使3D声音制作能够动态地适应听众的环境。在不受控制的生活空间中实现沉浸式音频体验是一个重大的研究挑战。这需要我们对空间音频感知的理解取得重大进展，以及音频的新表示和信号处理，以允许内容创作和感知上准确的再现。现有的音频制作格式（立体声，5.1）和未来的电影空间音频（24,128）都是基于声道的，需要特定的控制扬声器安排，这对于大多数家庭听众来说根本不实用。S3A将开创一种新的基于对象的音频信号处理方法，允许在真实空间中灵活地生产和再现。复制将适应扬声器配置，房间声学和听众的位置。音频和视觉3D场景理解领域将汇集在一起，以识别和建模复杂真实场景中的视听对象。视听对象是具有已知形状和位置随时间变化的空间属性的声源或事件，例如正在踢的足球，正在演奏的乐器或足球比赛中的人群。基于对象的表示将把音频制作从现有的基于通道的信号混合（立体声，5.1,22.2）转变为对孤立声源和事件的空间控制。这将实现3D声音的创造潜力，实现以用户为中心的智能内容生产，以独立于平台的格式传输和复制3D音频内容。基于对象的音频将允许灵活的传输（广播、IP和移动），并将3D声音自适应地复制到现有和新的数字设备上。

3D sound can offer listeners the experience of "being there" at a live event, such as the Proms or Olympic 100m, butcurrently requires highly controlled listening spaces and loudspeaker setups. The goal of S3A is to realise practical 3D audio for the general public to enable immersive experiences at home or on the move.Virtually the whole of the UK population consume audio. S3A aims to unlock the creative potential of 3D sound and deliver to listeners a step change in immersive experiences. This requires a radical new listener centred approach to audio enabling 3D sound production to dynamically adapt to the listeners' environment. Achieving immersive audio experiences in uncontrolled living spaces presents a significant research challenge. This requires major advances in our understanding of the perception of spatial audio together with new representations of audio and the signal processing that allows content creation and perceptually accurate reproduction. Existing audio production formats (stereo, 5.1) and those proposed for future cinema spatial audio (24,128) are channel-based requiring specific controlled loudspeaker arrangements that are simply not practical for the majority of home listeners. S3A will pioneer a novel object-based methodology for audio signal processing that allows flexible production and reproduction in real spaces. The reproduction will be adaptive to loudspeaker configuration, room acoustics and listener locations. The fields of audio and visual 3D scene understanding will be brought together to identify and model audio-visual objects in complex real scenes. Audio-visual objects are sound sources or events with known spatial properties of shape and location over time, e.g. a football being kicked, a musical instrument being played or the crowd chanting at a football match. Object based representation will transform audio production from existing channel based signal mixing (stereo, 5.1, 22.2) to spatial control of isolated sound sources and events. This will realise the creative potential of 3D sound enabling intelligent user-centred content production, transmission and reproduction of 3D audio content in platform independent formats. Object-based audio will allow flexible delivery (broadcast, IP and mobile) and adaptive reproduction of 3D sound to existing and new digital devices.