Fusing Semantic and Audio Technologies for Intelligent Music Production and Consumption

融合语义和音频技术实现智能音乐制作和消费

• 批准号: EP/L019981/1
• 负责人: Mark Sandler
• 金额: $ 662.58万
• 依托单位: Queen Mary University of London
• 依托单位国家: 英国
• 项目类别: Research Grant
• 财政年份: 2014
• 资助国家: 英国
• 起止时间: 2014 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=EP%2FL019981%2F1
• 关键词: Fusing; Semantic; Audio; Technologies; Intelligent

Music is probably the most pervasive of the performing arts, and perhaps, the most abused (think of your recent shopping trips!). It has tremendous power to influence our emotions, often subliminally. The advent of recording in the 19th Century made it possible to enjoy music at a time, and in a place, different from the performance. Compression, broadband and the ever increasing capacity to aggregate large collections mean that the issues confronting music consumers have totally changed in nature: equally so for professionals, such as broadcasters (playlists for radio, music for documentaries, etc.) and those at the creative heart of the process: musicians, sound engineers and producers. The recorded music industry has grappled unsuccessfully with digital technology and the rate of adoption of new technologies has been slow, ironically, mostly in fear of piracy and loss of revenue. Given the social and economic importance of music, it is vital that the industry's crisis is averted and its decline reversed. Simple semantics and metadata are already helping (for example in recommendation and sharing services) but this is just the beginning. The next generation semantic technologies that are the focus of this proposal have the power to exact the turnaround that music (and other content industries) needs but this should be established via a fundamental and principled exploration of how semantic technologies underpin music throughout the value chain.The proposal brings the very latest technologies to bear on the complete industry, end-to-end, producer to consumer, making the production process more fruitful, the consumption process more engaging, and the delivery and intermediation more automated and robust. In this project we will address 3 premises: (i) that Semantic Web technologies should be deployed throughout the content value chain from producer to consumer; (ii) that advanced signal processing should be employed in the content production phases to extract "pure" features of perceptual significance and represent these in standard vocabularies; (iii) that this combination of semantic technologies and content-derived metadata leads to advantages (and new products and services) at many points in the value chain, from recording studio to end-user (listener) devices and applications.The project will work with partners from industry - BBC R&D, Microsoft Research Cambridge and Omnifone) as well as internationally - the International Audio Labs, a joint initiative of the Fraunhofer Institute in Erlangan and the local university, and the Internet Archive, one of the world's major on-line libraries. We will engage with other universities in the UK supported by a partnership fund and via the BBC Audio Research Partnership. This long term project will foster new ways for professionals to work with music in the studio and for consumers to engage in their homes. It will support new business models that emphasise the whole experience of musical involvement, and discover ways to monetise the metadata as well as the essential content. The technologies to be researched support new ways of learning (about and to play) music as well as new ways of teaching and performing. And because the project will encompass vast quantities of music data and metadata, from heterogeneous sources, and will stress test emerging principles of big data, distributed intelligence and future generation web, it also addresses key questions of wide significance to EPSRC's ICT Programme, particularly relating to Intelligent Information Systems and Working Together.

音乐可能是最普遍的表演艺术，也许，最滥用（想想你最近的购物之旅！）。它有巨大的力量影响我们的情绪，往往是潜意识的。19世纪录音的出现使人们有可能在与表演不同的时间、地点欣赏音乐。压缩、宽带和不断增加的收集大量音乐的能力意味着音乐消费者所面临的问题在性质上已经完全改变：对于专业人士来说也是如此，例如广播公司（广播节目的播放列表，纪录片的音乐等）。以及那些处于创作过程核心的人：音乐家、音响工程师和制作人。唱片业一直未能成功地与数字技术作斗争，具有讽刺意味的是，新技术的采用速度一直很慢，主要是担心盗版和收入损失。鉴于音乐的社会和经济重要性，避免该行业的危机并扭转其衰落至关重要。简单的语义和元数据已经有所帮助（例如在推荐和共享服务中），但这仅仅是个开始。下一代语义技术是这项建议的重点，它有能力实现音乐的转变，（和其他内容行业）需要，但这应该通过对语义技术如何支撑整个价值链的基本和原则性探索来建立。该提案将最新技术应用于整个行业，端到端，生产者到消费者，使生产过程更富有成效，消费过程更有吸引力，交付和中介更加自动化和强大。在这个项目中，我们将解决3个前提：（i）语义网技术应部署在整个内容价值链从生产者到消费者;（ii）先进的信号处理应采用在内容生产阶段提取“纯”的感知意义的功能，并表示在标准词汇表中;（iii）语义技术和内容衍生元数据的这种结合带来了优势（以及新产品和服务）在价值链的许多点上，从录音棚到最终用户（收听者）设备和应用程序。该项目将与来自行业的合作伙伴- BBC研发，微软研究剑桥和Omnifone）以及国际上的合作伙伴-国际音频实验室，这是位于埃尔兰根的弗劳恩霍夫研究所和当地大学的联合倡议，以及世界主要在线图书馆之一的互联网档案馆。我们将与英国的其他大学合作，通过合作基金和BBC音频研究合作伙伴关系提供支持。这个长期项目将为专业人士在工作室处理音乐和消费者在家中参与创造新的方式。它将支持新的商业模式，强调音乐参与的整体体验，并发现将元数据和基本内容货币化的方法。待研究的技术支持学习（关于和演奏）音乐的新方法以及教学和表演的新方法。由于该项目将涵盖来自不同来源的大量音乐数据和元数据，并将对大数据、分布式智能和下一代网络的新兴原则进行压力测试，因此它还解决了对EPSRC的ICT计划具有广泛意义的关键问题，特别是与智能信息系统和协同工作有关的问题。

项目成果

An AI-Based Design Framework to Support Musicians' Practices

支持音乐家实践的基于人工智能的设计框架

• DOI: 10.1145/3243274.3275381
• 发表时间: 2018
• 作者: Avila J

The Semantic Web - ISWC 2016 - 15th International Semantic Web Conference, Kobe, Japan, October 17-21, 2016, Proceedings, Part II

语义网 - ISWC 2016 - 第 15 届国际语义网会议，日本神户，2016 年 10 月 17-21 日，会议记录，第二部分

• DOI: 10.1007/978-3-319-46547-0_1
• 发表时间: 2016
• 作者: Allik A

myMoodplay: an Interactive Mood-Based Music Discovery App.

myMoodplay：一款基于情绪的交互式音乐发现应用程序。

• 发表时间: 2016
• 作者: Allik, A.,

MusicWeb: music discovery with open linked semantic metadata

MusicWeb：具有开放链接语义元数据的音乐发现

• 发表时间: 2016
• 作者: Allik, A.,

MUSICWEB : SIMILARITY MODELLING STRATEGIES FOR ARTIST DISCOVERY

MUSICWEB：艺术家发现的相似性建模策略

• 发表时间: 2016
• 作者: Alo Allik;Mariano Mora;György Fazekas;M. Sandler
• 通讯作者: M. Sandler