Apolo: a toolkit for generative music production and benchmarking

Apolo：用于生成音乐制作和基准测试的工具包

• 批准号: RGPIN-2019-07093
• 负责人: Pasquier, Philippe
• 金额: $ 4.01万
• 依托单位: Simon Fraser University
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2021
• 资助国家: 加拿大
• 起止时间: 2021-01-01 至 2022-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=739305
• 关键词: Apolo; toolkit; generative; music; production

The Apolo project is a direct response to recent developments in Artificial Intelligence, and Machine Learning when applied to the partial or complete automation of creative tasks, a field known as computational creativity, Creative AI, or Metacreation. In particular, recent advances in corpus-based generative music algorithms are leading to a revolution in how music is being created by professionals and amateurs alike. These increasingly powerful algorithms have not yet been applied much, mostly due to the complexities of machine learning, and the lack of an open source library, data management software, and graphical user interfaces for accessing these algorithms. The Apolo project aims to fill this gap providing user-friendly technologies that enable composers, sound designers, game developers, VR studios, amateur musicians as well as researchers and students to understand, apply, refine, benchmark, extend these new computational techniques in their own applications or research. The main outcomes of the Apolo project will be: - Generative algorithms that go beyond pastiche and style imitation using novelty and surprise search in combination with Deep Learning generative algorithms - High-level variables and cross-modal mapping strategies that can be used to steer the musical generation in interactive contexts be it for computer-assisted composition in digital audio workstations, or adaptive online generation in online applications (such as video games). - The ApoloC corpus manager will allow users (researchers, students, musicians, composer, and enthusiasts) to load and manipulate music compositions (in a variety of formats) to manage training sets for generative style imitation algorithms. - The ApoloG generation engine, will provide a graphic interface to select training sets, training algorithms, and specify the generative task and parameters. - Both ApoloC and ApoloG will rest on the Apolo library: an open source library implementing a collection of existing and new music generation algorithms. - The ApoloQ quantitative evaluation toolbox for style imitation will be integrated into the framework to help benchmark algorithms. With the shift from linear to non-linear media, users are now exposed to rich immersive and interactive experiences. Be it for gaming, education, or entertainment, interactive mediums are quickly outgrowing linear media (books, film, tv, ...). As nonlinear (interactive) mediums develop, the number of assets needed is growing exponentially. Besides its contribution to artificial intelligence, machine learning, computational creativity, computer music, and music information retrieval, the Apolo project will lay the ground for computer-assisted or completely procedural music generation approaches that are now required in a variety of software products (interactive systems, video games, ...), central to the digital economy and Canadian industry in these sectors.

Apolo 项目是对人工智能和机器学习最新发展的直接回应，应用于创意任务的部分或完全自动化，这一领域被称为计算创造力、创意人工智能或元创造。特别是，基于语料库的生成音乐算法的最新进展正在引发专业人士和业余爱好者创作音乐方式的一场革命。这些日益强大的算法尚未得到太多应用，主要是由于机器学习的复杂性，以及缺乏用于访问这些算法的开源库、数据管理软件和图形用户界面。 Apolo 项目旨在填补这一空白，提供用户友好的技术，使作曲家、声音设计师、游戏开发人员、VR 工作室、业余音乐家以及研究人员和学生能够在自己的应用或研究中理解、应用、完善、基准测试和扩展这些新的计算技术。 Apolo 项目的主要成果将是： - 使用新颖性和惊喜搜索与深度学习生成算法相结合，超越模仿和风格模仿的生成算法 - 高级变量和跨模式映射策略，可用于在交互式环境中引导音乐生成，无论是数字音频工作站中的计算机辅助作曲，还是在线应用程序（例如视频游戏）中的自适应在线生成。 - ApoloC 语料库管理器将允许用户（研究人员、学生、音乐家、作曲家和爱好者）加载和操作音乐作品（各种格式），以管理生成风格模仿算法的训练集。 - ApoloG生成引擎，将提供图形界面来选择训练集、训练算法，并指定生成任务和参数。 - ApoloC 和 ApoloG 都将依赖于 Apolo 库：一个实现现有和新音乐生成算法集合的开源库。 - 用于风格模仿的 ApoloQ 定量评估工具箱将集成到框架中，以帮助基准算法。随着从线性媒体到非线性媒体的转变，用户现在可以获得丰富的沉浸式和交互式体验。无论是游戏、教育还是娱乐，交互式媒体的发展速度都很快超过了线性媒体（书籍、电影、电视……）。随着非线性（交互式）媒体的发展，所需的资产数量呈指数级增长。除了对人工智能、机器学习、计算创造力、计算机音乐和音乐信息检索的贡献外，阿波罗项目还将为计算机辅助或完全程序化的音乐生成方法奠定基础，这些方法目前在各种软件产品（交互式系统、视频游戏等）中都需要，是数字经济和加拿大这些领域产业的核心。