Learning Tonal Representations of Music Signals Using Deep Neural Networks

随着技术的影响越来越大，音乐学研究正在经历一场根本性的变革。数字化的数据和专门的算法使大型音乐语料库的系统分析成为可能。最近，这种语料库的研究是基于音频记录，涉及数字信号处理和机器学习的方法。在这种情况下，关于和弦、音阶或键的音乐信号的音调分析起着重要的作用。传统的分析方法依赖于信号处理技术来提取音调特征表示，该音调特征表示指示音乐音高类别随时间的存在，从而允许明确的语义解释。这个项目的目标是使用深度神经网络来学习音调表示，这是可解释的，健壮的，和音色、乐器和声学条件不变的。该项目建立在古典音乐的复杂场景之上，其中按时间排列的乐谱和作品的多次表演可用于训练、验证和测试算法。从技术的角度来看，这个项目调查了学习音调类、多音调和突出度表示的方法。其中，序列学习技术可以处理弱对齐注释和受分层音乐结构启发的U-Net体系结构，将被探索。将学习到的表示应用到复杂的音乐场景中，旨在通过开发新的深度学习算法的潜力来开发健壮的音调分析方法，从而为计算音乐研究的新水平铺平道路。

With the growing impact of technology, musicological research is subject to a fundamental transformation. Digitized data and specialized algorithms enable systematic analyses of large music corpora. Recently, such corpus studies were performed based on audio recordings involving methods from digital signal processing and machine learning. In this context, the tonal analysis of the music signals regarding chords, scales, or keys plays a significant role. Traditional analysis methods rely on signal processing techniques to extract tonal feature representations that indicate the presence of musical pitch classes over time, thus allowing for an explicit semantic interpretation. The objective of this project is to use deep neural networks for learning tonal representations, which are interpretable, robust, and invariant regarding timbre, instrumentation, and acoustic conditions. The project builds on complex scenarios of classical music where time-aligned scores and multiple performances of the pieces can be used for training, validating, and testing the algorithms. From a technical perspective, this project investigates approaches for learning pitch-class, multi-pitch, and salience representations. Among others, sequence learning techniques that can handle weakly-aligned annotations and U-net architectures that are inspired by hierarchical musical structures will be explored. Applying the learned representations to complex music scenarios aims for developing robust tonal analysis methods by exploiting the potential of novel deep-learning algorithms, thus paving the way towards a new level of computational music research.