Schubert Winterreise Dataset
Schubert Winterreise Dataset
复制标题
DOI：
10.1145/3429743
复制
发表时间：
2021-05
期刊：
影响因子：
--
通讯作者：
Christof Weiß;Frank Zalkow;Vlora Arifi-Müller;Meinard Müller;Hendrik Vincent Koops;Anja Volk;Harald Grohganz
中科院分区：
文献类型：
--
作者：
Christof Weiß;Frank Zalkow;Vlora Arifi-Müller;Meinard Müller;Hendrik Vincent Koops;Anja Volk;Harald Grohganz
本文提出了一个多模态数据集，其中包含弗朗茨·舒伯特的歌曲周期《冬之旅》的各种表示和注释。舒伯特的开创性作品构成了浪漫主义歌曲系列的杰出典范，浪漫主义歌曲是西方古典音乐的核心流派。我们的数据集统一了由音乐专家精心创建的多个公共来源和注释，并以全面且一致的方式编译。多模态表示包括歌手的歌词、不同机器可读格式的乐谱以及九场表演的录音，其中两场可免费用于研究目的。通过明确的音乐小节位置，我们在不同的表示之间建立了时间对齐，从而能够对不同的表演和方式进行详细的比较。使用这些对齐方式，我们为不同版本提供描述音调和结构特征的各种音乐学注释。该元数据包括不同粒度的和弦注释、音调的局部和全局注释以及结构部分的分段。从技术角度来看，该数据集允许评估自动音乐转录、跨模式音乐对齐或音调分析等任务的算法方法，并测试这些算法在歌曲、表演和模式中的稳健性。从音乐学的角度来看，该数据集可以系统地研究舒伯特《冬之旅》的音乐语言和风格，并比较不同注释者和粒度的注释。除了研究领域之外，这些数据还可以用于其他目的，例如舒伯特作品的教学准备以及通过交互式多媒体体验向更广泛的公众展示。在本文中，我们提供了该数据集的详细描述，通过多项研究表明其在计算音乐分析方面的潜力，并指出了未来研究的可能性。
This article presents a multimodal dataset comprising various representations and annotations of Franz Schubert’s song cycle Winterreise. Schubert’s seminal work constitutes an outstanding example of the Romantic song cycle—a central genre within Western classical music. Our dataset unifies several public sources and annotations carefully created by music experts, compiled in a comprehensive and consistent way. The multimodal representations comprise the singer’s lyrics, sheet music in different machine-readable formats, and audio recordings of nine performances, two of which are freely accessible for research purposes. By means of explicit musical measure positions, we establish a temporal alignment between the different representations, thus enabling a detailed comparison across different performances and modalities. Using these alignments, we provide for the different versions various musicological annotations describing tonal and structural characteristics. This metadata comprises chord annotations in different granularities, local and global annotations of musical keys, and segmentations into structural parts. From a technical perspective, the dataset allows for evaluating algorithmic approaches to tasks such as automated music transcription, cross-modal music alignment, or tonal analysis, and for testing these algorithms’ robustness across songs, performances, and modalities. From a musicological perspective, the dataset enables the systematic study of Schubert’s musical language and style in Winterreise and the comparison of annotations regarding different annotators and granularities. Beyond the research domain, the data may serve further purposes such as the didactic preparation of Schubert’s work and its presentation to a wider public by means of an interactive multimedia experience. With this article, we provide a detailed description of the dataset, indicate its potential for computational music analysis by means of several studies, and point out possibilities for future research.