Audio-Based Automatic Generation of a Piano Reduction Score by Considering the Musical Structure
Audio-Based Automatic Generation of a Piano Reduction Score by Considering the Musical Structure
复制标题
考虑音乐结构的基于音频的钢琴还原乐谱自动生成
DOI：
10.1007/978-3-030-05716-9_14
复制
发表时间：
2018
期刊：
影响因子：
--
通讯作者：
S. Morishima
中科院分区：
文献类型：
--
作者：
Hirofumi Takamori;Takayuki Nakatsuka;Satoru Fukayama;Masataka Goto;S. Morishima
本研究描述一种方法，自动生成一个钢琴减少分数从流行音乐的录音，同时考虑音乐结构。生成的乐谱包括右手和左手钢琴部分，其反映从原始音频信号提取的旋律、和弦和节奏。从音频记录生成这样的缩减分数是具有挑战性的，因为当输入包含来自各种乐器的声音时，自动音乐转录仍然被认为是低效的。反映类似的重复柱背后的长期相关性结构也是具有挑战性的;此外，以前的方法独立地生成每个柱。我们的方法通过将音乐分析，特别是结构分析与音乐生成相结合来解决上述问题。我们的方法提取的节奏特征，以及旋律和和弦从输入的音频记录，并反映在分数。为了考虑酒吧之间的长期相关性，我们使用相似性矩阵，创建几个声学特征，作为约束。我们进一步进行多元回归分析，以确定代表最有价值的约束，产生一个音乐结构的声学特征。我们已经使用我们的方法生成了钢琴乐谱，并观察到我们可以生成在实现节奏特征的能力和获得音乐结构的能力之间具有不同平衡的乐谱。
This study describes a method that automatically generates a piano reduction score from the audio recordings of popular music while considering the musical structure. The generated score comprises both right- and left-hand piano parts, which reflect the melodies, chords, and rhythms extracted from the original audio signals. Generating such a reduction score from an audio recording is challenging because automatic music transcription is still considered to be inefficient when the input contains sounds from various instruments. Reflecting the long-term correlation structure behind similar repetitive bars is also challenging; further, previous methods have independently generated each bar. Our approach addresses the aforementioned issues by integrating musical analysis, especially structural analysis, with music generation. Our method extracts rhythmic features as well as melodies and chords from the input audio recording and reflects them in the score. To consider the long-term correlation between bars, we use similarity matrices, created for several acoustical features, as constraints. We further conduct a multivariate regression analysis to determine the acoustical features that represent the most valuable constraints for generating a musical structure. We have generated piano scores using our method and have observed that we can produce scores that differently balance between the ability to achieve rhythmic characteristics and the ability to obtain musical structures.