Lyrics-Based Audio Retrieval and Multimodal Navigation in Music Collections
Lyrics-Based Audio Retrieval and Multimodal Navigation in Music Collections
复制标题
音乐收藏中基于歌词的音频检索和多模态导航
DOI：
--
复制
发表时间：
2007
期刊：
影响因子：
--
通讯作者：
M. Clausen
中科院分区：
文献类型：
--
作者：
Meinard Müller;F. Kurth;D. Damm;C. Fremerey;M. Clausen
现代数字音乐库包含在各种语义级别上描述音乐的文本、视觉和音频数据。本文利用一首音乐的不同语义相关表示的可用性，提出了一种按歌词查询检索系统，该系统有助于 CD 音频收藏中的多模式导航。特别是，我们引入了一种自动化方法，使用同步算法的组合将给定歌词与底层歌曲的音频录音进行时间对齐。此外，我们描述了一个歌词搜索引擎，并展示了如何使用歌词-音频对齐直接从查询结果列表导航到录音中相应的匹配位置。最后，我们提供了一个用于基于歌词的查询和查询结果回放的用户界面，该界面扩展了我们的 SyncPlayer 框架的功能，用于基于内容的音乐和音频导航。
Modern digital music libraries contain textual, visual, and audio data describing music on various semantic levels. Exploiting the availability of different semantically interrelated representations for a piece of music, this paper presents a query-by-lyrics retrieval system that facilitates multimodal navigation in CD audio collections. In particular, we introduce an automated method to time align given lyrics to an audio recording of the underlying song using a combination of synchronization algorithms. Furthermore, we describe a lyrics search engine and show how the lyrics-audio alignments can be used to directly navigate from the list of query results to the corresponding matching positions within the audio recordings. Finally, we present a user interface for lyrics-based queries and playback of the query results that extends the functionality of our SyncPlayer framework for content-based music and audio navigation.