Automatic Indexing of Audio with Timbre Information for Musical Instruments of Definite Pitch

定音乐器的带有音色信息的音频自动索引

• 批准号: 0414815
• 负责人: Zbigniew Ras
• 金额: $ 31.5万
• 依托单位: University of North Carolina at Charlotte
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2005
• 资助国家: 美国
• 起止时间: 2005-01-15 至 2008-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0414815&HistoricalAwards=false
• 关键词: Automatic; Indexing; Audio; Timbre; Information

The goal of the project is to construct a system for automatic extraction of audio files containing a tune performed with desired timbre, given microphone vocal input. The system will be able to identify which audio files within the searched database match the tune and timbre of specified instrument or instrument family with selected articulation. The approach consists of sound processing, segmentation, and indexing of audio files for content-based searching. The first step is the elaboration of the appropriate sound description for timbre classification, based on low-level sound parameters. The main process involves segmentation of audio files from the database into musical events, and indexing them using a dedicated tree-based structure. When this step is accomplished, the database of audio files, indexed using the above procedure, can be searched. This research project has a strong educational component. It involves graduate students gaining expertise in sound processing under the guidance of PIs and adding this new research domain into a set of topics currently offered by the graduate program in Computer Science at UNC-Charlotte. Involvement of faculty and graduate students from the Polish-Japanese Institute of Information Technology in this project will add not only a strong international component to it, but also will expose graduate students at UNC-Charlotte to international collaboration.As the result of this project, new tools applicable for automatic search of audio files matching desired contents, including melody and timbre information, will be available to users and research community.

该项目的目标是构建一个系统，用于自动提取音频文件，其中包含与所需的音色，给定麦克风声乐输入执行的曲调。该系统将能够识别在所搜索的数据库内的哪些音频文件与具有所选择的清晰度的指定乐器或乐器族的曲调和音色匹配。该方法包括声音处理，分割和索引的音频文件的基于内容的搜索。第一步是根据低电平声音参数，为音色分类制定适当的声音描述。主要过程包括将数据库中的音频文件分割成音乐事件，并使用专用的基于树的结构对其进行索引。完成此步骤后，可以搜索使用上述过程索引的音频文件数据库。这个研究项目有很强的教育成分。它涉及研究生在PI的指导下获得声音处理方面的专业知识，并将这一新的研究领域添加到目前由北卡罗来纳大学夏洛特分校计算机科学研究生课程提供的一系列主题中。波兰-日本信息技术研究所的教师和研究生参与该项目不仅将为其增加一个强大的国际组成部分，而且还将使UNC-Charlotte的研究生参与国际合作。作为该项目的结果，适用于自动搜索与所需内容匹配的音频文件的新工具，包括旋律和音色信息，将提供给用户和研究界。