An Overview on Perceptually Motivated Audio Indexing and Classification
An Overview on Perceptually Motivated Audio Indexing and Classification
复制标题
DOI：
10.1109/jproc.2013.2251591
复制
发表时间：
2013-07
影响因子：
20.6
通讯作者：
G. Richard;Shiva Sundaram;Shrikanth S. Narayanan
中科院分区：
文献类型：
--
作者：
G. Richard;Shiva Sundaram;Shrikanth S. Narayanan
音频索引系统旨在通过识别、标记或分类不同的声学事件来描述音频内容。由于所得到的音频分类和索引旨在用于直接的人类消费，因此非常期望其产生感知相关的结果。这可以通过在设计过程中不同程度地整合人类听觉系统的特定知识来实现。在本文中，我们强调了一些重要的概念，用于音频分类和索引的感知动机或利用感知的一些原则。特别是，我们讨论了几种不同的策略，以整合人类的感知，包括：1）使用通用的听觉模型; 2）使用感知相关的功能的分析阶段，感知合理的听力模型的组成部分，或作为相关的感知维度的声音相似性;和3）参与用户在音频索引或分类任务。在本文中，我们还说明了一些最近的趋势，语义音频检索，近似更高层次的感知处理和人类音频识别能力的认知方面，包括基于影响的音频检索。
An audio indexing system aims at describing audio content by identifying, labeling, or categorizing different acoustic events. Since the resulting audio classification and indexing is meant for direct human consumption, it is highly desirable that it produces perceptually relevant results. This can be obtained by integrating specific knowledge of the human auditory system in the design process to various extent. In this paper, we highlight some of the important concepts used in audio classification and indexing that are perceptually motivated or that exploit some principles of perception. In particular, we discuss several different strategies to integrate human perception, including: 1) the use of generic audition models; 2) the use of perceptually relevant features for the analysis stage that are perceptually justified either as a component of a hearing model or as being correlated with a perceptual dimension of sound similarity; and 3) the involvement of the user in the audio indexing or classification task. In this paper, we also illustrate some of the recent trends in semantic audio retrieval that approximate higher level perceptual processing and cognitive aspects of human audio recognition capabilities, including affect-based audio retrieval.