A Deep Attention Model for Environmental Sound Classification from Multi-Feature Data
A Deep Attention Model for Environmental Sound Classification from Multi-Feature Data
复制标题
多特征数据环境声音分类的深度关注模型
DOI:
10.3390/app12125988
复制
发表时间:
2022-06-01
影响因子:
2.7
通讯作者:
Wang, Pan
中科院分区:
文献类型:
--
作者:
Guo, Jinming;Li, Chuankun;Wang, Pan
Automated environmental sound recognition has clear engineering benefits; it allows audio to be sorted, curated, and searched. Unlike music and language, environmental sound is loaded with noise and lacks the rhythm and melody of music or the semantic sequence of language, making it difficult to find common features representative enough of various environmental sound signals. To improve the accuracy of environmental sound recognition, this paper proposes a recognition method based on multi-feature parameters and time-frequency attention module. It begins with a pretreatment that relies on multi-feature parameters to extract the sound, which supplements the phase information lost by the Log-Mel spectrogram in the current mainstream methods, and enhances the expressive ability of input features. A time-frequency attention module with multiple convolutions is designed to extract the attention weight of the input feature spectrogram and reduce the interference coming from the background noise and irrelevant frequency bands in the audio. Comparative experiments were conducted on three general datasets: environmental sound classification datasets (ESC-10, ESC-50) and an UrbanSound8K dataset. Experiments demonstrated that the proposed method performs better.