CityNet - Deep Learning Tools for Urban Ecoacoustic Assessment
CityNet - Deep Learning Tools for Urban Ecoacoustic Assessment
复制标题
CityNet - 用于城市生态声学评估的深度学习工具
DOI：
10.1101/248708
复制
发表时间：
2018
期刊：
影响因子：
--
通讯作者：
Fairbrass A
中科院分区：
文献类型：
--
作者：
Fairbrass A
城市支持独特而有价值的生态社区，但由于评估生物多样性的困难，对城市野生动物的了解有限。生态声学调查是评估生境的一种有用方法，从录音中测得的生物声音被用作种群丰度和/或活动的代表。然而，现有的算法系统地高估和低估了记录中存在典型城市非生物声音的生物活动的测量。我们开发了CityNet，这是一个使用卷积神经网络（CNN）的深度学习系统，用于测量城市中的可听生物（CityBioNet）和人为（CityAnthroNet）声学活动。CNN是在英国大伦敦收集的注释音频记录的大型数据集上训练的。使用一个测试数据集，我们将CityBioNet和CityAnthroNet的精确度和召回率分别与最好的替代算法进行比较：四个声学指数：声学复杂性指数，声学多样性指数，生物声学指数和标准化差异声景指数，以及最先进的鸟鸣检测CNN（bulbul）。我们还比较了非生物声音对CityBioNet和bulbul预测的影响。最后，我们应用CityNet来描述城市声景观的声学模式在两个站点沿着的城市化gradient.CityBioNet是最好的执行算法测量生物活动的精度和召回，其次是白头翁，而声学指数表现最差。CityAnthroNet的表现优于标准化差异声景指数，但比CityBioNet与竞争算法相比的优势要小。CityBioNet的预测受到机械声音的影响，而空中交通和风的声音影响了白头翁的预测。在城市化梯度中，我们发现CityNet从真实的城市音频数据中产生了生物和人类声学活动的真实日常模式。使用CityNet，可以从音频记录中自动测量城市中的生物和人类声学活动。如果嵌入到自主传感系统中，CityNet可以产生大规模的城市环境数据，并促进调查人类活动对野生动物的影响。算法、代码和预训练模型与两个专家注释的城市音频数据集结合使用，以促进城市的自动化环境监测。
Cities support unique and valuable ecological communities, but understanding urban wildlife is limited due to the difficulties of assessing biodiversity. Ecoacoustic surveying is a useful way of assessing habitats, where biotic sound measured from audio recordings is used as a proxy for population abundance and/or activity. However, existing algorithms systematically over and underestimate measures of biotic activity in the presence of typical urban non‐biotic sounds in recordings.We develop CityNet, a deep learning system using convolutional neural networks (CNNs), to measure audible biotic (CityBioNet) and anthropogenic (CityAnthroNet) acoustic activity in cities. The CNNs were trained on a large dataset of annotated audio recordings collected across Greater London, UK. Using a held‐out test dataset, we compare the precision and recall of CityBioNet and CityAnthroNet separately to the best available alternative algorithms: four Acoustic Indices: Acoustic Complexity Index, Acoustic Diversity Index, Bioacoustic Index, and Normalised Difference Soundscape Index, and a state‐of‐the‐art bird call detection CNN (bulbul). We also compare the effect of non‐biotic sounds on the predictions of CityBioNet and bulbul. Finally we apply CityNet to describe acoustic patterns of the urban soundscape in two sites along an urbanisation gradient.CityBioNet was the best performing algorithm for measuring biotic activity in terms of precision and recall, followed by bulbul, whereas the Acoustic Indices performed worst. CityAnthroNet outperformed the Normalised Difference Soundscape Index, but by a smaller margin than CityBioNet achieved against the competing algorithms. The CityBioNet predictions were impacted by mechanical sounds, whereas air traffic and wind sounds influenced the bulbul predictions. Across an urbanisation gradient, we show that CityNet produced realistic daily patterns of biotic and anthropogenic acoustic activity from real‐world urban audio data.Using CityNet, it is possible to automatically measure biotic and anthropogenic acoustic activity in cities from audio recordings. If embedded within an autonomous sensing system, CityNet could produce environmental data for cites at large‐scales and facilitate investigation of the impacts of anthropogenic activities on wildlife. The algorithms, code and pretrained models are made freely available in combination with two expert‐annotated urban audio datasets to facilitate automated environmental surveillance in cities.
登录
查看更多内容
影响因子：
25.7
作者：
Crouse, Dan L.;Pinault, Lauren;Villeneuve, Paul J.
通讯作者：
Villeneuve, Paul J.
影响因子：
5.9
作者：
Gasc, A.;Pavoine, S.;Sueur, J.
通讯作者：
Sueur, J.
影响因子：
5
作者：
Boelman, Natalie T.;Asner, Gregory P.;Martin, Roberta E.
通讯作者：
Martin, Roberta E.
DOI：
10.1109/waspaa.2017.8170052
发表时间：
2017-10
期刊：
2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA)
影响因子：
--
作者：
J. Salamon;D. MacConnell;M. Cartwright;P. Li;J. Bello
通讯作者：
J. Salamon;D. MacConnell;M. Cartwright;P. Li;J. Bello
影响因子：
2.7
作者：
Stowell D;Plumbley MD
通讯作者：
Plumbley MD