An integrated framework for field recording, localization,classification and annotation of birdsongs using robot audition techniques-HARKBIRD 2.0
An integrated framework for field recording, localization,classification and annotation of birdsongs using robot audition techniques-HARKBIRD 2.0
复制标题
使用机器人试听技术进行鸟鸣现场录音、定位、分类和注释的集成框架-HARKBIRD 2.0
DOI：
10.1109/icassp.2019.8683743
复制
发表时间：
2019
期刊：
影响因子：
--
通讯作者：
Hiroshi G. Okuno
中科院分区：
文献类型：
--
作者：
Shinji Sumitani;Reiji Suzuki;Naoaki Chiba;Shiho Matsubayashi;Takaya Arita;Kazuhiro Nakadai;Hiroshi G. Okuno
鸟类发声是生态声学研究的重要课题之一，因为鸟类通过各种发声方式进行交流，如鸣叫等。我们开发了一个便携式系统HARKBird来提供一个基本的功能，即鸟鸣定位，它使用基于HARK的机器人听力技术自动提取声源及其到达方向(DOA)。在本文中，我们介绍了HARKBird 2.0，它可以更好地理解鸟鸣。基于非监督特征映射t-SNE的歌曲分类交互界面增强了用于本地化结果的新的Soundscape注释工具。我们发现，HARKBird 2.0为鸟类研究人员提供了一个集成的框架，可以利用日本林莺的鸣叫分析来分析鸟类鸣叫的时空动态。
Bird vocalizations are one of the important subjects in ecoacoustics because birds communicate diversely using various vocalizations such as songs and calls. We have developed a portable system, HARKBird to provide a basic function, i.e., birdsong localization, which automatically extracts sound sources and their direction of arrivals (DOA) using robot audition techniques based on HARK. In this paper, we introduce HARKBird 2.0 which is empowered for higher understanding of birdsongs. A new soundscape annotation tool for localization results is enhanced by an interactive interface for song classification based on an unsupervised feature mapping t-SNE. We show that HARKBird 2.0 provides bird researchers with an integrated framework to analyze spatio-spectro-temporal dynamics of birdsongs using the song analysis of Japanese bush warbler (Horornis diphone).