Visualizing Directional Soundscapes of Bird Vocalizations Using Robot Audition Techniques

Visualizing Directional Soundscapes of Bird Vocalizations Using Robot Audition Techniques
复制标题

DOI：
10.1109/ieeeconf49454.2021.9382639
复制
发表时间：
2021-01
期刊：
2021 IEEE/SICE International Symposium on System Integration (SII)
影响因子：
--
通讯作者：
Reiji Suzuki;Hao Zhao;Shinji Sumitani;Shiho Matsubayashi;Takaya Arita;K. Nakadai;H. Okuno
Reiji Suzuki;Hao Zhao;Shinji Sumitani;Shiho Matsubayashi;Takaya Arita;K. Nakadai;H. Okuno
中科院分区：
其他
文献类型：
--
作者：
Reiji Suzuki;Hao Zhao;Shinji Sumitani;Shiho Matsubayashi;Takaya Arita;K. Nakadai;H. Okuno

文献摘要

相似文献

声景动力学的可视化是生态声学的重要课题之一。然而，现有的方法主要集中在频域的声景，而在方向或空间域的声景也是必不可少的，以更好地理解动物发声。本文提出并讨论了新的应用程序的机器人听觉技术可视化声景动态的方向或空间域通过使用的方向信息的声源从机器人听觉软件HARK（本田研究所日本机器人与京都大学的试镜）和鸟鸣定位HARKBird的软件。首先，我们创建一个假彩色声谱图，可视化方向音景，其中声谱图的颜色反映了分离声音的到达方向。我们还通过结合声音存在的似然熵（MUSIC谱）和潜在空间嵌入方法（UMAP）来可视化定向音景的分布。我们将这些技术应用于5分钟的记录与6个个体的斑胸草雀，以表明所提取的视觉信息可以反映声学结构之间的一组鸟类个体的方向域。
A visualisation of the soundscape dynamics is one of the important topics in ecoacousics. However, existing approaches mainly focused on the soundscape in the frequency domain while the soundscape in the directional or spatial domain is also essential to better understand animal vocalizations. This paper proposes and discusses novel applications of robot audition techniques to visualize soundscape dynamics in the directional or spatial domain by using the directional information of sound sources obtained from the robot audition software HARK (Honda Research Institute Japan Audition for Robots with Kyoto University) and the software for birdsong localization HARKBird. First, we create a false-color spectrogram that visualizes directional soundscapes in which the color of the spectrogram reflects the direction of arrival of separated sounds. We also visualize the distribution of directional soundscapes by combining the entropy of the likelihood of sound existence (MUSIC spectrum) and a latent space embedding method (UMAP). We applied these techniques to a 5 min recording with 6 individuals of Zebra Finch in order to show that the extracted visual information can reflect acoustic structures among the group of bird individuals in the directional domain.