Smart drone audition: A search and rescue drone system that listens and communicates

Benjamin Yen博士将他在奥克兰大学的一些研究成果整合到东京工业大学的相关无人机试听项目中。具体来说，他结合了他在声源增强工作中的技术，以改善使用多架无人机的声源跟踪。这已经产生了一个会议论文提交到2023年IEEE/RSJ智能机器人和系统国际会议。该论文目前正在审稿中。我们已经向IEEE/ACM音频语音和语言处理事务提交了一篇关于无人机试听的期刊文章。具体而言，我们提出了一种噪声协方差矩阵估计方法，可应用于无人机试听声源增强算法。虽然这项研究是在Benjamin Yen博士在奥克兰大学期间开展的，但它完全在JSPS博士后奖学金提案的研究范围内，并且是一个将在该奖学金期间进一步发展的课题。这篇论文目前正在进行重大修改。我们进行了大型户外实验，收集必要的数据，对各种无人机试听算法进行性能评估。这包括无人机噪音和移动目标声源的精确音频记录。此外，还记录了目标声源运动的精确GPS数据。这些测量将有助于从所提出的算法中评估声源跟踪性能。我们计划了一系列与研究主题相关的研究课题，由我们自己和新的B4/硕士学生研究。

Dr. Benjamin Yen has integrated some of his research at the University of Auckland into related drone audition projects at the Tokyo Institute of Technology. Specifically, he incorporated techniques from his work in sound source enhancement to improve sound source tracking using multiple drones. This has yielded a conference paper submission to the 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems. The paper is currently under review.We have submitted a journal article for drone audition to the IEEE/ACM Transactions on Audio Speech and Language Processing. Specifically, we proposed a noise covariance matrix estimation method that can be applied to sound source enhancement algorithms for drone audition. While this research is developed during Dr. Benjamin Yen's time at the University of Auckland, it is entirely within the research scope of the JSPS postdoctoral fellowship proposal and is a topic that will be further developed during this fellowship. The paper is currently under major revision.We have carried out a major outdoor experiment to collect the necessary data to perform performance evaluation for various drone audition algorithms. This includes accurate audio recordings of drone noise and a moving target sound source. In addition, accurate GPS data of the target sound source's movement is also recorded. These measurements will be helpful in evaluating sound source tracking performance from the algorithms proposed.We have planned a range of research topics related to the research theme to be researched by ourselves and new B4/masters students.