CAREER: Audio RESCUE: Realistic Audio for RESponders in Complex Undetermined Environments

职业：音频救援：在复杂的不确定环境中为响应者提供逼真的音频

• 批准号: 1845324
• 负责人: Kyla McMullen
• 金额: $ 55万
• 依托单位: University of Florida
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-08-15 至 2025-07-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1845324&HistoricalAwards=false
• 关键词: CAREER; Audio; RESCUE; Realistic; RESponders

First responders save lives in hazardous conditions such as hurricanes, tsunamis, earthquakes, fires, and terror events, and their role is more important than ever. For firefighters, the greatest challenges in search and rescue tasks are low visibility, disorientation, and tracking other team members. Despite methods to overcome these challenges, firefighters are still plagued by getting lost in buildings, miscommunication of locations and spaces, and not being able to identify paths. This project investigates using spatial (or 3D) sound to represent targets of interest (for example, a lost child) in order to allow first responders to use sound to navigate to specific points that they are unable to see. Using 3D sound in this context is a promising solution because responders' hands are often occupied, and a visual display can increase cognitive load. In addition, the present work will develop supplemental augmented-reality modules for firefighter emergency medical service (EMS) training. This training will allow firefighters to practice EMS skills in a realistic environment outside of the classroom. The PI and team will engage a diverse pool of underrepresented minority students through recruitment from the Distributed Research Experiences for Undergraduates (DREU) program and the Institute for African American Mentoring in Computing Sciences (iAAMCS). University of Florida (UF) undergraduate students will also be recruited through the Emerging Scholars Program to participate in the proposed work. Furthermore, firefighters will receive more interactive educational training as a direct result of their collaboration in this research program.This research will pursue a novel research program to create a fundamental understanding of how to move 3D audio research out of the laboratory into the real world. Working closely with Gainesville Fire Rescue (GFR) as the testbed application domain, the project team will evaluate using 3D audio to support a search and rescue mission. The PI and team will evaluate firefighters' performance and use the results to inform data-driven and empirically validated 3D sound design guidelines that address the following challenges: Realistic 3D sound rendering - this is challenging due to the individualistic nature of 3D sound filters, sound delivery hardware, and perceptual qualities of sounds; Change detection - in real-world contexts, a user must be able to quickly detect 3D sound changes, however, limited literature exists in this area; Effects of competing sounds - real-world scenarios are filled with background noise that may hinder the listener from accurately distinguishing a 3D sound of interest. Project outcomes will help first responders unobtrusively perceive the 360 degree world around them and maintain awareness of their surroundings.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

急救人员在飓风、海啸、地震、火灾和恐怖事件等危险情况下拯救生命，他们的作用比以往任何时候都更加重要。对于消防员来说，搜索和救援任务中最大的挑战是能见度低、迷失方向和跟踪其他队员。尽管有克服这些挑战的方法，消防队员仍然受到在建筑物中迷路，位置和空间的错误沟通以及无法识别路径的困扰。该项目研究使用空间（或3D）声音来表示感兴趣的目标（例如，丢失的孩子），以便第一响应者使用声音导航到他们无法看到的特定点。在这种情况下使用3D声音是一种很有前途的解决方案，因为响应者的手经常被占用，而视觉显示会增加认知负荷。此外，目前的工作将开发用于消防员紧急医疗服务（EMS）培训的补充增强现实模块。这项培训将使消防队员在教室外的现实环境中练习EMS技能。PI和团队将通过本科生分布式研究经验（DREU）计划和非裔美国人计算机科学导师研究所（iAAMCS）的招聘来吸引代表性不足的少数民族学生。佛罗里达大学（UF）的本科生也将通过新兴学者计划招募参加拟议的工作。此外，消防员将获得更多的互动教育培训，作为他们在这个研究计划的合作的直接结果。这项研究将追求一个新的研究计划，以创建一个基本的理解，如何移动3D音频研究出实验室到真实的世界。项目团队将与盖恩斯维尔消防救援（GFR）作为测试平台应用领域密切合作，评估使用3D音频来支持搜救使命的情况。PI和团队将评估消防员的表现，并使用结果为数据驱动和经验验证的3D声音设计指南提供信息，以解决以下挑战：逼真的3D声音渲染-由于3D声音过滤器，声音传输硬件和声音的感知质量的个性化性质，这是具有挑战性的;变化检测-在现实环境中，用户必须能够快速检测3D声音变化，然而，该领域的文献有限;竞争声音的影响-现实世界的场景充满了背景噪音，可能会阻碍听众准确区分感兴趣的3D声音。 项目成果将帮助第一反应者不显眼地感知周围的360度世界，并保持对周围环境的意识。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Prediction of Object Geometry from Acoustic Scattering Using Convolutional Neural Networks

• DOI: 10.1109/icassp39728.2021.9414743
• 发表时间: 2020-10
• 期刊: ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
• 作者: Ziqi Fan;Vibhav Vineet;Chenshen Lu;K. McMullen

The Effects of Laboratory Environment Type on Intermittent Sound Localization

实验室环境类型对间歇声定位的影响

• DOI: 10.1177/1071181322661494
• 发表时间: 2022
• 期刊: Proceedings of the Human Factors and Ergonomics Society Annual Meeting
• 作者: Roberts, Armisha;McMullen, Kyla
• 通讯作者: McMullen, Kyla

Computation of Head-Related Transfer Functions Using Graphics Processing Units and a Perceptual Validation of the Computed HRTFs against Measured HRTFs

使用图形处理单元计算与头部相关的传递函数，并对计算的 HRTF 与测量的 HRTF 进行感知验证

• 发表时间: 2019
• 期刊: 2019 AES INTERNATIONAL CONFERENCE ON HEADPHONE TECHNOLOGY
• 作者: Fan, Ziqi;Arce, Terek;Lu, Chenshen;Zhang, Kai;Wu, T. W.;McMullen, Kyla
• 通讯作者: McMullen, Kyla