RI: Small: Collaborative Research: 'Houston We Have A Solution': Novel Speech Processing Advancements for Analysis of Large Asynchronous Multi-Channel Audio Corpora

该项目的重点是开发新的语音处理技术，这将改变对大型异步多通道和各种多媒体材料的访问。特别是，开发的算法正在用于创建一个新的多源和多尺度事件重建系统，该系统汇集了阿波罗登月任务的大量档案，以创建与历史材料的体验式交互。具体的研究进展集中在最先进的声学环境分析，语音识别，包括关键字定位，在不利条件下的说话人识别，多模式内容对齐，以及自动链接的事件和实体从口语内容。具体而言，该研究正在开发：（i）用于噪声和信道鲁棒声学处理的新技术，利用具有新特征提取和补偿技术的缺失特征概念，（ii）用于语音识别的新发音框架，用于对语音产生中的变化的鲁棒性，（iii）环境“嗅探”技术，用于自动表征声学环境以提高鲁棒性，以及（iv）新的任务特定音频事件的自动检测。由于数据是异步的，因此正在制定独特的语音分析技术，以解决NASA使命控制中心的大量“本地环路”内部通话电路，在特定使命事件期间在两个阿波罗航天器上记录的音频，以及空间到地面的无线电电路。具体的语音、语言和知识提取进步将被集成到一个新的自动评估模型中，该模型反映了事件重建任务中遇到的具体挑战。该平台将由位于达拉斯的德克萨斯大学科学与工程教育中心（SEEC）的实际用户部署和评估。强大的语音处理算法与事件重建系统的集成将对教育，社会和政府组织产生直接和直接的影响。利用NASA的阿波罗使命数据，可以开发语音技术，以应对包含严重通信信道伪影、串扰/静态/音调和低信噪比的具有挑战性的音频。该项目开发的软件将提供给任何非营利组织，供其用于音频/视频搜索（下载时附带培训模块）。在高级设计团队工作的学生还将开发一个接触科学站，部署在德克萨斯州的达拉斯，并由德克萨斯大学达拉斯科学与工程教育中心监督，以说明和评估学生对进步的使用。 作为这个项目的持久遗产，这个项目团队包括人类太空飞行的杰出历史学家，他们将探索在博物馆环境中部署这个事件重建系统的机会，在那里它可以支持学术和公众参与，我们将在开源的基础上提供系统本身，以支持其他研究人员。

This project is focused on developing new speech processing techniques which will transform access to large asynchronous multi-channel and diverse collections of multimedia materials. In particular, the algorithms developed are being employed to create a novel multi-source and multi-scale event reconstruction system that brings together the massive archives of the Apollo lunar missions, to create experiential interaction with historical materials. Specific research advancements are focused on state of the art acoustic environment analysis, speech recognition including keyword spotting, speaker identification under adverse conditions, multimodal content alignment, and automated linking for events and entities from spoken content. Specifically, the research is developing: (i) new techniques for noise- and channel-robust acoustic processing, exploiting missing-features concepts with novel feature extraction and compensation techniques, (ii) a new articulatory framework for speech recognition for robustness to variations in speech production, (iii) environmental "sniffing" techniques to automatically characterize acoustic environments to improve robustness, and (iv) automatic detection of novel task-specific audio-events. Since the data is asynchronous, unique speech analytics techniques are being formulated to address the large number of "local loop" intercom circuits in the NASA Mission Control Center, audio recorded onboard the two Apollo spacecrafts during specific mission events, and space-to-ground radio circuits. The specific speech, language, and knowledge extraction advancements will be integrated into a new automated evaluation model that reflects specific challenges encountered in the event reconstruction task. This platform will be deployed and evaluated by actual users from the Science and Engineering Education Center (SEEC) of the University of Texas at Dallas. Integration of robust speech processing algorithms with event reconstruction systems will have a direct and immediate impact on education, society, and government organizations. Working with NASA's Apollo mission data allows for the development of speech technology for challenging audio that contains severe communication channel artifacts, cross-talk/static/tones, and low signal-to-noise ratios. The software being developed in this project will be made available to any non-profit organization for use in audio/video search (download with training modules). Students working on senior design teams will also develop a Contact Science station to be deployed in Dallas, TX and overseen by the University of Texas in Dallas Science and Engineering Education Center to illustrate and assess student use of the advancements. As a lasting legacy for this project, this project team includes eminent historians of human space flight, who will explore opportunities to deploy this event reconstruction system in a museum setting where it can support both scholarship and public engagement, and we will make the system itself available on an open-source basis to support other researchers.