It's About Time: Minimizing Hardware and Software Latencies in Speech Research With Real-Time Auditory Feedback.

It's About Time: Minimizing Hardware and Software Latencies in Speech Research With Real-Time Auditory Feedback.
复制标题

DOI:
10.1044/2020_jslhr-19-00419
复制
发表时间:
2020-08-10
期刊:
Journal of speech, language, and hearing research : JSLHR
影响因子:
--
通讯作者:
Max L
Max L
中科院分区:
其他
文献类型:
--
作者:
Kim KS;Wang H;Max L

文献摘要

被引文献

相似文献

通过听觉反馈扰动范例,其中参与者的声学语音输出被实验性地改变并通过耳机/头戴式耳机“以真实的时间”回放,已经检查了与听觉-运动整合和学习相关的语音产生的各个方面。科学的严谨性要求在确定和报告所涉及的硬件和软件方面具有高精度。然而,文献中的许多报告与给定实验设置的最小可实现延迟不一致。在这里,我们特别关注与实施实时听觉反馈扰动相关的方法学问题,并为提高这一特定工作的可重复性提供了具体建议。硬件和软件延迟以及总反馈回路延迟被测量用于使用Auditon软件的共振峰扰动研究。对各种音频接口、台式机和笔记本电脑以及音频驱动程序进行了测量。还测试了一种通过非默认参数规范降低Auditon软件延迟的方法。经常被忽视的硬件特定延迟对于一些测试的音频接口来说是不可忽略的(加起来高达15 ms)。总反馈环路延迟(包括硬件和软件延迟)通常也大于文献中的要求。非默认的参数值可以改善Auditory自身的处理延迟,而不会对共振峰跟踪产生负面影响。音频接口的选择和软件参数的优化实质上影响总的反馈环路延迟。因此,需要在所有发布的报告中正确测量和描述实际的总延迟(硬件加软件)。未来的语音研究与“实时”听觉反馈扰动应增加科学严谨性,尽量减少这种延迟。
Various aspects of speech production related to auditory–motor integration and learning have been examined through auditory feedback perturbation paradigms in which participants' acoustic speech output is experimentally altered and played back via earphones/headphones “in real time.” Scientific rigor requires high precision in determining and reporting the involved hardware and software latencies. Many reports in the literature, however, are not consistent with the minimum achievable latency for a given experimental setup. Here, we focus specifically on this methodological issue associated with implementing real-time auditory feedback perturbations, and we offer concrete suggestions for increased reproducibility in this particular line of work. Hardware and software latencies as well as total feedback loop latency were measured for formant perturbation studies with the Audapter software. Measurements were conducted for various audio interfaces, desktop and laptop computers, and audio drivers. An approach for lowering Audapter's software latency through nondefault parameter specification was also tested. Oft-overlooked hardware-specific latencies were not negligible for some of the tested audio interfaces (adding up to 15 ms). Total feedback loop latencies (including both hardware and software latency) were also generally larger than claimed in the literature. Nondefault parameter values can improve Audapter's own processing latency without negative impact on formant tracking. Audio interface selection and software parameter optimization substantially affect total feedback loop latency. Thus, the actual total latency (hardware plus software) needs to be correctly measured and described in all published reports. Future speech research with “real-time” auditory feedback perturbations should increase scientific rigor by minimizing this latency.