The Influence of Age, Hearing, and Working Memory on the Speech Comprehension Benefit Derived from an Automatic Speech Recognition System
The Influence of Age, Hearing, and Working Memory on the Speech Comprehension Benefit Derived from an Automatic Speech Recognition System
复制标题
年龄、听力和工作记忆对自动语音识别系统的语音理解效果的影响
DOI：
10.1097/aud.0b013e3181987063
复制
发表时间：
2009
期刊：
影响因子：
3.7
通讯作者：
T. Houtgast
中科院分区：
文献类型：
--
作者：
A. Zekveld;S. Kramer;J. Kessens;M. Vlaming;T. Houtgast
目的：本研究的目的是检验自动语音识别 (ASR) 系统自动生成的部分不正确的字幕是否可以提高听力障碍听众的语音理解能力。在早期的一项研究中（Zekveld 等人，2008 年），我们表明，当呈现部分不正确的自动生成的字幕时，听力正常的年轻听众在噪音中的语音理解能力会有所提高。目前的研究重点是年龄、听力损失、视觉工作记忆能力和语言技能对在噪音中聆听语音时自动生成的字幕所带来的好处的影响。设计：为了调查年龄和听力损失的影响，纳入了三组参与者：22 名听力正常的年轻人（YNH，平均年龄 = 21 岁）、22 名听力正常的中年人（MA-NH，平均年龄 = 55 岁）和 30 名听力障碍中年人（MA-HI，平均年龄 = 57 岁）。自动字幕的好处通过语音接收阈值 (SRT) 测试来衡量（Plomp & Mimpen，1979）。进行了单模态听觉和双模态视听 SRT 测试。在视听测试中，字幕与语音同时呈现，而在听觉测试中，仅呈现语音。听觉和视听 SRT 之间的差异被定义为视听效益。参与者还对听力努力进行了评分。我们使用重复测量一般线性模型分析来研究 ASR 准确度水平和文本延迟对视听效果和听力效果的影响。在相关性分析中，我们评估了年龄、听觉 SRT、视觉工作记忆能力与视听效益和听力努力之间的关系。结果：自动生成的字幕提高了当前研究涵盖的所有 ASR 准确性和延迟的噪声中的语音理解能力。 ASR 准确度越高，字幕带来的好处就越大。即使 ASR 准确度水平相对较低，语音理解能力也能得到改善；例如，参与者获得了约 2 dB SNR 视听优势，ASR 准确度约为 74%。延迟呈现文本会降低收益并增加听力努力。单模态语音理解能力相对较低的参与者比单模态语音理解能力较好的参与者从字幕中获得的益处更大。我们观察到，听力正常的听众的工作记忆能力会随着年龄的增长而下降。年龄较大和工作记忆容量较低与使用字幕提高语音理解能力所需的努力增加有关。结论：无论年龄和听力损失如何，参与者都能够使用部分不正确和延迟的字幕来提高他们对噪音中语音的理解。这支持辅助听力系统的进一步开发和评估，该系统显示自动识别的语音，以帮助有听力障碍的听众理解语音。
Objective: The aim of the current study was to examine whether partly incorrect subtitles that are automatically generated by an Automatic Speech Recognition (ASR) system, improve speech comprehension by listeners with hearing impairment. In an earlier study (Zekveld et al. 2008), we showed that speech comprehension in noise by young listeners with normal hearing improves when presenting partly incorrect, automatically generated subtitles. The current study focused on the effects of age, hearing loss, visual working memory capacity, and linguistic skills on the benefit obtained from automatically generated subtitles during listening to speech in noise. Design: In order to investigate the effects of age and hearing loss, three groups of participants were included: 22 young persons with normal hearing (YNH, mean age = 21 years), 22 middle-aged adults with normal hearing (MA-NH, mean age = 55 years) and 30 middle-aged adults with hearing impairment (MA-HI, mean age = 57 years). The benefit from automatic subtitling was measured by Speech Reception Threshold (SRT) tests (Plomp & Mimpen, 1979). Both unimodal auditory and bimodal audiovisual SRT tests were performed. In the audiovisual tests, the subtitles were presented simultaneously with the speech, whereas in the auditory test, only speech was presented. The difference between the auditory and audiovisual SRT was defined as the audiovisual benefit. Participants additionally rated the listening effort. We examined the influences of ASR accuracy level and text delay on the audiovisual benefit and the listening effort using a repeated measures General Linear Model analysis. In a correlation analysis, we evaluated the relationships between age, auditory SRT, visual working memory capacity and the audiovisual benefit and listening effort. Results: The automatically generated subtitles improved speech comprehension in noise for all ASR accuracies and delays covered by the current study. Higher ASR accuracy levels resulted in more benefit obtained from the subtitles. Speech comprehension improved even for relatively low ASR accuracy levels; for example, participants obtained about 2 dB SNR audiovisual benefit for ASR accuracies around 74%. Delaying the presentation of the text reduced the benefit and increased the listening effort. Participants with relatively low unimodal speech comprehension obtained greater benefit from the subtitles than participants with better unimodal speech comprehension. We observed an age-related decline in the working-memory capacity of the listeners with normal hearing. A higher age and a lower working memory capacity were associated with increased effort required to use the subtitles to improve speech comprehension. Conclusions: Participants were able to use partly incorrect and delayed subtitles to increase their comprehension of speech in noise, regardless of age and hearing loss. This supports the further development and evaluation of an assistive listening system that displays automatically recognized speech to aid speech comprehension by listeners with hearing impairment.
影响因子：
1.2
作者：
A. Wingfield
通讯作者：
A. Wingfield