Deaf and Hard-of-Hearing Perspectives on Imperfect Automatic Speech Recognition for Captioning One-on-One Meetings
Deaf and Hard-of-Hearing Perspectives on Imperfect Automatic Speech Recognition for Captioning One-on-One Meetings
复制标题
聋人和听力障碍人士对一对一会议字幕的不完美自动语音识别的看法
DOI：
10.1145/3132525.3132541
复制
发表时间：
2017
期刊：
影响因子：
--
通讯作者：
Matt Huenerfauth
中科院分区：
文献类型：
--
作者：
Larwan Berke;Christopher Caulfield;Matt Huenerfauth
自动语音识别 (ASR) 的最新进展使该技术成为聋哑或听力障碍 (DHH) 人士实时转录音频输入的潜在解决方案。然而，ASR 并不完美；用户必须处理输出中的错误。虽然之前的一些研究已经研究了 ASR 生成的转录，以便为 DHH 人员提供字幕，但尚未对如何最好地呈现可能包含 ASR 软件错误的字幕以及如何利用 ASR 系统的单词级置信度进行系统研究。我们对 21 名和 107 名 DHH 参与者进行了两项研究，比较以确定性值直观呈现 ASR 输出的各种方法。参与者回答了主观偏好问题，并提供了有关如何将 ASR 字幕与置信度显示标记结合使用的反馈。用户更喜欢他们已经最熟悉的字幕样式（不显示置信度信息），并且他们担心 ASR 系统的准确性。虽然他们对在字幕中显示单词置信度的系统感兴趣，但他们担心文本外观的变化可能会分散注意力。这项研究的结果对于为 DHH 用户开发自动字幕系统的研究人员和公司应该有用。
Recent advances in Automatic Speech Recognition (ASR) have made this technology a potential solution for transcribing audio input in real-time for people who are Deaf or Hard of Hearing (DHH). However, ASR is imperfect; users must cope with errors in the output. While some prior research has studied ASR-generated transcriptions to provide captions for DHH people, there has not been a systematic study of how to best present captions that may include errors from ASR software nor how to make use of the ASR system's word-level confidence. We conducted two studies, with 21 and 107 DHH participants, to compare various methods of visually presenting the ASR output with certainty values. Participants answered subjective preference questions and provided feedback on how ASR captioning could be used with confidence display markup. Users preferred captioning styles with which they were already most familiar (that did not display confidence information), and they were concerned about the accuracy of ASR systems. While they expressed interest in systems that display word confidence during captions, they were concerned that text appearance changes may be distracting. The findings of this study should be useful for researchers and companies developing automated captioning systems for DHH users.
手语翻译和文本替代品对聋哑学生课堂学习的好处。
影响因子：
2
作者：
Marschark,Marc;Leigh,Greg;Sapere,Patricia;Burnham,Denis;Convertino,Carol;Stinson,Michael;Knoors,Harry;Vervloed,MathijsPJ;Noble,William
通讯作者：
Noble,William