Design and Evaluation of Hybrid Search for American Sign Language to English Dictionaries: Making the Most of Imperfect Sign Recognition
Design and Evaluation of Hybrid Search for American Sign Language to English Dictionaries: Making the Most of Imperfect Sign Recognition
复制标题
DOI：
10.1145/3491102.3501986
复制
发表时间：
2022-04
期刊：
影响因子：
--
通讯作者：
Saad Hassan;Akhter Al Amin;Alexis Gordon;Sooyeon Lee;Matt Huenerfauth
中科院分区：
文献类型：
--
作者：
Saad Hassan;Akhter Al Amin;Alexis Gordon;Sooyeon Lee;Matt Huenerfauth
对于学习者来说，在字典中搜索一个不熟悉的手语单词的含义是困难的，但是新兴的手语识别技术很快将使用户能够通过提交他们自己表演他们回忆起的单词的视频来搜索。然而，标志识别技术是不完善的，用户可能需要通过一个长长的列表中的可能的结果时，寻求所需的结果进行搜索。为了加快这种搜索，我们提出了一种混合搜索方法，在这种方法中，用户开始基于视频的查询，然后通过语言属性过滤搜索结果，例如，手形我们采访了32名美国手语学习者，了解他们对搜索结果页面的内容和外观以及过滤标准的偏好。20个美国手语学习者之间的主题实验表明，我们的混合搜索系统优于基于视频的搜索系统沿着多个满意度和性能指标。我们的研究结果为基于视频的手语词典搜索系统的设计者提供了指导，并对其他搜索场景产生了影响。
Searching for the meaning of an unfamiliar sign-language word in a dictionary is difficult for learners, but emerging sign-recognition technology will soon enable users to search by submitting a video of themselves performing the word they recall. However, sign-recognition technology is imperfect, and users may need to search through a long list of possible results when seeking a desired result. To speed this search, we present a hybrid-search approach, in which users begin with a video-based query and then filter the search results by linguistic properties, e.g., handshape. We interviewed 32 ASL learners about their preferences for the content and appearance of the search-results page and filtering criteria. A between-subjects experiment with 20 ASL learners revealed that our hybrid search system outperformed a video-based search system along multiple satisfaction and performance metrics. Our findings provide guidance for designers of video-based sign-language dictionary search systems, with implications for other search scenarios.