An integrated RGB-D system for looking up the meaning of signs
An integrated RGB-D system for looking up the meaning of signs
复制标题
用于查找标志含义的集成 RGB-D 系统
DOI：
10.1145/2769493.2769534
复制
发表时间：
2015
期刊：
影响因子：
--
通讯作者：
V. Athitsos
中科院分区：
文献类型：
--
作者：
C. Conly;Zhong Zhang;V. Athitsos
使用书面语言的人能够快速方便地查找未知单词的意思。然而，那些使用手语的人缺乏这种优势，并且找到未知手势的含义可能是一项挑战。虽然确实存在一些符号到文字的语言词典，但它们使用起来既笨重又缓慢。我们提出了一个改进的美国手语视频词典系统，该系统允许用户在传感器前执行一个未知的手势，并快速检索相似手势的排名列表，并提供每个手势的视频示例。该系统的早期版本需要使用一个单独的软件来记录查询标志，以及用户干预，在标志的第一帧中为手和脸提供边界框。这里介绍的系统将所有功能集成到一个软件中，并使用RGB-D传感器自动进行头部和手部检测，消除了以前系统的一些缺点，同时提高了匹配精度并缩短了执行查询所需的时间。
Users of written languages have the ability to quickly and easily look up the meaning of an unknown word. Those who use sign languages, however, lack this advantage, and it can be a challenge to find the meaning of an unknown sign. While some sign-to-written language dictionaries do exist, they are cumbersome and slow to use. We present an improved American Sign Language video dictionary system that allows a user to perform an unknown sign in front of a sensor and quickly retrieve a ranked list of similar signs with a video example of each. Earlier variants of the system required the use of a separate piece of software to record the query sign, as well as user intervention to provide bounding boxes for the hands and face in the first frame of the sign. The system presented here integrates all functionality into one piece of software and automates head and hand detection with the use of an RGB-D sensor, eliminating some of the shortcomings of the previous system, while improving match accuracy and shortening the time required to perform a query.