Collaborative Research: A Framework for Encoding American Sign Language and Other Structured Video

合作研究：美国手语和其他结构化视频编码框架

• 批准号: 0514353
• 负责人: Eve Riskin
• 金额: --
• 依托单位: University of Washington
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2005
• 资助国家: 美国
• 起止时间: 2005-08-01 至 2009-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0514353&HistoricalAwards=false
• 关键词: Collaborative; Research; Framework; Encoding; American

Video-enabled cell phones have the potential to enable deaf Americans to speak in their community's native language, American Sign Language (ASL), and gain the freedom, flexibility, and comfort of the wireless phone revolution. This research involves the design, implementation, and evaluation of new standards-compliant data compression methods that will allow ASL video, and other structured video, to be transmitted over low bandwidth cell phone channels. To be more specific, the goal of this research is to develop a framework in which to implement low-complexity H.264 encoding to provide maximum quality compressed structured video. Because the developed algorithms will be H.264 standard-compliant, an off-the-shelf H.264 decoder can be used.The research applies to any class of videos where there is some inherent structure that can be exploited. The five areas of research are: (1) Design of an appropriate objective distortion metric for ASL; (2) Design of algorithms to preprocess video for display on small devices; (3) Development of methods to exploit structure in video for efficient coding; (4) Implementation of a rate-distortion-complexity optimization of H.264 using the new metric; and (5) Applications of the framework to other structured video such as surveillance video. Studies with ASL users are used to develop the objective intelligibility metric and to evaluate the new compression techniques.

具有视频功能的手机有可能使美国聋哑人用他们社区的母语——美国手语（ASL）说话，并获得无线电话革命带来的自由、灵活和舒适。本研究涉及新的符合标准的数据压缩方法的设计、实现和评估，这些方法将允许在低带宽手机信道上传输ASL视频和其他结构化视频。更具体地说，本研究的目标是开发一个框架，在该框架中实现低复杂度的H.264编码，以提供最高质量的压缩结构化视频。由于开发的算法将符合H.264标准，因此可以使用现成的H.264解码器。这项研究适用于任何类型的视频，只要这些视频有一些可以利用的内在结构。五个研究领域是：(1)设计合适的美国手语客观失真度量；(2)设计用于在小型设备上显示的视频预处理算法；(3)开发利用视频结构进行高效编码的方法；(4)利用新度量实现H.264的率失真复杂度优化；(5)该框架在其他结构化视频（如监控视频）中的应用。通过对美国手语使用者的研究，建立了客观的可理解度度量标准，并对新的压缩技术进行了评估。