课题基金 / 基金详情

ITR: Fundamental Issues in Automated American Sign Language Recognition

ITR: Fundamental Issues in Automated American Sign Language Recognition
ITR:美国手语自动识别的基本问题
批准号:
0312993
负责人:
Sudeep Sarkar
金额:
$37.98万
依托单位:
依托单位国家:
美国
项目类别:
Continuing Grant
财政年份:
2003
资助国家:
美国
项目状态:
已结题
起止时间:
2003-07-15 至 2007-06-30

项目摘要

项目成果

Sudeep Sarkar的其他基金

相似基金

相关文献

中文摘要
翻译
手语是复杂的、抽象的语言系统,有它们自己的语法,它们的“发音”不仅涉及手,还涉及脸、肩膀和手臂。在这个项目中,PI和他的团队将推动可扩展的自动化美国手语(ASL)识别形式化的最先进水平。目前,已经有一些方法可以识别单个签名者的孤立符号,在某种程度上,也可以识别短句子中的连续符号,主要使用特殊设备,如数据手套或磁性记号笔,或者在普通背景和特殊服装的背景下通过视觉输入来识别。PI力求在五个领域取得实质性进展:(1)针对不同背景和不同服装的识别;(2)面部表情和头部运动等非人工方面的使用;(3)签名者之间的识别;(4)设计健壮、可扩展的形式;以及(5)开发大型高级语料库,使用各种不同的观点、背景、时间和签名者,以帮助确定进展的基准。为此,PI将(I)为ASL开发健壮的手动和非手动(人脸)特征集,(Ii)构建从例句学习手势模型的形式,(Iii)调查是否可以学习手势(手势)的基本形式,(Iv)使用基于贝叶斯网络的索引方案来限制识别的组合,以及(V)探索将语法和句法信息合并到识别过程中的技术。除非在手语自动识别方面取得重大进展,否则依赖手语进行交流的人将被剥夺接触最先进技术的机会,这是非常危险的。这些进展还将通过促进在机场和杂货店等公共场合与普通民众的互动,提高残疾人的生活质量。PI将确定至少一名聋人研究生或一名有沟通障碍的学生参与该项目,以确保结果与目标用户社区相关和适当。在这个项目中收集的大型ASL数据语料库将被积极地分发;这一努力将在项目结束日期后继续得到支持。
英文摘要
Sign languages are complex, abstract linguistic systems, with their own grammars, and their "articulation" involve not just the hands, but the face, shoulder, and arms. In this project the PI and his team will push the state of the art in scalable automated American Sign Language (ASL) recognition formalisms. Presently, there are methods to recognize isolated signs and, to some extent, continuous signs in short sentences from a single signer, mostly using special equipment such as data gloves or magnetic markers or from visual input against plain background and special clothing. The PI seeks to achieve substantial advances in five areas:: (i) recognition against varied backgrounds and different clothing, (ii) use of non-manual aspects such as facial expression and head movement, (iii) recognition across signers, (iv) design of robust, scalable formalisms, and (v) development of large ASL data corpus that exercise variates such as viewpoint, background, time, and signer, to help benchmark progress. To these ends, the PI will (i) develop robust manual and non-manual (face) feature sets for ASL, (ii) construct formalisms to learn sign models from example sentences, (iii) investigate if elemental forms of signs (signemes) can be learned, (iv) employ Bayesian network based indexing schemes to limit the combinatorics of recognition, and (v) explore techniques to incorporate grammar and syntax information into the recognition process.Broader Impacts: With the gradual shift to speech based I/O devices for human computer interaction, there is great danger that people who rely on sign languages for communication will be deprived access to state of the art technology unless there significant advances in automated recognition of sign language are achieved. Such advances will also enhance the quality of life of persons with disabilities, by facilitating interaction with the general populace in public situations, such as airports and grocery stores. The PI will identify at least one deaf graduate student or a student with communication disorder to participate in the project, to ensure the outcome is relevant and appropriate to the intended user community. The large ASL data corpus collected in this project will be distributed aggressively; this effort will continue to be supported beyond the project end date.
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
Collaborative Research: RI:Medium:Understanding Events from Streaming Video - Joint Deep and Graph Representations, Commonsense Priors, and Predictive Learning
  • 批准号:
    1956050
  • 项目类别:
    Continuing Grant
  • 资助金额:
    $42.12万
  • 财政年份:
    2020
  • 负责人:
    Sudeep Sarkar
  • 依托单位:
I-Corps Sites: Type II - I-Corps Site at University of South Florida Tampa
  • 批准号:
    1829217
  • 项目类别:
    Continuing Grant
  • 资助金额:
    $16.0万
  • 财政年份:
    2018
  • 负责人:
    Sudeep Sarkar
  • 依托单位:
I-Corps: Semantic Video - from Video to Descriptions
  • 批准号:
    1647887
  • 项目类别:
    Standard Grant
  • 资助金额:
    $5.0万
  • 财政年份:
    2016
  • 负责人:
    Sudeep Sarkar
  • 依托单位:
I-Corps Sites: University of South Florida: Catalyzing Research Translation
  • 批准号:
    1449137
  • 项目类别:
    Continuing Grant
  • 资助金额:
    $29.97万
  • 财政年份:
    2015
  • 负责人:
    Sudeep Sarkar
  • 依托单位:
海外基金