Collaborative: II-EN: Development of Publicly Available, Easily Searchable, Linguistically Analyzed, Video Corpora for Sign Language and Gesture Research

协作：II-EN：开发公开可用、易于搜索、语言分析的视频语料库，用于手语和手势研究

• 批准号: 0958286
• 负责人: Vassilis Athitsos
• 金额: $ 1万
• 依托单位: University of Texas at Arlington
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2010
• 资助国家: 美国
• 起止时间: 2010-04-01 至 2011-03-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0958286&HistoricalAwards=false
• 关键词: Collaborative; II; EN; Development; Publicly

American Sign Language (ASL) is used by as many as two million people in the United States, with additional users elsewhere in North America. The purpose of this "planning grant" is to enable the PI and her multi-institutional team to explore the case for a possible future NSF investment in an annotated, publicly available, and easily searchable corpus consisting of terabytes of ASL video data (deriving in part from prior work by the PI and her colleagues), including diverse types of content such as dialogues, narratives, elicited sentences illustrating specific grammatical constructions, and isolated signs. The PI contends such a resource would constitute an important infrastructure that would be exploited by a broad research community to advance the fields of linguistics (the structure of ASL), computer vision (machine recognition of gestures), indexing of visual information (through the expansion of mark up vocabularies), and education. The PI notes that the potential value of the existing corpora remains largely untapped, notwithstanding their extensive and productive use by her team and others, due to hardware and software limitations that make it cumbersome to search, identify, and share data of interest. Broader Impacts: The new resource would be easily accessible by the research community and the broader public, via a user-friendly Web-based interface. Availability of the resource online would allow ASL teachers and users, and others, to access the data directly. Users would be able to look up an unknown sign by submitting a video example of that sign. Students of ASL would be able to retrieve video showing examples of a specific sign used in actual sentences, or examples of a grammatical construction. ASL instructors and teachers of the Deaf would have easy access to video examples of lexical items and grammatical constructions as used by a variety of native signers, for use in language instruction and evaluation.

美国手语 (ASL) 在美国有多达 200 万人使用，北美其他地区也有更多用户。 这笔“规划拨款”的目的是使 PI 和她的多机构团队能够探索 NSF 未来可能投资的案例，即一个带注释、公开可用且易于搜索的语料库，该语料库由 TB 级的 ASL 视频数据（部分源自 PI 和她的同事之前的工作）组成，包括不同类型的内容，例如对话、叙述、说明特定语法结构的引出句子，以及 孤立的迹象。 PI 认为，这样的资源将构成一个重要的基础设施，广泛的研究界将利用它来推进语言学（美国手语的结构）、计算机视觉（手势的机器识别）、视觉信息索引（通过扩展标记词汇表）和教育领域的发展。 PI 指出，尽管她的团队和其他人广泛且富有成效地使用了现有语料库，但由于硬件和软件的限制，搜索、识别和共享感兴趣的数据变得很麻烦，现有语料库的潜在价值在很大程度上尚未开发。 更广泛的影响：研究界和更广泛的公众可以通过用户友好的基于网络的界面轻松访问新资源。 在线资源的可用性将允许 ASL 教师和用户以及其他人直接访问数据。 用户可以通过提交未知标志的视频示例来查找该标志。 ASL 的学生将能够检索显示实际句子中使用的特定符号示例或语法结构示例的视频。 ASL 教师和聋人教师可以轻松访问各种母语手语者使用的词汇项目和语法结构的视频示例，用于语言教学和评估。