Collaborative Research: CRI: CRD: A Multi-Representational and Multi-Layered Treebank for Hindi/Urdu

合作研究：CRI：CRD：印地语/乌尔都语的多表征和多层树库

• 批准号: 0751213
• 负责人: Fei Xia
• 金额: $ 19.6万
• 依托单位: University of Washington
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2008
• 资助国家: 美国
• 起止时间: 2008-05-01 至 2014-04-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0751213&HistoricalAwards=false
• 关键词: Collaborative; Research; CRI; CRD; Multi

Treebanks are corpora of naturally occurring text that have been annotated with morphological and syntactic (structural) information. In the last 15 years they have led to significant advances in natural language processing (NLP) results by providing training data for supervised machine learning algorithms. These algorithms can now automatically perform useful part-of-speech tagging, parsing and semantic interpretation. This project is creating a new-generation, multi-representational Treebank. The languages being annotated are Hindi (400K words) and Urdu (200K words). The texts are being annotated in dependency structure (trees in which all nodes are labeled with words of the sentence), enriched with additional semantic role labels. The dependency representation is also being automatically mapped to a phrase-structure representation (in which the words are at the leaves of the tree and internal nodes are labeled with phrase markers). After applying standard quality-control both versions will be released to the public, providing an immediate boost to the performance of Hindi/Urdu NLP. A tool will also be released that will allow a researcher to produce alternative formatting of the phrase structure representation. This supports a view of the treebank as a more general, abstract representation of the morphology and syntax of the language rather than merely as data for a particular style of machine learning experiment. Research into parsing and other NLP tasks has recently recognized the benefits of reformatting syntactic representations in order to improve the machine learning process; this treebank will make that step much easier for all NLP researchers interested in Hindi or Urdu in particular and in language in general.

树库是自然发生的文本的语料库，已用形态和句法（结构）信息进行注释。 在过去 15 年中，他们通过为监督机器学习算法提供训练数据，在自然语言处理 (NLP) 结果方面取得了重大进展。 这些算法现在可以自动执行有用的词性标记、解析和语义解释。 该项目正在创建一个新一代的、具有多重代表性的树库。 被注释的语言是印地语（400K 单词）和乌尔都语（200K 单词）。 文本以依赖结构（其中所有节点都用句子的单词标记的树）进行注释，并通过附加语义角色标签进行丰富。 依存关系表示也被自动映射到短语结构表示（其中单词位于树的叶子，内部节点用短语标记进行标记）。 在应用标准质量控制后，这两个版本都将向公众发布，从而立即提升印地语/乌尔都语 NLP 的性能。 还将发布一个工具，允许研究人员生成短语结构表示的替代格式。 这支持了树库作为语言形态和语法的更一般、抽象的表示的观点，而不仅仅是作为特定类型的机器学习实验的数据。 最近，对解析和其他 NLP 任务的研究已经认识到重新格式化句法表示以改进机器学习过程的好处；对于所有对印地语或乌尔都语以及一般语言感兴趣的 NLP 研究人员来说，这个树库将使这一步变得更加容易。