Collaborative Research: CRI: CRD: A Multi-Representational and Multi-Layered Treebank for Hindi/Urdu

树库是自然发生的文本的语料库，已经用形态和句法（结构）信息进行了注释。 在过去的15年里，他们通过为监督机器学习算法提供训练数据，在自然语言处理（NLP）结果方面取得了重大进展。 这些算法现在可以自动执行有用的词性标注、解析和语义解释。 这个项目正在创建一个新一代的多代表性树库。 被注释的语言是印地语（40万字）和乌尔都语（20万字）。 文本在依赖结构（树，其中所有节点都标记有句子的单词）中进行注释，并使用额外的语义角色标签进行丰富。 依赖关系表示也被自动映射到短语结构表示（其中单词位于树的叶子上，内部节点用短语标记标记）。 在应用标准质量控制后，两个版本将向公众发布，立即提升印地语/乌尔都语NLP的性能。 还将发布一个工具，允许研究人员生成短语结构表示的替代格式。 这支持了树库作为语言的形态和语法的更一般、抽象的表示的观点，而不仅仅是作为特定风格的机器学习实验的数据。 对解析和其他NLP任务的研究最近已经认识到重新格式化句法表示以改进机器学习过程的好处;这个树库将使所有对印地语或乌尔都语感兴趣的NLP研究人员更容易完成这一步。 OISE正在与印度海得拉巴的IIIT共同资助科罗拉多大学的学生交换，在那里，40万个印地语单词和20万个乌尔都语单词将使用依赖关系解析进行注释。 这将为美国学生提供国际研究经验。

Treebanks are corpora of naturally occurring text that have been annotated with morphological and syntactic (structural) information. In the last 15 years they have led to significant advances in natural language processing (NLP) results by providing training data for supervised machine learning algorithms. These algorithms can now automatically perform useful part-of-speech tagging, parsing and semantic interpretation. This project is creating a new-generation, multi-representational Treebank. The languages being annotated are Hindi (400K words) and Urdu (200K words). The texts are being annotated in dependency structure (trees in which all nodes are labeled with words of the sentence), enriched with additional semantic role labels. The dependency representation is also being automatically mapped to a phrase-structure representation (in which the words are at the leaves of the tree and internal nodes are labeled with phrase markers). After applying standard quality-control both versions will be released to the public, providing an immediate boost to the performance of Hindi/Urdu NLP. A tool will also be released that will allow a researcher to produce alternative formatting of the phrase structure representation. This supports a view of the treebank as a more general, abstract representation of the morphology and syntax of the language rather than merely as data for a particular style of machine learning experiment. Research into parsing and other NLP tasks has recently recognized the benefits of reformatting syntactic representations in order to improve the machine learning process; this treebank will make that step much easier for all NLP researchers interested in Hindi or Urdu in particular and in language in general. OISE is co-funding the University of Colorado student exchange with the IIIT in Hyderabad, India where 400K words of Hindi and 200K words of Urdu will be annotated with dependency parses. This will enable an international research experience for U.S.students.