Collaborative Research:Interlingual Annotation of Multilingual Text Corporation

这项多站点的研究工作旨在开发一种连贯、一致、标准化的语际表示，以及一种方法和可共享的工具，用于注释大型双语平行文本语料库。它有四个核心组成部分：首先，正在编制六个语料库，每个语料库由一种特定源语言的若干文本组成，并将每个文本翻译成英语。其次，基于对这些平行文本语料库的比较分析，正在开发标准化的语际表示。第三，使用标准化的中间语并按照预定义的注释程序对双语语料库进行注释。第四，根据给定特定任务的表示的粒度大小，正在开发用于评估语际表示的准确性和适当性的指标。这些度量是基于编码间的可靠性、语间表示的增长率以及从语间生成的目标语言文本的质量。由此产生的带注释的、多语言的、平行的语料库将作为开发各种语言间NLP系统的经验基础，用于机器翻译、问答、网络搜索、摘要或演示生成等任务，以及理论和应用语言学、外语教育学、翻译研究和其他相关学科的许多其他研究和开发工作。参与者包括NMSU的CRL、USC的ISI、马里兰大学的UMIACS、CMU的LTI、哥伦比亚大学和MITRE公司。源语言包括阿拉伯语、汉语、法语、印地语、日语、西班牙语和英语。

This multi-site research effort is aimed at developing a coherent, consistent, standardized Interlingual representation along with a methodology and sharable tools for annotating large bilingual corpora of parallel texts. It has four central components: First, six corpora are being compiled, each consisting of a number of texts in a particular source language along with three translations of each text into English. Second, a standardized interlingual representation is being developed based on a comparative analysis of these parallel text corpora. Third, the bilingual corpora are being annotated using the standardized interlingua and following a predefined annotation procedure. Fourth, metrics are being developed for evaluating the accuracy and appropriateness of the interlingual representations in terms of the grain size of the representation given a particular task. The metrics are based on inter-coder reliability, the growth rate of the interlingual representation, and quality of the target language text that is be generated from the interlingua. The resulting annotated, multilingual, parallel corpora will be useful as an empirical basis for developing a wide variety of interlingual NLP systems for tasks such as machine translation, question answering, web searching, summarization, or presentation generation, as well as a host of other research and development efforts in theoretical and applied linguistics, foreign language pedagogy, translation studies, and other related disciplines. The participants include CRL at NMSU, ISI at USC, UMIACS at the University of Maryland, LTI at CMU, Columbia University, and The MITRE Corporation. The source languages include Arabic, Chinese, French, Hindi, Japanese, Spanish and English.