ITR: Collaborative Research: Interlingual Annotation of Multilingual Text Corporation

这项多地点的研究工作旨在开发一个连贯、一致、标准化的语际表征，以及一种方法和可共享的工具，用于标注大型双语平行文本语料库。它有四个主要组成部分：第一，正在汇编六个语料库，每个语料库由一种特定来源语文的若干文本以及每个文本的三个英文译文组成。其次，基于对这些平行文本语料库的比较分析，正在开发标准化的语际表示法。第三，双语语料库正在使用标准化的中间语言进行注释，并遵循预定义的注释程序。第四，正在制定衡量标准，根据特定任务的表征粒度来评估语际表征的准确性和适当性。这些衡量标准是基于编码者间的可靠性、语际表征的增长率以及从中间语言生成的目标语言文本的质量。生成的带注释的多语言平行语料库将有助于开发各种语际自然语言处理系统，用于机器翻译、问题回答、网络搜索、摘要或演示文稿生成等任务，以及理论和应用语言学、外语教育学、翻译学和其他相关学科的其他研究和开发工作。参与者包括NMSU的CRL、南加州大学的ISI、马里兰大学的UMIACS、CMU的LTI、哥伦比亚大学和MITRE公司。源语言包括阿拉伯语、汉语、法语、印地语、日语、西班牙语和英语。

This multi-site research effort is aimed at developing a coherent, consistent, standardized Interlingual representation along with a methodology and sharable tools for annotating large bilingual corpora of parallel texts. It has four central components: First, six corpora are being compiled, each consisting of a number of texts in a particular source language along with three translations of each text into English. Second, a standardized interlingual representation is being developed based on a comparative analysis of these parallel text corpora. Third, the bilingual corpora are being annotated using the standardized interlingua and following a predefined annotation procedure. Fourth, metrics are being developed for evaluating the accuracy and appropriateness of the interlingual representations in terms of the grain size of the representation given a particular task. The metrics are based on inter-coder reliability, the growth rate of the interlingual representation, and quality of the target language text that is be generated from the interlingua. The resulting annotated, multilingual, parallel corpora will be useful as an empirical basis for developing a wide variety of interlingual NLP systems for tasks such as machine translation, question answering, web searching, summarization, or presentation generation, as well as a host of other research and development efforts in theoretical and applied linguistics, foreign language pedagogy, translation studies, and other related disciplines. The participants include CRL at NMSU, ISI at USC, UMIACS at the University of Maryland, LTI at CMU, Columbia University, and The MITRE Corporation. The source languages include Arabic, Chinese, French, Hindi, Japanese, Spanish and English.