Conceptual analysis of parallel corpus collected from the Web
Conceptual analysis of parallel corpus collected from the Web
复制标题
网络平行语料库的概念分析
DOI：
10.1002/asi.20326
复制
发表时间：
2006
期刊：
影响因子：
--
通讯作者：
Christopher C. Yang
中科院分区：
文献类型：
--
作者：
K. W. Li;Christopher C. Yang
如万维网所示，近年来，英语以外的其他语言的信息量显著增长。这就凸显了多语种语料库的重要性。为了实现跨语言信息检索和机器翻译的目的，人们一直致力于多语种语料库的编纂。现有的平行语料库大多涉及欧洲语言，如英语-法语和英语-西班牙语。欧洲语言和亚洲语言之间仍然缺乏平行语料库。在作者的前期工作中，提出了一种一对一的中英文标题对对齐方法，并用于构建一个基于万维网的英汉平行语料库，获得了100%的准确率和87%的召回率。对这些结果的仔细分析有助于作者理解如何改进对齐方法。对对齐和非对齐的英汉标题对进行了概念分析，包括概念对等和概念信息交替分析。分析的结果不仅反映了平行语料库的特点，也揭示了对齐方法的优点和不足。特别是，概念上的改变，例如省略和添加，被发现对对齐方法的性能有显着影响。
As illustrated by the World Wide Web, the volume of information in languages other than English has grown significantly in recent years. This highlights the importance of multilingual corpora. Much effort has been devoted to the compilation of multilingual corpora for the purpose of cross-lingual information retrieval and machine translation. Existing parallel corpora mostly involve European languages, such as English–French and English–Spanish. There is still a lack of parallel corpora between European languages and Asian languages. In the authors' previous work, an alignment method to identify one-to-one Chinese and English title pairs was developed to construct an English–Chinese parallel corpus that works automatically from the World Wide Web, and a 100% precision and 87% recall were obtained. Careful analysis of these results has helped the authors to understand how the alignment method can be improved. A conceptual analysis was conducted, which includes the analysis of conceptual equivalent and conceptual information alternation in the aligned and nonaligned English–Chinese title pairs that are obtained by the alignment method. The result of the analysis not only reflects the characteristics of parallel corpora, but also gives insight into the strengths and weaknesses of the alignment method. In particular, conceptual alternation, such as omission and addition, is found to have a significant impact on the performance of the alignment method.