Char_align: A Program for Aligning Parallel Texts at the Character Level

Char_align: A Program for Aligning Parallel Texts at the Character Level
复制标题

Char_align:在字符级别对齐并行文本的程序

DOI:
10.3115/981574.981575
复制
发表时间:
1993
期刊:
--
影响因子:
--
通讯作者:
Kenneth Ward Church
Kenneth Ward Church
中科院分区:
--
文献类型:
--
作者:
Kenneth Ward Church

文献摘要

被引文献

相似文献

最近有许多关于在句子层面对齐平行文本的论文,例如,Brown et al (1991), Gale and Church (to appear), Isabelle (1992), Kay and Rosenschein (to appear), Simard et al (1992), Warwick-Armstrong and Russell(1990)。对于干净的输入,如加拿大的汉萨,这些方法非常成功(至少96%的句子正确率)。不幸的是,如果输入有噪声(由于OCR和/或未知的标记约定),那么这些方法往往会失效,因为噪声会使查找段落边界变得困难,更不用说查找句子了。本文描述了一个新的程序char_align,它基于Simard等人提出的同源方法,在字符级别而不是句子/段落级别对齐文本。
There have been a number of recent papers on aligning parallel texts at the sentence level, e.g., Brown et al (1991), Gale and Church (to appear), Isabelle (1992), Kay and Rosenschein (to appear), Simard et al (1992), Warwick-Armstrong and Russell (1990). On clean inputs, such as the Canadian Hansards, these methods have been very successful (at least 96% correct by sentence). Unfortunately, if the input is noisy (due to OCR and/or unknown markup conventions), then these methods tend to break down because the noise can make it difficult to find paragraph boundaries, let alone sentences. This paper describes a new program, char_align, that aligns texts at the character level rather than at the sentence/paragraph level, based on the cognate approach proposed by Simard et al.