The importance of the lexicon in tagging biological text
The importance of the lexicon in tagging biological text
复制标题
词典在标记生物文本中的重要性
DOI：
10.1017/s1351324905003967
复制
发表时间：
2005
影响因子：
2.5
通讯作者：
W. J. Wilbur
中科院分区：
文献类型：
--
作者：
Lawrence H. Smith;Thomas C. Rindflesch;W. J. Wilbur
词性标记器是计算语言学中一个基本且不可或缺的工具，通常在加工的关键早期阶段使用。虽然在非常一般的领域实现高精确度的标记器是广泛可用的，但当应用于新的专门领域时，这些标记器的表现几乎没有那么好，对于生物学文本尤其如此。我们提出了一种随机标记器，在MEDLINE摘要上取得了97.44%以上的准确率。标记器的一个主要组成部分是它的词典，它列举了MEDLINE中出现频率最高的10000个单词的允许词性。我们提供了证据来证明这一结论，即词典对标记器的准确性与训练语料库一样重要，而且比之前认为的更重要。
A part-of-speech tagger is a fundamental and indispensable tool in computational linguistics, typically employed at the critical early stages of processing. Although taggers are widely available that achieve high accuracy in very general domains, these do not perform nearly as well when applied to novel specialized domains, and this is especially true with biological text. We present a stochastic tagger that achieves over 97.44% accuracy on MEDLINE abstracts. A primary component of the tagger is its lexicon which enumerates the permitted parts-of-speech for the 10000 words most frequently occurring in MEDLINE. We present evidence for the conclusion that the lexicon is as vital to tagger accuracy as a training corpus, and more important than previously thought.