Online Acquisition of Japanese Unknown Morphemes using Morphological Constraints
Online Acquisition of Japanese Unknown Morphemes using Morphological Constraints
复制标题
使用形态约束在线获取日语未知语素
DOI：
10.3115/1613715.1613770
复制
发表时间：
2008
期刊：
影响因子：
--
通讯作者：
S. Kurohashi
中科院分区：
文献类型：
--
作者：
Yugo Murawaki;S. Kurohashi
我们提出了一种新的词汇采集器，它与形态分析器协同工作，并具有在线模式运行的能力。每次分析一个句子时，它都会检测未知的词素，列举候选词，并通过比较存储中的多个示例来选择最佳候选词。当一个语素被明确选择时，词典获取器更新分析器的词典，并将其用于后续的分析。我们使用的限制，日本形态学和有效地减少所需的例子，以获得一个词素。实验结果表明，该方法能够准确地提取出未知词素，提高了词法分析的质量。
We propose a novel lexicon acquirer that works in concert with the morphological analyzer and has the ability to run in online mode. Every time a sentence is analyzed, it detects unknown morphemes, enumerates candidates and selects the best candidates by comparing multiple examples kept in the storage. When a morpheme is unambiguously selected, the lexicon acquirer updates the dictionary of the analyzer, and it will be used in subsequent analysis. We use the constraints of Japanese morphology and effectively reduce the number of examples required to acquire a morpheme. Experiments show that unknown morphemes were acquired with high accuracy and improved the quality of morphological analysis.