Morpheme-based Derivation of Bipolar Semantic Orientation of Chinese Words
Morpheme-based Derivation of Bipolar Semantic Orientation of Chinese Words
复制标题
DOI：
10.3115/1220355.1220500
复制
发表时间：
2004-08
期刊：
影响因子：
--
通讯作者：
R. Yuen;Terence Y. W. Chan;Tom B. Y. Lai;O. Kwong;Benjamin Ka-Yin T'sou
中科院分区：
文献类型：
--
作者：
R. Yuen;Terence Y. W. Chan;Tom B. Y. Lai;O. Kwong;Benjamin Ka-Yin T'sou
一个词的评价性特征被称为它的语义指向。正SO指示合意性（例如，好，诚实），并且负SO指示不合意性（例如，坏，丑）。基于Turney（2003）的方法，提出了一种从强极化词和词素的统计关联中推断词的SO的方法。注意，词素的数量比单词少得多，并且在修改后的系统中也可以使用少量的基本词素以获得很大的优势。该算法在3400万字的语料库中测试了1,249个词（604个阳性词和645个阴性词），分别使用20个和40个极化词运行，精度高（79.96%至81.05%），但召回率低（45.56%至59.57%）。该算法在同一语料库中使用20个极化词素或单个字符运行，获得了80.23%的高准确率和85.03%的高召回率。我们的结论是，在汉语中的语素，在任何语言中，构成一个独特的子词汇单位，虽然数量很少，有更大的语言意义比词，所看到的显着增强的结果与一个小得多的语料库比Turney所需的。
The evaluative character of a word is called its semantic orientation (SO). A positive SO indicates desirability (e.g. Good, Honest) and a negative SO indicates undesirability (e.g., Bad, Ugly). This paper presents a method, based on Turney (2003), for inferring the SO of a word from its statistical association with strongly-polarized words and morphemes in Chinese. It is noted that morphemes are much less numerous than words, and that also a small number of fundamental morphemes may be used in the modified system to great advantage. The algorithm was tested on 1,249 words (604 positive and 645 negative) in a corpus of 34 million words, and was run with 20 and 40 polarized words respectively, giving a high precision (79.96% to 81.05%), but a low recall (45.56% to 59.57%). The algorithm was then run with 20 polarized morphemes, or single characters, in the same corpus, giving a high precision of 80.23% and a high recall of 85.03%. We concluded that morphemes in Chinese, as in any language, constitute a distinct sub-lexical unit which, though small in number, has greater linguistic significance than words, as seen by the significant enhancement of results with a much smaller corpus than that required by Turney.