Finnish resources for evaluating language model semantics
Finnish resources for evaluating language model semantics
复制标题
用于评估语言模型语义的芬兰资源
DOI：
--
复制
发表时间：
2017
期刊：
影响因子：
--
通讯作者：
J. Vankka
中科院分区：
文献类型：
--
作者：
Viljami Venekoski;J. Vankka
分布式语言模型一直被证明可以捕获单词的语义属性。然而，用于评估建模语义的准确性的方法的研究一直是有限的，特别是对于资源较少的语言。本研究提出了三个资源来评估芬兰语言分布模型的语义质量：（1）语义相似性判断资源，以及（2）单词类比和（3）单词入侵测试集。评价资源的使用在实践中表现为从不同的语料库建立不同的语言模型。
Distributional language models have consistently been demonstrated to capture semantic properties of words. However, research into the methods for evaluating the accuracy of the modeled semantics has been limited, particularly for less-resourced languages. This research presents three resources for evaluating the semantic quality of Finnish language distributional models: (1) semantic similarity judgment resource, as well as (2) a word analogy and (3) a word intrusion test set. The use of evaluation resources is demonstrated in practice by presenting them with different language models built from varied corpora.