Thematic fit evaluation: an aspect of selectional preferences
Thematic fit evaluation: an aspect of selectional preferences
复制标题
主题契合度评估：选择偏好的一个方面
DOI：
--
复制
发表时间：
2016
期刊：
影响因子：
--
通讯作者：
Vera Demberg
中科院分区：
文献类型：
--
作者：
A. Sayeed;Clayton Greenberg;Vera Demberg
在本文中，我们讨论了人类的主题适合判断相关任务的背景下，实值向量空间词表示。主位匹配是指一个论元在多大程度上满足了某个动词的选择偏好：例如，“cake”在多大程度上满足了“cut”的受事角色。在最近的工作中，系统已经通过发现它们的输出判断与人类收集的判断数据的相关性来评估这一任务。这个任务是一个representationindependent的方式来评估模型，可以应用于任何时候都可以生成一个系统的分数，它是适用于任何地方的谓词参数关系是显着的性能在最终用户的任务。这一认知建模任务已经取得了重大进展，为未来更全面的评估类型留下了相当大的空间。
In this paper, we discuss the human thematic fit judgement correlation task in the context of real-valued vector space word representations. Thematic fit is the extent to which an argument fulfils the selectional preference of a verb given a role: for example, how well “cake” fulfils the patient role of “cut”. In recent work, systems have been evaluated on this task by finding the correlations of their output judgements with human-collected judgement data. This task is a representationindependent way of evaluating models that can be applied whenever a system score can be generated, and it is applicable wherever predicate-argument relations are significant to performance in end-user tasks. Significant progress has been made on this cognitive modeling task, leaving considerable space for future, more comprehensive types of evaluation.