Relational evaluation schemes
Relational evaluation schemes
复制标题
关系评估方案
DOI：
--
复制
发表时间：
2002
期刊：
影响因子：
--
通讯作者：
Ann A. Copestake
中科院分区：
文献类型：
--
作者：
Ted Briscoe;John A. Carroll;Jonathan Graham;Ann A. Copestake
我们描述了基于棘手的词汇头之间指定的语法关系评估分析选择精度的方案的扩展。该方案旨在直接反映恢复语法和逻辑关系的任务，而不是树拓扑的更任意细节。有500个句子的手动注释测试套件已被几个小组使用来进行评估。我们正在开发软件，以自动从现有的树库自动创建更大的测试套件。我们正在考虑替代关系注释，这些注释在语法和逻辑关系之间提出了更清晰的区别，以克服当前建议的局限性。
We describe extensions to a scheme for evaluating parse selection accuracy based on named grammatical relations between lemmatised lexical heads. The scheme is intended to directly reflect the task of recovering grammatical and logical relations, rather than more arbitrary details of tree topology. There is a manually annotated test suite of 500 sentences which has been used by several groups to perform evaluations. We are developing software to create larger test suites automatically from existing treebanks. We are considering alternative relational annotations which draw a clearer distinction between grammatical and logical relations in order to overcome limitations of the current proposal.