ERD'14
ERD'14
复制标题
ERD14
DOI：
10.1145/2701583.2701591
复制
发表时间：
2014
期刊：
影响因子：
--
通讯作者：
Kuansan Wang
中科院分区：
文献类型：
--
作者：
David Carmel;Ming;E. Gabrilovich;B. Hsu;Kuansan Wang
在本文中，我们概述了2014年实体识别和消歧挑战赛（ERD'14），该挑战赛于2014年3月至6月举行，并在SIGIR 2014的专门研讨会上进行了总结。ERD挑战的主要目标是促进非结构化文本中实体的识别和消歧研究。与许多过去的实体链接挑战不同，对于给定的文档，没有提到参与系统的分段。参与者被要求为他们的系统实现一个Web服务，以最大限度地减少评估过程中的人为参与，并能够测量处理时间。这项挑战吸引了很多人的兴趣（100多个团队注册，其中27个团队提交了最终结果）。在本文中，我们涵盖了任务定义，注释过程中遇到的问题，并提供了所有参与系统的详细分析。具体来说，我们将展示我们如何适应池技术，以解决收集实体链接任务的注释的困难。我们还总结了ERD研讨会之后的挑战，包括口头和海报介绍，以及邀请会谈。
In this paper we overview the 2014 Entity Recognition and Disambiguation Challenge (ERD'14), which took place from March to June 2014 and was summarized in a dedicated workshop at SIGIR 2014. The main goal of the ERD challenge was to promote research in recognition and disambiguation of entities in unstructured text. Unlike many past entity linking challenges, no mention segmentations were given to the participating systems for a given document. Participants were asked to implement a web service for their system to minimize human involvement during evaluation and to enable measuring the processing times. The challenge has attracted a lot of interest (over 100 teams registered, and 27 of those submitted final results). In this paper we cover the task definition, issues encountered during annotation, and provide a detailed analysis of all the participating systems. Specifically, we show how we adapted the pooling technique to address the difficulties of gathering annotations for the entity linking task. We also summarize the ERD workshop that followed the challenge, including the oral and poster presentations as well as the invited talks.