A Summary of the COLIEE 2019 Competition
A Summary of the COLIEE 2019 Competition
复制标题
DOI：
10.1007/978-3-030-58790-1_3
复制
发表时间：
2019
期刊：
影响因子：
--
通讯作者：
J. Rabelo;Mi-Young Kim;R. Goebel;Masaharu Yoshioka;Yoshinobu Kano;K. Satoh
中科院分区：
文献类型：
--
作者：
J. Rabelo;Mi-Young Kim;R. Goebel;Masaharu Yoshioka;Yoshinobu Kano;K. Satoh
我们对第六届法律信息提取/蕴涵大赛（COLIEE 2019）的评估进行了总结。竞赛包括四项任务：两项关于判例法，两项关于成文法。判例法部分包括信息检索任务（任务1）以及现有案例和未见过案例之间的蕴含关系的确认（任务2）。成文法部分还包括信息检索任务（任务 3）和蕴含/问答任务（任务 4），该任务试图确认特定法规是否适用于是/否问题。世界上任何团体、任何方式都可以参与。十一个不同的团队参加了判例法竞赛任务，其中一些团队参与了不止一项任务。我们收到了来自 7 个团队的任务 1（15 次运行）和 7 个团队的任务 2（18 次运行）的结果。对于成文法任务，有 8 个不同的团队参与，有些团队参与了不止一项任务。 7 个团队为任务 3 提交了总共 13 次运行，7 个团队为任务 4 提交了总共 15 次运行。这里我们总结了每个团队的方法、我们的官方评估以及对产生评估结果的各种方法的一些分析。
We summarize the evaluation of the 6th Competition on Legal Information Extraction/Entailment (COLIEE 2019). The competition consists of four tasks: two on case law and two on statute law. The case law component includes an information retrieval task (Task 1), and the confirmation of an entailment relation between an existing case and an unseen case (Task 2). The statute law component also includes an information retrieval task (Task 3) and an entailment/question answering task (Task 4), which attempts to confirm whether a particular statute applies to a yes/no question. Participation was open to any group in the world, based on any approach. Eleven different teams participated in the case law competition tasks, some of them in more than one task. We received results from 7 teams for Task 1 (15 runs) and 7 teams for Task 2 (18 runs). For the statute law tasks, 8 different teams participated, some in more than one task. Seven teams submitted a total of 13 runs for Task 3, and 7 teams submitted a total of 15 runs for Task 4. Here we summarize each team’s approaches, our official evaluation, and some analysis of the variety of methods that produced the evaluation results.