Overview and Discussion of the Competition on Legal Information Extraction/Entailment (COLIEE) 2021
Overview and Discussion of the Competition on Legal Information Extraction/Entailment (COLIEE) 2021
复制标题
DOI：
10.1007/s12626-022-00105-z
复制
发表时间：
2022-02
期刊：
影响因子：
--
通讯作者：
J. Rabelo;R. Goebel;Mi-Young Kim;Yoshinobu Kano;Masaharu Yoshioka;Ken Satoh
中科院分区：
文献类型：
--
作者：
J. Rabelo;R. Goebel;Mi-Young Kim;Yoshinobu Kano;Masaharu Yoshioka;Ken Satoh
我们对第八届法律信息提取与蕴涵大赛进行了总结。在这一届比赛中，竞赛包括关于判例法和成文法的五项任务。判例法部分包括信息检索任务（任务1），以及现有案件和未见过案件之间的蕴含关系的确认（任务2）。成文法部分包括信息检索任务（任务3）、基于检索到的民法典法规的蕴涵/问答任务（任务4）和没有检索到的民法典法规的蕴涵/问答任务（任务5）。任何团体都可以以任何方式参与。八个不同的团队参加了判例法竞赛任务，其中大多数都不止一项任务。我们收到了来自 6 个团队的任务 1（16 次运行）和 6 个团队的任务 2（17 次运行）的结果。在成文法任务中，有八个不同的团队参与，大多数都不止一项任务。 6 个团队为任务 3 提交了总共 18 次运行，6 个团队为任务 4 提交了总共 18 次运行，4 个团队为任务 5 提交了总共 12 次运行。这里我们总结了方法、我们的官方评估以及对我们的数据和提交结果的分析。
We summarize the 8th Competition on Legal Information Extraction and Entailment. In this edition, the competition included five tasks on case law and statute law. The case law component includes an information retrieval Task (Task 1), and the confirmation of an entailment relation between an existing case and an unseen case (Task 2). The statute law component includes an information retrieval Task (Task 3), an entailment/question answering task based on retrieved civil code statutes (Task 4) and an entailment/question answering task without retrieved civil code statutes (Task 5). Participation was open to any group based on any approach. Eight different teams participated in the case law competition tasks, most of them in more than one task. We received results from six teams for Task 1 (16 runs) and 6 teams for Task 2 (17 runs). On the statute law task, there were eight different teams participating, most in more than one task. Six teams submitted a total of 18 runs for Task 3, 6 teams submitted a total of 18 runs for Task 4, and 4 teams submitted a total of 12 runs for Task 5. Here we summarize the approaches, our official evaluation, and analysis on our data and submission results.