Extended Overview of ChEMU 2022 Evaluation Campaign: Information Extraction in Chemical Patents
Extended Overview of ChEMU 2022 Evaluation Campaign: Information Extraction in Chemical Patents
复制标题
DOI：
--
复制
发表时间：
2022
期刊：
影响因子：
--
通讯作者：
Yuan Li;Biaoyan Fang;Jiayuan He;Hiyori Yoshikawa;S. Akhondi;Christian Druckenbrodt;Camilo Thorne;Z. Afzal;Zenan Zhai;Kojiro Machi;Masaharu Yoshioka;Y. Jang;Ho-Kyung Song;Junho Lee;Gyeonghun Kim;Yi-Na Kim;Stanley Jungkyu Choi;Ho Hin Lee;Kyunghoon Bae;D. Mahendran;Christina Tang;Bridget Mcinnes;Timothy Baldwin;K. Verspoor
中科院分区：
文献类型：
--
作者：
Yuan Li;Biaoyan Fang;Jiayuan He;Hiyori Yoshikawa;S. Akhondi;Christian Druckenbrodt;Camilo Thorne;Z. Afzal;Zenan Zhai;Kojiro Machi;Masaharu Yoshioka;Y. Jang;Ho-Kyung Song;Junho Lee;Gyeonghun Kim;Yi-Na Kim;Stanley Jungkyu Choi;Ho Hin Lee;Kyunghoon Bae;D. Mahendran;Christina Tang;Bridget Mcinnes;Timothy Baldwin;K. Verspoor
在这篇文章中，我们提供了化学信息学埃尔塞维尔墨尔本大学(ChEMU)评估实验室2022的概述，该实验室是评估论坛2022(CLEF 2022)会议和实验室的一部分。CHEMU活动的重点是信息提取任务，而不是专利中的化学反应。CHEMU 2020实验室提供了两项信息提取任务，名为实体识别和事件提取。ChEMU 2021实验室又推出了一项任务，即回指解析。今年，我们用新的测试数据重新运行了所有三项任务。总而言之，这些任务支持全面的自动化化学专利分析。在此，我们描述为这些任务创建的资源和采用的评价方法。我们还简要总结了本实验参与者使用的方法以及从3个团队的22次运行中获得的结果，发现有几份提交的方法比组织者准备的基线方法获得了更好的结果。
In this paper, we provide an overview of the Cheminformatics Elsevier Melbourne University (ChEMU) evaluation lab 2022, part of the Conference and Labs of the Evaluation Forum 2022 (CLEF 2022). The ChEMU campaign focuses on information extraction tasks over chemical reactions in patents. The ChEMU 2020 lab provided two information extraction tasks, named entity recognition and event extraction. The ChEMU 2021 lab introduced one more task, anaphora resolution. This year, we re-run all the three tasks with new test data. Together, the tasks support comprehensive automatic chemical patent analysis. Herein, we describe the resources created for these tasks and the evaluation methodology adopted. We also provide a brief summary of the methods employed by participants of this lab and the results obtained across 22 runs from 3 teams, finding that several submissions achieve better results than the baseline methods prepared by the organizers.