BioCreAtIvE task 1A: gene mention finding evaluation.
BioCreAtIvE task 1A: gene mention finding evaluation.
复制标题
DOI：
10.1186/1471-2105-6-s1-s2
复制
发表时间：
2005
影响因子：
3
通讯作者：
Hirschman L
中科院分区：
文献类型：
--
作者：
Yeh A;Morgan A;Colosimo M;Hirschman L
生物学研究文献是知识的主要宝库。随着文献数量的增加，找到特定主题的感兴趣信息将变得更加困难。有越来越多的工作对文本挖掘这些文献，但比较这项工作是困难的，因为缺乏标准进行比较。为了解决这个问题，我们与马德里CNB-CSIC蛋白质设计小组的同事合作开发了BioCreAtIvE（生物学信息提取的关键评估），这是一个开放的通用评估系统，用于评估一些生物文本挖掘任务。我们在这里报告任务1A，它涉及在文本中找到基因和相关实体的提及。“发现提及”是一项基本任务，可用作其他文本挖掘任务的构建块。该任务利用了美国国家生物技术信息中心（NCBI）提供的数据和评估软件。15个小组参加了任务1A。许多团队的得分超过80% F-测量（平衡的精确度和召回率）。试图使用任务1A系统帮助其他BioCreAtIvE任务的团队报告了混合结果。80%以上的F-测量结果是好的，但仍然有些落后于其他一些领域，如新闻通讯，部分原因是基因名称的复杂性和长度，与新闻通讯中的个人或组织名称相比。
The biological research literature is a major repository of knowledge. As the amount of literature increases, it will get harder to find the information of interest on a particular topic. There has been an increasing amount of work on text mining this literature, but comparing this work is hard because of a lack of standards for making comparisons. To address this, we worked with colleagues at the Protein Design Group, CNB-CSIC, Madrid to develop BioCreAtIvE (Critical Assessment for Information Extraction in Biology), an open common evaluation of systems on a number of biological text mining tasks. We report here on task 1A, which deals with finding mentions of genes and related entities in text. "Finding mentions" is a basic task, which can be used as a building block for other text mining tasks. The task makes use of data and evaluation software provided by the (US) National Center for Biotechnology Information (NCBI). 15 teams took part in task 1A. A number of teams achieved scores over 80% F-measure (balanced precision and recall). The teams that tried to use their task 1A systems to help on other BioCreAtIvE tasks reported mixed results. The 80% plus F-measure results are good, but still somewhat lag the best scores achieved in some other domains such as newswire, due in part to the complexity and length of gene names, compared to person or organization names in newswire.