Enhancing access to the Bibliome: the TREC 2004 Genomics Track.
Enhancing access to the Bibliome: the TREC 2004 Genomics Track.
复制标题
DOI：
10.1186/1747-5333-1-3
复制
发表时间：
2006-03-13
期刊：
影响因子：
--
通讯作者：
Kraemer, Dale F
中科院分区：
文献类型：
--
作者：
Hersh, William R;Bhupatiraju, Ravi Teja;Ross, Laura;Roberts, Phoebe;Cohen, Aaron M;Kraemer, Dale F
TREC基因组学跟踪的目标是通过创建测试集合来改善基因组学领域的信息检索，这些测试集合将使研究人员能够改进和更好地了解其系统的故障。2004年的曲目包括一个临时检索任务，模拟使用搜索引擎获取有关生物医学主题的文档。本文介绍了基因组学跟踪的文本检索会议（TREC）2004年，IR研究系统，在基因组学领域的检索最近开始进行评估的评估论坛。共有27个研究小组提交了47个不同的运行。最有效的运行，作为衡量的平均平均精密度（MAP）的主要评价指标，使用特定领域和一般技术的组合。通过任何运行获得的最佳MAP为0.4075。使用基因名称列表以及相关文章中的单词扩展查询的技术具有最佳功效。然而，许多运行比简单的基线运行表现更差，这表明仔细选择系统功能是必不可少的。各种方法的特设检索提供了多样性的功效。TREC基因组学跟踪及其测试收集资源提供了改进信息检索系统的工具。
The goal of the TREC Genomics Track is to improve information retrieval in the area of genomics by creating test collections that will allow researchers to improve and better understand failures of their systems. The 2004 track included an ad hoc retrieval task, simulating use of a search engine to obtain documents about biomedical topics. This paper describes the Genomics Track of the Text Retrieval Conference (TREC) 2004, a forum for evaluation of IR research systems, where retrieval in the genomics domain has recently begun to be assessed. A total of 27 research groups submitted 47 different runs. The most effective runs, as measured by the primary evaluation measure of mean average precision (MAP), used a combination of domain-specific and general techniques. The best MAP obtained by any run was 0.4075. Techniques that expanded queries with gene name lists as well as words from related articles had the best efficacy. However, many runs performed more poorly than a simple baseline run, indicating that careful selection of system features is essential. Various approaches to ad hoc retrieval provide a diversity of efficacy. The TREC Genomics Track and its test collection resources provide tools that allow improvement in information retrieval systems.