Analysis and Evaluation of Measures of Information Retrieval Performance

信息检索性能测量的分析与评估

• 批准号: 0534482
• 负责人: Javed Aslam
• 金额: $ 30万
• 依托单位: Northeastern University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2006
• 资助国家: 美国
• 起止时间: 2006-07-01 至 2010-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0534482&HistoricalAwards=false
• 关键词: Analysis; Evaluation; Measures; Information; Retrieval

Search engines and other information retrieval technologies are critical in the digital age. The goal of the proposed research is to investigate novel frameworks for analyzing and efficiently evaluating measures of retrieval performance, with an eye toward fostering and enabling research leading to better search engines and other retrieval technologies. Two novel frameworks are proposed: (1) an information-theoretic framework within which one can quantifiably assess what various measures of retrieval performance are measuring and (2) a statistical framework within which one can efficiently estimate these measures of retrieval performance. The former provides a theoretical underpinning for retrieval evaluation and analysis; the latter provides a practical methodology for efficiently evaluating search engines on a large scale. Each will foster and enable research leading to better search engines and search technology. The potential impacts of this project are many. From a research and infrastructure perspective, the project will yield published research results and freely available software artifacts (via http://www.ccs.neu.edu/home/jaa/IIS-0534482/), which will permit large-scale retrieval evaluation with minimal effort. Academics and other technologists will be able to efficiently test and evaluate new retrieval algorithms on novel data sets without incurring the high costs associated with the standard information retrieval evaluation paradigm. As such, one aspect of the project is an enabling technology that will foster the more rapid development of new search algorithms, vital in the current digital age. From an educational perspective, the project will train graduate and undergraduate students.

搜索引擎和其他信息检索技术在数字时代至关重要。拟议研究的目标是研究用于分析和有效评估检索性能指标的新颖框架，着眼于促进和支持导致更好的搜索引擎和其他检索技术的研究。提出了两个新颖的框架：（1）一种信息论框架，在该框架中，人们可以量化评估各种检索性能测量的内容；（2）一种统计框架，在其中，人们可以有效地估计这些检索性能的测量。前者为检索评价和分析提供理论基础；后者提供了一种大规模有效评估搜索引擎的实用方法。每一个都将促进和促进研究，从而带来更好的搜索引擎和搜索技术。该项目的潜在影响是多方面的。从研究和基础设施的角度来看，该项目将产生已发表的研究成果和免费提供的软件工件（通过http://www.ccs.neu.edu/home/jaa/IIS-0534482/），这将允许以最小的努力进行大规模检索评估。学者和其他技术人员将能够在新颖的数据集上有效地测试和评估新的检索算法，而不会产生与标准信息检索评估范式相关的高成本。因此，该项目的一个方面是一项使能技术，它将促进新搜索算法的更快发展，这在当前数字时代至关重要。从教育角度来看，该项目将培养研究生和本科生。