TEXTUAL INFORMATION RETRIEVAL TESTING

测试检索方法有效性的新方法有 本文研究了一种测试检索性能的方法， 统计上独立的检索方法的比较， 开发第二种测试检索的方法是基于对 文献收集与相关关系的研究， 与以前的方法相比。第二种方法涉及 超几何概率分布，并产生相当的结果 与第一个一致。已经发表了一篇论文描述了这一点 建模方法 一种基于信息论的新的检索性能度量方法， 被发现这种方法很容易应用， 由分级检索方法产生的信息位数， 在检索中将相关文档集中在前n个等级中 操作它具有许多直观上令人满意的特性， 当后者允许明确的比较时，精确-召回曲线 不同的检索方法。发表了一篇论文， 方法论。 已经进行了研究来评估检索的灵敏度 测试集中的查询数量和特定的 使用的措施。几个经典的测试集（CRAN，CISI和MED， 等等）。以及Medline在分子生物学领域的测试子集 生物学已经研究过了。特别注意的是 大型数据库的问题，其中只有不完全抽样是可能的。

New approaches to testing the effectiveness of retrieval methods have been studied. A method of testing retrieval performance which involves the comparison of statistically independent retrieval methods has been developed. A second method of testing retrieval based on modelling the document collection and the relevance relation has been investigated and compared with the previous method. This second method involves the hypergeometic probability distribution and yields results quite consistent with the first. A paper has been published describing this modelling method. A new measure of retrieval performance based on information theory has been discovered. This measure is simple to apply and calculates the number of bits of information produced by a ranked retrieval method in concentrating relevant documents in the first n ranks in the retrieval operation. It has many intuitively desirable properties and agrees with precision-recall curves when the latter allow the unambiguous comparison of different methods of retrieval. A paper has been published describing the methodology. Studies have been performed to evaluate the sensitivity of retrieval testing to the number of queries in a test set and to the particular measure used. Several of the classical test sets (CRAN, CISI, and MED, etc.) as well as a test subset of Medline in the area of molecular biology have been studied. Special attention has been paid to the problem of large databases where only incomplete sampling is possible.