Towards new measures of information retrieval evaluation.
Towards new measures of information retrieval evaluation.
复制标题
走向信息检索评价的新措施。
DOI：
10.1145/215206.215355
复制
发表时间：
1994
期刊：
影响因子：
--
通讯作者：
Leichtenstien,C
中科院分区：
文献类型：
--
作者：
Hersh,WR;Elliot,DL;Hickam,DH;Wolf,SL;Molnar,A;Leichtenstien,C
目前用于评价信息检索系统的所有方法在衡量用户获取信息的能力方面都有局限性。我们利用一种方法来评估基于用户回答来自shorttanswer测试的问题的能力而获得的信息。高年级医学生参加了十个问题的测试，然后在WOIR系统中搜索他们最不关心答案的五个问题之一。我们的研究结果表明，在测试中，预搜索分数很低，但搜索产生了很高比例的答案与两个系统。这些方法能够测量所获得的信息，并将用于后续的研究，以评估红外系统之间的差异。
All of the methods cumently used to evaluate information retrieval (Ill) systems have limitations in their ability to measure how well users are able to acquire information. We utilized on approach to assessing information obtained based on the user’s ability to answer qtrcstions from a shortanswer test. Senior medical students took the ten-question test and then searched one of (WOIR systems on the five questions for which they were least ccrtuin of their answer. Our results showed thtit pre-searching scores on the test were low but that searching yielded a high proportion of answers with both systems. These methods are able to measure information obtained, and will be used in subsequent studies to assessdifferences among IR systems.