A Task-Oriented Approach to Information Retrieval Evaluation
A Task-Oriented Approach to Information Retrieval Evaluation
复制标题
面向任务的信息检索评估方法
DOI：
--
复制
发表时间：
1996
期刊：
影响因子：
--
通讯作者：
D. Hickam
中科院分区：
文献类型：
--
作者：
W. Hersh;Jeffrey Pentecost;D. Hickam
随着检索系统越来越面向最终用户，越来越需要改进方法来评估其有效性。我们对两个MEDLINE检索系统进行了面向任务的评估，其中一个系统促进了人类索引词库术语的传统布尔检索，另一个系统促进了标题、摘要和索引术语中的自然语言检索。医科学生被随机分配到两个系统中的一个，并回答临床问题。学生们能够成功地使用每个系统，在正确回答的问题，所花费的时间，检索到的相关文章或系统之间的用户满意度没有显着差异。这种评价方法在衡量系统使用的有效性方面是成功的，并表明这两种类型的系统可以同样好地使用，只需很少的培训。John Wiley & Sons，Inc.
As retrieval systems become more oriented towards end‐users, there is an increasing need for improved methods to evaluate their effectiveness. We performed a task‐oriented assessment of two MEDLINE searching systems, one which promotes traditional Boolean searching on human‐indexed thesaurus terms and the other natural language searching on words in the title, abstract, and indexing terms. Medical students were randomized to one of the two systems and given clinical questions to answer. The students were able to use each system successfully, with no significant differences in questions correctly answered, time taken, relevant articles retrieved, or user satisfaction between the systems. This approach to evaluation was successful in measuring effectiveness of system use and demonstrates that both types of systems can be used equally well with minimal training. © 1996 John Wiley & Sons, Inc.