Precision and Recall of Search Strategies for Identifying Studies on Return-To-Work in Medline
Precision and Recall of Search Strategies for Identifying Studies on Return-To-Work in Medline
复制标题
DOI：
10.1007/s10926-009-9177-0
复制
发表时间：
2009-09-01
影响因子：
3.3
通讯作者：
Shaw, William
中科院分区：
文献类型：
--
作者：
Gehanno, Jean-Francois;Rollin, Laetitia;Shaw, William
引言本研究的目的是报告各种搜索策略和关键词的质量，以找到返回工作（RTW）的研究在Medline书目数据库。方法应用计算机多字符串检索Medline 2003年有关RTW的文献，手工检索16种主要康复或职业医学期刊。在检索到的文章中，将认为相关的文章汇总到黄金标准数据库中。从这个数据库中，我们确定了候选文本词或MeSH术语的搜索策略，使用词频分析的摘要和MEDLINE分类算法。根据确定的术语的频率，对每个术语单独或组合进行检索。我们计算了每个关键字或关键字组合的召回率，精度和阅读所需的数量（NNR = 1/精度）。结果在8，073篇文章中，314篇（3.9%）被认为是相关的，并被纳入金标准数据库。检索字符串（“康复，职业”[MeSH]）、（“返回工作”[全部]）和（“返回工作”[全部]）的召回率/准确率分别为30.46/19.11、59.55/87.38和3.18/90.91%。它们与布尔运算符OR的组合产生了73.89/58.44%的召回率/精确率和1.7的NNR。对于需要全面文献检索的最终用户，最佳字符串是（“返回工作”或“返回工作”或“康复，职业”[MeSH]或“康复”[副标题]），召回率为88.22%，NNR为18。结论没有一个单一的MeSH术语可用于帮助医生识别Medline中关于RTW的相关研究。定位这些类型的研究需要结合使用各种MeSH和非MeSH术语，以获得令人满意的召回。然而，提高搜索策略的查全率可能会导致更低的查准率和更高的NNR，尽管具有非线性趋势。最终用户必须考虑这一因素，以提高Medline检索的成本效益比。
Introduction The purpose of this study was to report on the qualities of various search strategies and keywords to find return to work (RTW) studies in the Medline bibliographic database. Methods We searched Medline for articles on RTW published in 2003, using multiple search strings, and hand searched 16 major periodicals of rehabilitation or occupational medicine. Among the retrieved articles, those considered to be relevant, were pooled in a Gold Standard Database. From this database, we identified candidate text words or MeSH terms for search strategies using a word frequency analysis of the abstracts and a MEDLINE categorization algorithm. According to the frequency of identified terms, searches were run for each term independently and in combination. We computed Recall, Precision, and number needed to read (NNR = 1/Precision) of each keyword or combination of keywords. Results Among the 8,073 articles examined, 314 (3.9%) were considered relevant and included in the Gold Standard Database. The search strings ("Rehabilitation, Vocational'' [MeSH]), ("Return to work''[All]) and ("Back to work''[All]) had Recall/Precision ratio of 30.46/19.11, 59.55/87.38 and 3.18/90.91%, respectively. Their combination with the Boolean operator OR yielded to a Recall/Precision ratio of 73.89/58.44% and a NNR of 1.7. For the end user requiring comprehensive literature search, the best string was ("Return to work'' OR "Back to work'' OR "Rehabilitation, vocational''[MeSH] OR "rehabilitation''[Subheading]), with a Recall of 88.22% and a NNR of 18. Conclusions No single MeSH term is available to help the physician to identify relevant studies on RTW in Medline. Locating these types of studies requires the use of various MeSH and non-MeSH terms in combination to obtain a satisfactory Recall. Nevertheless, enhancing the Recall of search strategies may lead to lower Precision, and higher NNR, although with a non linear trend. This factor must be taken into consideration by the end user in order to improve the cost-effectiveness ratio of the search in Medline.