Reviewing the meaning of ‘systematic review’
Reviewing the meaning of ‘systematic review’
复制标题
回顾“系统审查”的含义
DOI:
--
复制
发表时间:
2007
影响因子:
3.5
通讯作者:
J. Daly
中科院分区:
文献类型:
--
作者:
J. Lumley;J. Daly
In a multi-disciplinary field such as public health, we have to be careful about the range of meanings that can be attached to words or phrases. One term that is causing us difficulty at the Journal is ‘systematic review’. The interpretation of the term ranges from a common sense use, where authors have been more or less systematic in their review of the literature, to the use of a quite technical and formalised synthesis of information from the literature. Our aim here is to examine these differences and to suggest a compromise in which the emphasis is on the systematic nature of the review. At the technical end of the spectrum of meaning is meta-analysis. That is, how it came about. In the past two or three decades there has been a substantial increase in the number of randomised controlled trials that have been conducted. Not all of these trials have delivered statistically significant results, sometimes because the sample sizes are inadequate, and the results of different trials of the same procedure may be contradictory. There are then two choices. The first is to conduct a larger, more rigorous and, therefore, definitive trial. The other is to conduct a meta-analysis using statistical techniques to combine the results from various randomised controlled trials as they emerge, thus strengthening the conclusions. Cumulative meta-analysis provides timely and trustworthy evidence. The methods for conducting such meta-analyses are clearly spelled out and form the basis for much of the work published by the Cochrane Collaboration. An important facet of these metaanalyses is that there should be a comprehensive search of the literature, so that all relevant studies are identified. There have to be explicit criteria for what is included and excluded, based on the methodological rigour of the study. Since the meta-analysis involves a re-analysis of data from the original studies, authors may have to be contacted to confirm or provide additional data. If some studies are unpublished because the result is negative, that introduces a bias to be addressed by keeping track of all studies in a field, published and unpublished. Clearly these are demanding studies and they are recognised as making an important research contribution. Iain Chalmers, founder of the Cochrane Collaboration, preferred the term ‘systematic review’ to cover not only statistical meta-analyses but also other techniques for reducing bias by the systematic collection, categorisation and analysis of a set of studies addressing the same problem. Of course, researchers have to be methodologically and inventive to develop rigorous methods for combining the results of, say, a set of observational studies, or for combining the results of studies using different methods. Nevertheless, it can be done and when it is well done it is a source of good evidence for practitioners and policy makers. What then is the fate of the literature review that describes and draws conclusions from a selection of key papers from the literature? These reviews may still be adequate for the few paragraphs that provide background for a research paper. However, they are inadequate as stand-alone papers reporting an overview of the literature, especially if the article invokes the notion of a systematic review. With the rise of database searching for relevant articles, generating what is sometimes a vast accumulation of relevant studies, not all of them rigorous or well-developed, authors must specify and justify their search methods and criteria for selecting or excluding articles from the review. These stand-alone reviews then need to spell out the process used to synthesise the literature and to draw overall conclusions. We are aware that this view of the systematic review raises the bar for many researchers not accustomed to meta-analytic procedures. However, the advantages of this more explicit and, hopefully, rigorous approach well outweighs the disadvantages.