How Reliable Are Systematic Reviews in Empirical Software Engineering?

How Reliable Are Systematic Reviews in Empirical Software Engineering?
复制标题

实证软件工程中的系统评审有多可靠?

DOI:
--
复制
发表时间:
2010
影响因子:
7.4
通讯作者:
E. Mendes
E. Mendes
中科院分区:
计算机科学1区
文献类型:
--
作者:
Stephen G. MacDonell;M. Shepperd;B. Kitchenham;E. Mendes

文献摘要

参考文献

被引文献

相似文献

系统性综述正在成为经验软件工程中更常用的研究工具。在过度依赖这些审查的结果之前,考虑这种方法在这一特定研究背景下的稳健性似乎是有用的。本研究的目的是评估系统评价作为一种研究工具的可靠性。特别是,我们希望研究过程的一致性和结果的稳定性。方法-我们比较了两个独立的审查与一个共同的研究问题的结果。结果--这两篇评论对研究问题找到了相似的答案,尽管得出这些答案的方法有所不同。结论-在解决一个界限分明的研究问题,具有相似领域经验的研究人员群体可以达到相同的审查结果,即使他们可能以不同的方式这样做。这提供了证据,至少在这种情况下,系统评价是一种强大的研究方法。
BACKGROUND-The systematic review is becoming a more commonly employed research instrument in empirical software engineering. Before undue reliance is placed on the outcomes of such reviews it would seem useful to consider the robustness of the approach in this particular research context. OBJECTIVE-The aim of this study is to assess the reliability of systematic reviews as a research instrument. In particular, we wish to investigate the consistency of process and the stability of outcomes. METHOD-We compare the results of two independent reviews undertaken with a common research question. RESULTS-The two reviews find similar answers to the research question, although the means of arriving at those answers vary. CONCLUSIONS-In addressing a well-bounded research question, groups of researchers with similar domain experience can arrive at the same review outcomes, even though they may do so in different ways. This provides evidence that, in this context at least, the systematic review is a robust research method.
DOI: 10.1016/j.infsof.2008.09.009
发表时间: 2009-01-01
影响因子: 3.9
作者:
Kitchenham, Barbara;Brereton, O. Pearl;Linkman, Stephen
通讯作者: Linkman, Stephen