The impact of test suite granularity on the cost-effectiveness of regression testing
The impact of test suite granularity on the cost-effectiveness of regression testing
复制标题
DOI：
10.1145/581356.581358
复制
发表时间：
2002-05
期刊：
影响因子：
--
通讯作者：
G. Rothermel;Sebastian G. Elbaum;Alexey G. Malishevsky;Praveen Kallakuri;B. Davia
中科院分区：
文献类型：
--
作者：
G. Rothermel;Sebastian G. Elbaum;Alexey G. Malishevsky;Praveen Kallakuri;B. Davia
回归测试是一个昂贵的测试过程，用于验证软件修改后。回归测试技术的成本效益随测试套件的特性而变化。其中一个特性，测试套件粒度，涉及到测试输入被分组到测试套件中的测试用例的方式。各种成本效益权衡已被归因于测试套件粒度的选择，但几乎没有研究正式检查这些权衡。为了解决这个问题，我们进行了几个对照实验，检查测试套件粒度的成本和收益的几个回归测试方法在两个非平凡的软件系统的六个版本的影响。我们的研究结果暴露了在设计用于回归测试的测试套件时需要考虑的基本权衡。
Regression testing is an expensive testing process used to validate software following modifications. The cost-effectiveness of regression testing techniques varies with characteristics of test suites. One such characteristic, test suite granularity, involves the way in which test inputs are grouped into test cases within a test suite. Various cost-benefit tradeoffs have been attributed to choices of test suite granularity, but almost no research has formally examined these tradeoffs. To address this lack, we conducted several controlled experiments, examining the effects of test suite granularity on the costs and benefits of several regression testing methodologies across six releases of two non-trivial software systems. Our results expose essential tradeoffs to consider when designing test suites for use in regression testing evolving systems.