An Evaluation of Test Suite Minimization Techniques
An Evaluation of Test Suite Minimization Techniques
复制标题
测试套件最小化技术的评估
DOI：
--
复制
发表时间：
2019
期刊：
影响因子：
--
通讯作者：
Roman Haas
中科院分区：
文献类型：
--
作者：
Raphael Noemmer;Roman Haas
随着软件项目的发展，相关的测试套件通常也会随之发展。如果没有仔细地维护测试套件，这很容易导致大量的测试执行时间，减少回归测试的好处，因为错误是在开发后期甚至在发布之后发现的。测试套件最小化旨在通过移除冗余的测试用例来对抗长时间运行的测试套件。以前的工作主要是基于相对较小的项目来评估测试套件最小化技术，这些项目的实际相关性较低。在本文中，我们通过将四种测试套件最小化技术应用于几个开源软件项目并评估结果来比较它们。我们发现，所有测试套件的大小和执行时间平均可以减少70%以上。然而，在故障检测能力方面有很大的损失，平均约为12.5%，限制了这种形式的测试套件最小化的适用性。
As a software project evolves over time, the associated test suite usually grows with it. If test suites are not carefully maintained, this can easily result in massive test execution duration, reducing the benefits of regression testing because faults are found later in development or even after release. Test suite minimization aims to combat long running test suites by removing redundant test cases. Previous work mainly evaluates test suite minimization techniques based on comparably small projects, which are less practically relevant. In this paper, we compare four test suite minimization techniques by applying them to several open source software projects and evaluate the results. We find that the size and execution time of all the test suites can be reduced by over 70% on average. However, there is a substantial loss in fault detection capability of, on average, around 12.5%, restricting the applicability of this form of test suite minimization.