An Industrial Investigation of Similarity Measures for Model-Based Test Case Selection
An Industrial Investigation of Similarity Measures for Model-Based Test Case Selection
复制标题
DOI：
10.1109/issre.2010.9
复制
发表时间：
2010-11
期刊：
影响因子：
--
通讯作者：
H. Hemmati;L. Briand
中科院分区：
文献类型：
--
作者：
H. Hemmati;L. Briand
在实践中应用基于模型的测试(MBT)需要实际的解决方案来扩大到大型工业系统。我们在应用MBT时面临的一个挑战是生成了太大而不实用的测试套件，即使对于简单的覆盖标准也是如此。测试用例选择技术的目标是选择所生成的测试用例中满足资源约束的子集，同时产生最大的故障检测率。一个有趣的启发式方法是基于预定义的相似性度量选择最多样化的测试用例。在本文中，我们研究和比较了可能的相似性函数，以支持在状态机测试的上下文中基于相似性的测试选择，状态机测试是最常见的MBT形式。我们将所提出的相似性度量和基于遗传算法的选择策略应用于工业软件系统。在实际故障的基础上，比较了它们的故障检测率。结果表明，将Jaccard索引应用于表示为一组触发器保护的测试用例是最经济有效的相似性度量。我们还讨论了我们的测试选择方法在测试执行节省方面的总体好处。
Applying model-based testing (MBT) in practice requires practical solutions for scaling up to large industrial systems. One challenge that we have faced while applying MBT was the generation of test suites that were too large to be practical, even for simple coverage criteria. The goal of test case selection techniques is to select a subset of the generated test suite that satisfies resource constraints while yielding a maximum fault detection rate. One interesting heuristic is to choose the most diverse test cases based on a pre-defined similarity measure. In this paper, we investigate and compare possible similarity functions to support similarity-based test selection in the context of state machine testing, which is the most common form of MBT. We apply the proposed similarity measures and a selection strategy based on genetic algorithms to an industrial software system. We compare their fault detection rate based on actual faults. The results show that applying Jaccard Index on test cases represented as a set of trigger-guards is the most cost-effective similarity measure. We also discuss the overall benefits of our test selection approach in terms of test execution savings.