Using mutual information to test from Finite State Machines: Test suite selection

Using mutual information to test from Finite State Machines: Test suite selection
复制标题

使用相互信息从有限状态机进行测试:测试套件选择

DOI:
10.1016/j.infsof.2020.106498
复制
发表时间:
2021
影响因子:
3.9
通讯作者:
Ibias A
Ibias A
中科院分区:
计算机科学2区
文献类型:
--
作者:
Ibias A

文献摘要

参考文献

被引文献

相似文献

上下文互信息是一种信息理论度量,旨在量化两个随机变量之间的相似性。在本文中,我们采用了这个概念,并展示了如何使用它从基于最大多样性方法的有限状态机(FSM)中选择一个好的测试套件进行测试。本文的主要目标是使用互信息,以便从fsm中选择测试套件进行测试,并评估我们是否获得了更好的结果,关于所选测试套件的质量,而不是当前最先进的措施。首先,我们定义了我们的场景。我们考虑了这样一种情况:我们收到两个(或更多)测试套件,我们必须在它们之间进行选择。我们对这个场景很感兴趣,因为它是回归测试中经常出现的情况。其次,我们定义了基于互信息的概念:有偏互信息。最后,我们进行了实验,以评估该措施。结果我们获得了实验证据,证明了该措施的潜在价值。我们还表明,与应用额外测试所需的时间相比,计算度量所需的时间可以忽略不计。我们将我们的度量与最先进的测试选择度量进行了比较,并表明我们的建议优于它。最后,我们将我们的测量与过渡覆盖的概念进行了比较。我们的实验表明,我们的方法比转换覆盖率略差,正如预期的那样,但它的计算速度快了10倍。我们的实验表明,有偏互信息是选择测试套件的一个很好的度量,优于当前最先进的度量,并且与故障覆盖率具有(负)相关性。因此,我们可以得出结论,我们的新度量可以用来选择可能发现更多错误的测试套件。因此,它有可能被用于自动化测试生成。
ContextMutual Information is an information theoretic measure designed to quantify the amount of similarity between two random variables ranging over two sets. In this paper, we adapt this concept and show how it can be used to select agoodtest suite to test from a Finite State Machine (FSM) based on amaximise diversityapproach.ObjectiveThe main goal of this paper is to use Mutual Information in order to select test suites to test fromFSMs and evaluate whether we obtain better results, concerning the quality of the selected test suite, than current state-of-the-art measures.MethodFirst, we defined our scenario. We considered the case where we receive two (or more) test suites and we have to choose between them. We were interested in this scenario because it is a recurrent case in regression testing. Second, we defined our notion based on Mutual Information: Biased Mutual Information. Finally, we carried out experiments in order to evaluate the measure.ResultsWe obtained experimental evidence that demonstrates the potential value of the measure. We also showed that the time needed to compute the measure is negligible when compare to the time needed to apply extra testing. We compared our measure with a state-of-the-art test selection measure and showed that our proposal outperforms it. Finally, we have compared our measure with a notion of transition coverage. Our experiments showed that our measure is slightly worse than transition coverage, as expected, but its computation is 10 times faster.ConclusionOur experiments showed that Biased Mutual Information is a good measure for selecting test suites, outperforming the current state-of-the-art measure, and having a (negative) correlation to fault coverage. Therefore, we can conclude that our new measure can be used to select the test suite that is likely to find more faults. As a result, it has the potential to be used to automate test generation.
DOI: 10.1016/j.ipl.2012.01.004
发表时间: 2012
期刊: Inf. Process. Lett.
影响因子: --
作者:
D. Clark;R. Hierons
通讯作者: R. Hierons
使用多目标遗传算法的基于 EFSM 的测试套件生成方法
DOI: --
发表时间: 2017
期刊: Symposium on Symbolic and Numeric Algorithms for Scientific Computing
影响因子: --
作者:
Ana Turlea;F. Ipate;R. Lefticaru
通讯作者: R. Lefticaru
DOI: 10.1007/978-3-030-11298-1
发表时间: 2019
期刊: --
影响因子: --
作者:
Ming Li;P. Vitányi
通讯作者: Ming Li;P. Vitányi
使用故障模型对随机定时系统进行测试
DOI: --
发表时间: 2009
期刊: J. Log. Algebraic Methods Program.
影响因子: --
作者:
R. Hierons;Mercedes G. Merayo;M. Núñez
通讯作者: M. Núñez
DOI: --
发表时间: 2010
期刊: Comput. Networks
影响因子: --
作者:
Iksoon Hwang;A. Cavalli
通讯作者: A. Cavalli