Are We There Yet? Determining the Adequacy of Formalized Requirements and Test Suites
Are We There Yet? Determining the Adequacy of Formalized Requirements and Test Suites
复制标题
我们到了吗？
DOI：
--
复制
发表时间：
2015
期刊：
影响因子：
--
通讯作者：
Dongjiang You
中科院分区：
文献类型：
--
作者：
A. Murugesan;M. Whalen;Neha Rungta;O. Tkachuk;Suzette Person;M. Heimdahl;Dongjiang You
结构覆盖度量传统上将代码分类为已覆盖或未覆盖。最近的工作提出了一个更强的覆盖率概念，即检查覆盖率，它只计算其执行有助于甲骨文检查结果的语句。虽然这种覆盖范围的概念解决了Oracle的充分性，但对于基于模型的安全关键系统开发来说，它仍然不够；我们还对Oracle覆盖了多少以及在评估Oracle时是否屏蔽了程序变量的值感兴趣。这些信息可以帮助系统工程师识别缺失的需求和缺失的测试用例。在这项工作中，我们将检查覆盖率的结果与需求覆盖率的结果结合起来，以帮助工程师洞察需求或测试套件是否需要改进。我们实现了一种动态后向切片技术，并在SIMULINK开发的几个系统上进行了评估。我们的初步研究结果表明，即使对于具有全面的测试套件和良好的需求集的系统，我们的方法也可以识别需要更多测试或更多需求来提高覆盖率的情况。
Structural coverage metrics have traditionally categorized code as either covered or uncovered. Recent work presents a stronger notion of coverage, checked coverage, which counts only statements whose execution contributes to an outcome checked by an oracle. While this notion of coverage addresses the adequacy of the oracle, for Model-Based Development of safety critical systems, it is still not enough; we are also interested in how much of the oracle is covered, and whether the values of program variables are masked when the oracle is evaluated. Such information can help system engineers identify missing requirements as well as missing test cases. In this work, we combine results from checked coverage with results from requirements coverage to help provide insight to engineers as to whether the requirements or the test suite need to be improved. We implement a dynamic backward slicing technique and evaluate it on several systems developed in Simulink. The results of our preliminary study show that even for systems with comprehensive test suites and good sets of requirements, our approach can identify cases where more tests or more requirements are needed to improve coverage numbers.
登录
查看更多内容
DOI：
10.1145/2483760.2483774
发表时间：
2013-07
期刊：
Proceedings of the 2013 International Symposium on Software Testing and Analysis
影响因子：
--
作者：
G. Fraser;Matthew Staats;Phil McMinn;Andrea Arcuri;F. Padberg
通讯作者：
G. Fraser;Matthew Staats;Phil McMinn;Andrea Arcuri;F. Padberg
DOI：
10.1109/icst.2011.32
发表时间：
2011-03
期刊：
2011 Fourth IEEE International Conference on Software Testing, Verification and Validation
影响因子：
--
作者：
David Schuler;A. Zeller
通讯作者：
David Schuler;A. Zeller
检查覆盖率：预言机质量的指标
DOI：
10.1002/stvr.1497
发表时间：
2013
期刊：
Software Testing
影响因子：
--
作者：
David Schuler;Andreas Zeller
通讯作者：
Andreas Zeller
基于需求的测试的正式分析
DOI：
10.1145/1572272.1572279
发表时间：
2009
期刊：
--
影响因子：
--
作者：
Pecheur C
通讯作者：
Pecheur C