Observable modified condition/decision coverage
Observable modified condition/decision coverage
复制标题
可观察的修改条件/决策覆盖率
DOI：
--
复制
发表时间：
2013
期刊：
影响因子：
--
通讯作者：
Matthew Staats
中科院分区：
文献类型：
--
作者：
M. Whalen;Gregory Gay;Dongjiang You;M. Heimdahl;Matthew Staats
在许多关键系统领域中，测试套件充分性目前是使用源代码上的结构覆盖度量来衡量的。特别感兴趣的是例如关键航空电子系统所需的经修改的条件/决策覆盖(MC/DC)标准。在以前的调查中，我们发现这种测试套件的有效性高度依赖于被测试程序的结构和由Oracle监控的变量的选择。MC/DC适当的测试将经常执行错误代码，但错误的影响不会传播到受监视的Oracle变量。在本报告中，我们将MC/DC覆盖度量与可观测性概念相结合，以帮助确保覆盖结构性义务时遇到的故障的结果传播到被监测变量；我们将这一新的覆盖标准称为可观测MC/DC(OMC/DC)。我们假设此路径要求将使结构覆盖度量为1。)更有效地揭示故障，2.)对计划结构的变化更加健壮，以及3.)对所监测变量的选择更加稳健。我们评估了OMC/DC的有效性和对程序结构的敏感性，并与使用民用航空电子领域的四个子系统和微波控制逻辑屏蔽MC/DC进行了比较。我们发现，满足OMC/DC的测试用例明显比满足MC/DC的测试用例更有效，可以发现高达88%的错误，并且对程序结构和监控变量的选择不那么敏感。
In many critical systems domains, test suite adequacy is currently measured using structural coverage metrics over the source code. Of particular interest is the modified condition/decision coverage (MC/DC) criterion required for, e.g., critical avionics systems. In previous investigations we have found that the efficacy of such test suites is highly dependent on the structure of the program under test and the choice of variables monitored by the oracle. MC/DC adequate tests would frequently exercise faulty code, but the effects of the faults would not propagate to the monitored oracle variables. In this report, we combine the MC/DC coverage metric with a notion of observability that helps ensure that the result of a fault encountered when covering a structural obligation propagates to a monitored variable; we term this new coverage criterion Observable MC/DC (OMC/DC). We hypothesize this path requirement will make structural coverage metrics 1.) more effective at revealing faults, 2.) more robust to changes in program structure, and 3.) more robust to the choice of variables monitored. We assess the efficacy and sensitivity to program structure of OMC/DC as compared to masking MC/DC using four subsystems from the civil avionics domain and the control logic of a microwave. We have found that test suites satisfying OMC/DC are significantly more effective than test suites satisfying MC/DC, revealing up to 88% more faults, and are less sensitive to program structure and the choice of monitored variables.
DOI：
10.1109/icst.2011.32
发表时间：
2011-03
期刊：
2011 Fourth IEEE International Conference on Software Testing, Verification and Validation
影响因子：
--
作者：
David Schuler;A. Zeller
通讯作者：
David Schuler;A. Zeller