Cleansing Test Suites from Coincidental Correctness to Enhance Fault-Localization
Cleansing Test Suites from Coincidental Correctness to Enhance Fault-Localization
复制标题
DOI：
10.1109/icst.2010.22
复制
发表时间：
2010-04
期刊：
影响因子：
--
通讯作者：
Wes Masri;R. A. Assi
中科院分区：
文献类型：
--
作者：
Wes Masri;R. A. Assi
研究人员认为，要观察到失败，必须满足以下三个条件：1）缺陷被执行，2）程序已转换为感染状态，3）感染已传播到输出。当程序产生正确的输出时，偶然正确性出现，而条件1）和2）满足，但不满足3）。在以前的工作中，我们表明，巧合的正确性是普遍存在的，并证明了它是一个安全的减少因素，覆盖率为基础的故障定位。这项工作的目的是清洗测试套件从巧合的正确性，以提高故障定位。具体来说，给定一个测试套件，其中每个测试已被分类为失败或通过，我们提出了三种变化的技术，确定的子集，通过测试，很可能是巧合的正确。我们通过实证量化以下内容来评估我们的技术的有效性：1）他们如何准确地识别巧合正确的测试，2）他们在多大程度上提高了基于覆盖率的故障定位的有效性，以及3）由于应用它们，覆盖率降低了多少。使用我们更好的执行技术和配置，88%和61%的程序的错误定位的安全性和精度分别提高。
Researchers have argued that for failure to be observed the following three conditions must be met: 1) the defect is executed, 2) the program has transitioned into an infectious state, and 3) the infection has propagated to the output. Coincidental correctness arises when the program produces the correct output, while conditions 1) and 2) are met but not 3). In previous work, we showed that coincidental correctness is prevalent and demonstrated that it is a safety reducing factor for coverage-based fault localization. This work aims at cleansing test suites from coincidental correctness to enhance fault localization. Specifically, given a test suite in which each test has been classified as failing or passing, we present three variations of a technique that identify the subset of passing tests that are likely to be coincidentally correct. We evaluated the effectiveness of our techniques by empirically quantifying the following: 1) how accurately did they identify the coincidentally correct tests, 2) how much did they improve the effectiveness of coverage-based fault localization, and 3) how much did coverage decrease as a result of applying them. Using our better performing technique and configuration, the safety and precision of fault-localization was improved for 88% and 61% of the programs, respectively.