Assessing Oracle Quality with Checked Coverage
Assessing Oracle Quality with Checked Coverage
复制标题
DOI：
10.1109/icst.2011.32
复制
发表时间：
2011-03
期刊：
影响因子：
--
通讯作者：
David Schuler;A. Zeller
中科院分区：
文献类型：
--
作者：
David Schuler;A. Zeller
传统覆盖指标的一个已知问题是，它们不评估Oracle质量--也就是说，计算结果是否实际上根据预期进行了检查。在本文中，我们引入了检查覆盖的概念-实际影响预言机的覆盖语句的动态切片。我们在七个开源项目上的实验表明，检查覆盖率是Oracle质量的一个可靠指标，甚至比变异测试更敏感，变异测试是一个要求更高的替代方案。
A known problem of traditional coverage metrics is that they do not assess oracle quality -- that is, whether the computation result is actually checked against expectations. In this paper, we introduce the concept of checked coverage -- the dynamic slice of covered statements that actually influence an oracle. Our experiments on seven open-source projects show that checked coverage is a sure indicator for oracle quality -- and even more sensitive than mutation testing, its much more demanding alternative.