Assessing Test Adequacy for Black-Box Systems without Specifications

Assessing Test Adequacy for Black-Box Systems without Specifications
复制标题

评估没有规范的黑盒系统的测试充分性

DOI:
--
复制
发表时间:
2011
期刊:
International Conference on Testing Software and Systems
影响因子:
--
通讯作者:
Neil Walkinshaw
Neil Walkinshaw
中科院分区:
--
文献类型:
--
作者:
Neil Walkinshaw

文献摘要

参考文献

被引文献

相似文献

在不求助于规范的情况下测试黑盒系统很难,因为没有估计需要多少测试的基础,或者可以评估给定的测试集的完整程度。一些研究人员指出,这些测试问题与归纳推理的问题之间存在双重性(从给定的示例中学习隐藏系统的模型)。不可能分辨出需要多少个示例来推断准确的模型,也没有理由告诉给定的示例有多完整。这些问题已通过开发统计技术在归纳推理的领域中解决,其中推断模型的准确性受到可忍受的误差程度。本文探讨了这些技术在评估黑盒系统测试集的应用。它显示了如何使用统计合理的方式来推理他们在没有规格的情况下完全锻炼系统所需的测试数量,以及如何在应用上下文中为黑盒测试集提供有效的充分措施。
Testing a black-box system without recourse to a specification is difficult, because there is no basis for estimating how many tests will be required, or to assess how complete a given test set is. Several researchers have noted that there is a duality between these testing problems and the problem of inductive inference (learning a model of a hidden system from a given set of examples). It is impossible to tell how many examples will be required to infer an accurate model, and there is no basis for telling how complete a given set of examples is. These issues have been addressed in the domain of inductive inference by developing statistical techniques, where the accuracy of an inferred model is subject to a tolerable degree of error. This paper explores the application of these techniques to assess test sets of black-box systems. It shows how they can be used to reason in a statistically justified manner about the number of tests required to fully exercise a system without a specification, and how to provide a valid adequacy measure for black-box test sets in an applied context.
使用基于搜索的测试强化推断规范
DOI: 10.1109/icstw.2008.39
发表时间: 2008
期刊: --
影响因子: --
作者:
Ghani K
通讯作者: Ghani K
DOI: 10.1145/1868044.1868045
发表时间: 2010
期刊: --
影响因子: --
作者:
Walkinshaw N
通讯作者: Walkinshaw N