XML-manipulating test case prioritization for XML-manipulating services
XML-manipulating test case prioritization for XML-manipulating services
复制标题
DOI：
10.1016/j.jss.2010.11.905
复制
发表时间：
2011-04
期刊：
影响因子：
--
通讯作者：
Lijun Mei;W. Chan;T. Tse;Robert G. Merkel
中科院分区：
文献类型：
--
作者：
Lijun Mei;W. Chan;T. Tse;Robert G. Merkel
Web 服务可能会自主演化，使得同一服务组合中的对等 Web 服务不确定演化后的行为是否与其原始协作协议兼容。尽管对等服务可能希望进行回归测试来验证商定的协作，但他们可能无法访问前一个服务的源代码。由于对等服务的黑盒性质，传统的基于代码的回归测试方法不适用。此外，传统技术假设用于验证 Web 服务的回归测试套件可用。存储回归测试套件的位置也是一个问题。另一方面，我们注意到Web服务丰富的接口规范为对等服务提供了制定黑盒测试策略的手段。在本文中，我们提供了一种面向黑盒服务的测试策略。我们还使用嵌入在 XML 消息中的标签来制定新的测试用例优先级策略，以重新排序回归测试用例，并揭示测试用例如何使用 Web 服务的接口规范。我们通过实验评估了这些黑盒策略在揭示修改后的 WS-BPEL 程序中的回归错误方面的有效性。结果表明，新技术很有可能优于随机排序。此外，我们的实验表明，在回归测试用例中，基于 WSDL 标签覆盖率的测试用例优先级比基于 XML 消息中的标签数量的测试用例优先级可以实现更小的方差，尽管它们的总体故障检测率相似。
A web service may evolve autonomously, making peer web services in the same service composition uncertain as to whether the evolved behaviors are compatible with its original collaborative agreement. Although peer services may wish to conduct regression testing to verify the agreed collaboration, the source code of the former service may be inaccessible to them. Owing to the black-box nature of peer services, traditional code-based approaches to regression testing are inapplicable. In addition, traditional techniques assume that a regression test suite for verifying a web service is available. The location to store a regression test suite is also a problem. On the other hand, we note that the rich interface specifications of a web service provide peer services with a means to formulate black-box testing strategies. In this paper, we provide a strategy for black-box service-oriented testing. We also formulate new test case prioritization strategies using tags embedded in XML messages to reorder regression test cases, and reveal how the test cases use the interface specifications of web services. We experimentally evaluate the effectiveness of these black-box strategies in revealing regression faults in modified WS-BPEL programs. The results show that the new techniques can have a high chance of outperforming random ordering. Moreover, our experiment shows that prioritizing test cases based on WSDL tag coverage can achieve a smaller variance than that based on the number of tags in XML messages in regression test cases, even though their overall fault detection rates are similar.