Quality Assurance of Software Applications Using the In Vivo Testing Approach
Quality Assurance of Software Applications Using the In Vivo Testing Approach
复制标题
使用体内测试方法保证软件应用程序的质量
DOI：
10.1109/icst.2009.18
复制
发表时间：
2009
期刊：
影响因子：
--
通讯作者：
Matt Chu
中科院分区：
文献类型：
--
作者：
Christian Murphy;G. Kaiser;Ian Vo;Matt Chu
释放到现场的软件产品通常会在测试过程中未检测到或无法检测到的一些残留缺陷。这可能是测试案例本身缺陷的结果，在创建测试用例期间做出的错误假设，或者是测试复杂系统可能数量的可能配置数量的不可行性；这些缺陷也可能是由于实验室测试中未考虑的应用状态或由于违反安全性而可能出现的损坏状态。解决此问题的一种方法是即使在部署后，也要继续测试这些应用程序，以期找到剩余的缺陷。在本文中，我们提出了一种称为体内测试的测试方法，其中在部署环境中连续执行测试。我们还描述了一种我们称为体内测试的测试类型，该测试是专门设计用于使用这种方法的：这些测试在程序的当前状态内执行（而不是通过创建清洁的板岩），而不会影响或更改该状态最终用户的视角。我们讨论了称为邀请的Java应用程序的方法和原型测试框架。我们还提供了案例研究的结果，以证明邀请的有效性和效率。
Software products released into the field typically have some number of residual defects that either were not detected or could not have been detected during testing. This may be the result of flaws in the test cases themselves, incorrect assumptions made during the creation of test cases, or the infeasibility of testing the sheer number of possible configurations for a complex system; these defects may also be due to application states that were not considered during lab testing, or corrupted states that could arise due to a security violation. One approach to this problem is to continue to test these applications even after deployment, in hopes of finding any remaining flaws. In this paper, we present a testing methodology we call in vivo testing, in which tests are continuously executed in the deployment environment. We also describe a type of test we call in vivo tests that are specifically designed for use with such an approach: these tests execute within the current state of the program (rather than by creating a clean slate) without affecting or altering that state from the perspective of the end-user. We discuss the approach and the prototype testing framework for Java applications called Invite. We also provide the results of case studies that demonstrate Invite's effectiveness and efficiency.