An empirical study of profiling strategies for released software and their impact on testing activities
An empirical study of profiling strategies for released software and their impact on testing activities
复制标题
已发布软件的分析策略及其对测试活动的影响的实证研究
DOI：
10.1145/1007512.1007522
复制
发表时间：
2004
期刊：
影响因子：
--
通讯作者：
M. Hardojo
中科院分区：
文献类型：
--
作者：
Sebastian G. Elbaum;M. Hardojo
了解软件在该领域的使用方式可以为质量改进提供许多机会。分析发布的软件可以提供这样的理解。然而，由于必须分析的潜在大量部署站点、极高的透明度期望以及远程数据收集和部署管理过程，分析发布的软件是困难的。研究人员最近提出了各种方法来利用这些机会并克服这些挑战。初步研究表明，这些方法的应用，并已显示其可行性。尽管如此，所提出的有希望的方法，以及开销、准确性和测试活动的潜在好处之间的权衡，几乎没有被量化。本文旨在克服这些局限性。我们的分析1200个用户会话的155 KALLESS系统证实了现场数据的能力，以支持测试套件的改进，量化不同的方法，以前孤立地介绍，并评估效率的分析技术发布的软件和有效性，其相关的测试工作。
An understanding of how software is employed in the field can yield many opportunities for quality improvements. Profiling released software can provide such an understanding. However, profiling released software is diffcult due to the potentially large number of deployed sites that must be profiled, the extreme transparency expectations, and the remote data collection and deployment management process. Researchers have recently proposed various approaches to tap into the opportunities and overcome those challenges. Initial studies have illustrated the application of these approaches and have shown their feasibility. Still, the promising proposed approaches, and the tradeoffs between overhead, accuracy, and potential benefits for the testing activity have been barely quantified. This paper aims to over-come those limitations. Our analysis of 1200 user sessions on a 155 KLOC system substantiates the ability of field data to support test suite improvements, quantifies different approaches previously introduced in isolation, and assesses the efficiency of profiling techniques for released software and the effectiveness of their associated testing efforts.