An Exploratory Study of the State of Practice of Performance Testing in Java-Based Open Source Projects
An Exploratory Study of the State of Practice of Performance Testing in Java-Based Open Source Projects
复制标题
基于 Java 的开源项目性能测试实践现状的探索性研究
DOI：
10.1145/3030207.3030213
复制
发表时间：
2017
期刊：
影响因子：
--
通讯作者：
C. Bezemer
中科院分区：
文献类型：
--
作者：
P. Leitner;C. Bezemer
开源（OS）软件在许多行业中广泛使用。虽然操作系统项目的功能质量被认为与闭源软件相似，但在性能方面的质量还不清楚。操作系统开发人员面临的一个挑战是，与功能测试不同，性能测试缺乏公认的最佳实践。为了揭示操作系统项目中性能测试的实践状况，我们对GitHub上的111个基于Java的操作系统项目进行了探索性研究。我们从五个方面研究这些项目的性能测试：（1）开发人员，（2）规模，（3）测试组织，（4）性能测试的类型和（5）使用的工具。我们表明，编写性能测试是不是一个流行的任务，在操作系统项目：性能测试形式只有一小部分的测试套件，很少更新，通常是由一小群核心项目开发人员。此外，即使许多项目都意识到他们需要性能测试，开发人员似乎在努力实现它们。我们认为，未来的性能测试框架应该提供更好的支持低摩擦测试，例如通过非参数化的方法或性能测试生成，以及专注于与标准的持续集成工具的紧密集成。
The usage of open source (OS) software is wide-spread across many industries. While the functional quality of OS projects is considered to be similar to closed-source software, much is unknown about the quality in terms of performance. One challenge for OS developers is that, unlike for functional testing, there is a lack of accepted best practices for performance testing. To reveal the state of practice of performance testing in OS projects, we conduct an exploratory study on 111 Java-based OS projects from GitHub. We study the performance tests of these projects from five perspectives: (1) developers, (2) size, (3) test organization, (4) types of performance tests and (5) used tooling. We show that writing performance tests is not a popular task in OS projects: performance tests form only a small portion of the test suite, are rarely updated, and are usually maintained by a small group of core project developers. Further, even though many projects are aware that they need performance tests, developers appear to struggle implementing them. We argue that future performance testing frameworks should provider better support for low-friction testing, for instance via non-parameterized methods or performance test generation, as well as focus on a tight integration with standard continuous integration tooling.
软件开发过程中自动隔离性能回归的根本原因
DOI：
10.1145/2479871.2479879
发表时间：
2013
期刊：
影响因子：
--
作者：
Christoph Heger;Jens Happe;Roozbeh Farahbod
通讯作者：
Roozbeh Farahbod