The Performance Cockpit Approach: A Framework For Systematic Performance Evaluations
The Performance Cockpit Approach: A Framework For Systematic Performance Evaluations
复制标题
DOI：
10.1109/seaa.2010.24
复制
发表时间：
2010-09
期刊：
影响因子：
--
通讯作者：
D. Westermann;J. Happe;Michael Hauck;Christian Heupel
中科院分区：
文献类型：
--
作者：
D. Westermann;J. Happe;Michael Hauck;Christian Heupel
评估软件系统的性能（定时行为、吞吐量和资源利用率）变得越来越具有挑战性，因为当今的企业应用程序是在现有软件（例如中间件、遗留应用程序和第三方服务）的基础上构建的。由于系统的性能受到系统每一层上的多种因素的影响，性能分析师需要对被测系统有详细的了解，并且必须使用大量的工具进行基准测试、监控和分析。在实践中，性能分析师试图通过关注某些方面、工具或技术来处理复杂性。然而，这些孤立的解决方案是低效的，由于小的重用和知识共享。本文提出的Performance Cockpit是一个框架，它通过提供一个灵活的、基于插件的体系结构，将性能工程、被测系统和分析知识封装在一个应用程序中。我们通过两个不同的案例研究证明了该框架的价值。
Evaluating the performance (timing behavior, throughput, and resource utilization) of a software system becomes more and more challenging as today’s enterprise applications are built on a large basis of existing software (e.g. middleware, legacy applications, and third party services). As the performance of a system is affected by multiple factors on each layer of the system, performance analysts require detailed knowledge about the system under test and have to deal with a huge number of tools for benchmarking, monitoring, and analyzing. In practice, performance analysts try to handle the complexity by focusing on certain aspects, tools, or technologies. However, these isolated solutions are inefficient due to the small reuse and knowledge sharing. The Performance Cockpit presented in this paper is a framework that encapsulates knowledge about performance engineering, the system under test, and analyses in a single application by providing a flexible, plug-in based architecture. We demonstrate the value of the framework by means of two different case studies.