A Cloud Benchmark Suite Combining Micro and Applications Benchmarks
A Cloud Benchmark Suite Combining Micro and Applications Benchmarks
复制标题
结合微观和应用程序基准的云基准套件
DOI：
--
复制
发表时间：
2018
期刊：
影响因子：
--
通讯作者：
P. Leitner
中科院分区：
文献类型：
--
作者：
Joel Scheuner;P. Leitner
微观和应用性能基准测试通常用于指导云服务选择。然而，它们往往在一种难以重现的设置中被孤立地考虑，并且执行策略存在缺陷。本文提出了一种新的执行方法，将微观和应用基准测试组合成一个名为RMIT Combined的基准测试套件，将该套件集成到一个自动化的云基准测试环境中，并实施了一种可重复的执行策略。此外，还贡献了一个新设计的具有三种不同负载场景的Web服务基准测试，称为WPBench。在亚马逊EC2云中的一个案例研究表明，对于Web服务基准测试WPBench，选择一种具有成本效益的实例类型可以同时实现性能提高40%且成本降低40%。与先前的研究相反，我们的研究结果表明网络性能不再有显著差异。我们的结果还显示，对于I/O密集型工作负载，选择一种现代类型的虚拟化可以将磁盘利用率提高多达10%。
Micro and application performance benchmarks are commonly used to guide cloud service selection. However, they are often considered in isolation in a hardly reproducible setup with a flawed execution strategy. This paper presents a new execution methodology that combines micro and application benchmarks into a benchmark suite called RMIT Combined, integrates this suite into an automated cloud benchmarking environment, and implements a repeatable execution strategy. Additionally, a newly crafted Web serving benchmark called WPBench with three different load scenarios is contributed. A case study in the Amazon EC2 cloud demonstrates that choosing a cost-efficient instance type can deliver up to 40% better performance with 40% lower costs at the same time for the Web serving benchmark WPBench. Contrary to prior research, our findings reveal that network performance does not vary relevantly anymore. Our results also show that choosing a modern type of virtualization can improve disk utilization up to 10% for I/O-heavy workloads.