Towards A Better Understanding of Workload Dynamics on Data-Intensive Clusters and Grids
Towards A Better Understanding of Workload Dynamics on Data-Intensive Clusters and Grids
复制标题
更好地理解数据密集型集群和网格上的工作负载动态
DOI：
--
复制
发表时间：
2007
期刊：
影响因子：
--
通讯作者：
L. Wolters
中科院分区：
文献类型：
--
作者：
Hui Li;L. Wolters
This paper presents a comprehensive statistical analysis of workloads collected on data-intensive clusters and grids. The analysis is conducted at different levels, including virtual organization (VO) and user behavior. The aggregation procedure and scaling analysis are applied to job arrival processes, leading to the identification of several basic patterns, namely, pseudo-periodicity, long range dependence (LRD), and (multi)fractals. It is shown that statistical measures based on interarrivals are of limited usefulness and count based measures should be trusted instead when it comes to correlations. We also study workload characteristics like job run time, memory consumption, and cross correlations between these characteristics. A "bag-of-tasks" behavior is empirically proved, strongly indicating temporal locality. We argue that pseudo-periodicity, LRD, and "bag-of-tasks" behavior are important workload properties on data-intensive clusters and grids, which are not present in traditional parallel workloads. This study has important implications on workload modeling and performance predictions in data-intensive grid environments.
