Analyzing throughput and utilization on trestles
Analyzing throughput and utilization on trestles
复制标题
分析栈桥的吞吐量和利用率
DOI：
10.1145/2335755.2335802
复制
发表时间：
2012
期刊：
影响因子：
--
通讯作者：
Young, William S.
中科院分区：
文献类型：
--
作者：
Moore, Richard L.;Jundt, Adam;Carson, Leonard K.;Yoshimoto, Kenneth;Ghadersohi, Amin;Young, William S.
Trestles系统针对的是中等规模和网关用户，旨在通过保持良好的周转时间以及其他用户友好的功能（如长运行时间和用户预订）来提高用户的生产力。然而，保持良好吞吐量的目标与高系统利用率的目标竞争。本文分析了一年的栈桥业务的特点，利用率和吞吐量之间的经验关系，了解他们的关系，并通知分配和调度政策，以优化他们的权衡目标。利用率和吞吐量之间的相关性存在相当大的离散性，如扩展因子所测量的。在低利用率和高利用率下都存在良好吞吐量的时期，而在其他时期，吞吐量不仅在高利用率下而且甚至在低利用率下显著下降。然而，吞吐量持续下降，超过~90%的利用率。用户行为明显影响扩展因子度量：具有极端扩展因子的绝大多数作业与极少数用户相关联，这些用户（1）用许多作业淹没队列或（2）请求作业运行时间远远超过实际运行时间。虽然前者是用户的工作流选择，但后者清楚地展示了将请求时间与实际运行时间相匹配的好处。利用率和吞吐量指标来自XDMoD比较支架与其他两个XSEDE系统，游侠和海怪，具有不同的大小和分配/调度策略。在分析期间，Ranger和Kraken通常都具有更高的利用率，并且毫不奇怪，比支架具有更高的扩展系数。作为分析的结果，我们打算将目标分配比例从当前的70%增加到75- 80%，并强烈建议用户合理地匹配请求的运行时间和实际运行时间。
The Trestles system is targeted to modest-scale and gateway users, and is designed to enhance users' productivity by maintaining good turnaround time as well as other user-friendly features such as long run times and user reservations. However, the goal of maintaining good throughput competes with the goal of high system utilization. This paper analyzes one year of Trestles operations to characterize the empirical relationship between utilization and throughput, with the objectives of understanding their relationship, and informing allocations and scheduling policies to optimize their tradeoff. There is considerable scatter in the correlation between utilization and throughput, as measured by expansion factor. There are periods of good throughput at both low and high utilizations, while there are other periods when throughput degrades significantly not only at high utilization but even at low utilization. However, throughput consistently degrades above ~90% utilization. User behavior clearly impacts the expansion factor metrics: the great majority of jobs with extreme expansion factors are associated with a very small fraction of users who either (1) flood the queue with many jobs or (2) request job run times far in excess of actual run times. While the former is a user workflow choice, the latter clearly demonstrates the benefit of matching requested time to actual run time. Utilization and throughput metrics derived from XDMoD are compared for Trestles with two other XSEDE systems, Ranger and Kraken, with different sizes and allocation/scheduling policies. Both Ranger and Kraken have generally higher utilization and, not surprisingly, higher expansion factors than Trestles over the analysis period. As a result of this analysis, we intend to increase the target allocation fraction from the current 70% to ~75-80%, and strongly advise users to reasonably match requested run times to actual run times.
DOI：
--
发表时间：
2000
期刊：
Cluster Computing
影响因子：
--
作者：
P. Keleher;D. Zotkin;Dejan Perkovic
通讯作者：
Dejan Perkovic
Trestles：面向中等规模和网关用户的高生产率 HPC 系统
DOI：
--
发表时间：
2011
期刊：
TeraGrid Conference
影响因子：
--
作者：
Richard L. Moore;David L. Hart;W. Pfeiffer;M. Tatineni;Kenneth Yoshimoto;William S. Young
通讯作者：
William S. Young