To share or not to share: comparing burst buffer architectures

To share or not to share: comparing burst buffer architectures
复制标题

共享还是不共享:比较突发缓冲区架构

DOI:
--
复制
发表时间:
2017
期刊:
Spring Simulation Multiconference
影响因子:
--
通讯作者:
John Bent
John Bent
中科院分区:
--
文献类型:
--
作者:
Lei Cao;Bradley W. Settlemyer;John Bent

文献摘要

被引文献

相似文献

现代高性能计算平台采用突发缓冲区来克服限制大规模并行计算的规模和效率的I/O瓶颈。目前存在两种竞争的突发缓冲器架构。一种是将突发缓冲区作为专用的共享资源,另一种是将突发缓冲区硬件集成到每个计算节点中。在本文中,我们研究了设计权衡与本地和共享,专用突发缓冲区架构,通过建模。通过为我们的模拟提供真实的工作负载,我们能够系统地评估这两种设计的性能。我们的研究验证了以前的结果,表明没有奇偶校验保护的存储系统可以减少解决方案的总体时间,并进一步确定共享突发缓冲区组织可以导致平均应用程序I/O吞吐量比本地突发缓冲区配置高3.5倍。
Modern high performance computing platforms employ burst buffers to overcome the I/O bottleneck that limits the scale and efficiency of large-scale parallel computations. Currently there are two competing burst buffer architectures. One is to treat burst buffers as a dedicated shared resource, The other is to integrate burst buffer hardware into each compute node. In this paper we examine the design tradeoffs associated with local and shared, dedicated burst buffer architectures through modeling. By seeding our simulation with realistic workloads, we are able to systematically evaluate the resulting performance of both designs. Our studies validate previous results indicating that storage systems without parity protection can reduce overall time to solution, and further determine that shared burst buffer organizations can result in a 3.5× greater average application I/O throughput compared to local burst buffer configurations.