Replicating HPC I/O Workloads with Proxy Applications

Replicating HPC I/O Workloads with Proxy Applications
复制标题

使用代理应用程序复制 HPC I/O 工作负载

DOI:
--
复制
发表时间:
2016
期刊:
2016 1st Joint International Workshop on Parallel Data Storage and data Intensive Scalable Computing Systems (PDSW-DISCS)
影响因子:
--
通讯作者:
S. Jarvis
S. Jarvis
中科院分区:
--
文献类型:
--
作者:
J. Dickson;Steven A. Wright;S. Maheswaran;Andy Herdman;Mark C. Miller;S. Jarvis

文献摘要

被引文献

相似文献

大规模仿真性能依赖于许多组件,然而,调查和优化的任务长期以来一直倾向于I/O之上的计算和通信元件。从父应用程序中手动提取I/O行为模式是解决每个应用程序性能问题的有效方法,但是开发具有一定程度自动化和灵活性的工作流可以提供更强大的方法来解决当前和未来的I/O挑战。在本文中,我们描述了一个工作负载复制工作流,提取的I/O模式的应用程序,并重新创建其行为与灵活的代理应用程序。我们演示了如何简单的轻量级表征可以被翻译为提供一个物理应用程序的有效表示,并显示如何代理复制可以被用作调查I/O库范例的工具。
Large scale simulation performance is dependent on a number of components, however the task of investigation and optimization has long favored computational and communication elements above I/O. Manually extracting the pattern of I/O behavior from a parent application is a useful way of working to address performance issues on a per-application basis, but developing workflows with some degree of automation and flexibility provides a more powerful approach to tackling current and future I/O challenges. In this paper we describe a workload replication workflow that extracts the I/O pattern of an application and recreates its behavior with a flexible proxy application. We demonstrate how simple lightweight characterization can be translated to provide an effective representation of a physics application, and show how a proxy replication can be used as a tool for investigating I/O library paradigms.