Visual Characterization of I/O System Behavior for High-End Computing

现代超级计算机是由大量核心、磁盘存储系统和I/O转发节点组成的复杂的层次化系统。这些数字持续增长，对工具了解系统软件行为的需求变得至关重要：没有这些工具，就不可能有效地调优该软件，而应用程序也无法达到高度的效率。该项目解决了在超大规模计算平台上理解复杂系统软件的行为的挑战，如当前的千万亿级计算机。特别是，该项目正在开发软件基础设施，以提供I/O系统软件的端到端分析和可视化。具体地说，目标是开发、改进和部署(1)集成到I/O系统(MPI-IO、I/O转发和文件系统)中的端到端可扩展跟踪；(2)用于检查跟踪和提取知识的信息可视化工具；(3)测试驱动该系统生成示例模式的组件，包括生成异常的组件；以及(4)用于帮助其他系统软件开发人员将该分析和可视化系统合并到其生产软件中的教程和工具。本项目开发的软件和技术将直接适用于在大型系统上执行复杂交互的其他系统软件库，并对其有用。欲了解更多信息，请访问项目网站：http://vis.cs.ucdavis.edu/NSF/Jupiter

Abstract Modern supercomputers are complex, hierarchical systems consisting of huge numbers of cores, systems for disk storage, and nodes for I/O forwarding. These numbers continue to grow and the need for tools to understand the behavior of the system software becomes paramount: without these tools it is impossible to effectively tune that software, and high degrees of efficiency is unattainable by applications. This project addresses the challenge of understanding the behavior of complex system software on very large-scale compute platforms, like the current petascale computers. In particular, this project is developing software infrastructure to provide end-to-end analysis and visualization of I/O system software. Specifically, the objectives are to develop, improve, and deploy (1) end-to-end, scalable tracing integrated into the I/O system (MPI-IO, I/O forwarding, and file system); (2) information visualization tools for inspecting traces and extracting knowledge; (3) testing components that drive this system to generate example patterns, including a component to generate anomalies; and (4) tutorials and tools for helping other system software developers incorporate this analysis and visualization system into their production software. The software and techniques developed in this project will be directly applicable to and useful in other system software libraries which perform complex interactions on large systems. For further information see the project web site at the URL: http://vis.cs.ucdavis.edu/NSF/Jupiter