Collaborative Research: ST-HEC: Scalable, Interoperable Tools to Support Autonomic Optimization of High-End Applications

超大规模系统对应用程序设计人员提出了新的挑战。当前的软件开发技术在这些系统上的执行效率，或者更重要的是，在程序员花费在编写、调试和调优软件上的时间量方面不能很好地扩展。要实现极值计算，我们必须提高程序员的生产率。为此，我们需要在这些系统的编程范例方面取得三个进展。首先，应用程序程序员必须在高于进程或执行线程的级别与开发环境交互。工具必须支持这些交互模式和更抽象的应用程序视图。其次，必须存在系统监控功能，以便向应用程序程序员提供有关整体系统性能的反馈。监控一个极端规模的系统必须包括一定程度的自动化，并且必须能够从一小部分监控点推断出整体性能。必须对反馈进行压缩，以突出程序员要求的高抽象级别的性能问题。最后，许多低级优化决策必须通过结合针对全局程序行为的新一代编译器优化来实现自动化，并且这些优化必须与监控系统紧密集成。这些进展统称为自主性能优化。我们建议的研究通过开发新工具和扩展现有工具来管理大型软件项目来满足这些需求。我们将把我们之前在性能检测和分析工具的Tau框架上的工作扩展到这些HEC应用程序所使用的规模。为此，我们将加入一个新的框架，用于监视具有代表性的“骨架”，该框架可以通过使用与整个应用程序的执行配置文件匹配的更简单的模型，向程序员提供有关总体系统性能的信息。框架的性能建模是通过在系统中的战略位置放置配置文件监视器来实现的。我们将利用先进的机器学习技术来确定这些监控点的位置，并将产生的大量性能信息合成为适合应用程序设计人员的形式。最后，我们将通过将配置文件数据直接提供给编译器和动态代码翻译器来自动化一些关键的低级别设计决策。这些优化开发了目标数据布局、整个系统中的数据复制和动态数据移动。优化数据管理将减少内存引用的平均访问延迟，减少处理器间和集群间网络的拥塞，同时将程序员从详细的数据放置决策中解放出来。该建议的智力优势在于作为HEC系统性能方法和工具集成的框架的自主性能优化的新范式。更广泛的影响既有技术上的，也有社会上的。最终，我们努力增强用于解决Grand Challenges科学计算问题的计算工具基础设施。然而，我们认为，这必须与大规模计算的发展相关联，以使用内省的、自主的平台和系统。我们的工作将使从业者能够更轻松地构建高效、可伸缩的应用程序，解决非常大和复杂的问题，并比目前可行的更快地做到这一点。应用程序编写者生产率的显著提高不仅将促进对我们的国家基础设施重要的科学应用程序的开发，而且还将使HEC向重要的经济和社会应用程序开放，在这些应用程序中，计算正在推动科学和技术的发展。

Extremely large scale systems offer a new challenge to application designers. Current software development techniques do not scale well in execution efficiency on these systems or, more importantly, in the amount of time the programmer spends writing, debugging, and tuning the software. To realize extreme-scale computing, we must increase programmer productivity. To that end, we require three advances in the programming paradigm for these systems. First, the application programmer must interact with the development environment at a level higher than processesor execution threads. Tools must support these interaction modes and more abstract application views. Second, system monitoring functions must exist to provide feedback to the application programmer on overall system performance. Monitoring an extreme-scale system must include some degree of automation and must be able to infer overall performance from a small set of monitoring points. Feedback must be compressed to highlight performance issues at the high abstraction level the programmer requires. Finally, many low-level optimization decisions must be automated by incorporating a new generation of compiler optimizations targeting global program behavior, andthese must be intimately integrated with the monitoring system. These advances are described collectively as autonomic performance optimization.Our proposed research addresses these requirements by developing new tools and extending current tools to manage large software projects. We will extend our prior work on the Tau framework of performance instrumentation and analysis tools to the scale used by these HEC applications. To do this, we will incorporate a new framework for monitoring representative "skeletons" that can provide information to the programmer about total system performance by using a simpler model that matches the execution profile of the full application. Performance modeling of the skeleton is achieved by placement of profile monitors at strategic points in the system. We will utilize advancedmachine learning techniques to determine the placement of these monitor points, as well as to synthesize the resulting large quantity of performance information into the proper form for the application designer. Finally, we will automate some critical low-level design decisions by feeding profile data directly to the compiler and dynamic code translator. The optimizations developed target data layout, data duplication throughout the system, and dynamic data movement. Optimizing data management will decrease average access latency for memory references, reducing congestion on the inter-processor and inter-cluster networks while freeing the programmer from making detailed data placement decisions.The intellectual merit of this proposal is in the new paradigm of autonomic performance optimization as a framework for the integration of performance methods and tools for HEC systems. The broader impact is both technical and societal. Ultimately, we strive to enhance the computational tool infrastructure used to solve Grand Challenge scientific computing problems. However, we believe this must be done in association with the evolution of large-scale computing to use introspective, autonomic platforms and systems. Our work will enable practitioners to more easily build efficient, scalable applications, to solve very large and complex problems, and to do so more quicklythan is currently feasible. The significant increase in the productivity of applications writers will not only enhance the development of scientific applications important to our national infrastructure, but will also open HEC to important economic and societal applications where computing is advancing science and technology.