Collaborative Research: Performance Toolset for Dynamic Optimization of High-End Hybrid Applications

协作研究：用于高端混合应用动态优化的性能工具集

• 批准号: 0444319
• 负责人: Danesh Tafti
• 金额: --
• 依托单位: Virginia Polytechnic Institute and State University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2004
• 资助国家: 美国
• 起止时间: 2004-11-01 至 2008-10-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0444319&HistoricalAwards=false
• 关键词: Collaborative; Research; Performance; Toolset; Dynamic

Current high-end applications usually exploit just a fraction of the theoretical performance of large platforms. Interactions among the hardware, system software, programming interface, and algorithm are extremely complex, and the implications for development of hybrid MPI+OpenMP Fortran/C/C++ applications are challenging. The emerging generation of machines will be even more complex, as will the applications that exploit them. Typical application development and tuning scenarios involve the manual and separate use of compilers and performance tools, and program modifications based upon insights laboriously gleaned from their output. In this proposal, we intend to raise the quality of the application development and tuning process by creating an integrated environment for program optimization that reduces the manual labor and guesswork of existing approaches. We will develop strategies and the corresponding interfaces that enable the application developer, compiler and performance tools to collaborate to generate optimized code based upon a variety of sources of feedback, including performance data from .offline. development runs as well as from .online. production runs. We will build and deploy a flexible, working system that combines robust, existing, open source software . a compiler, a program analysis tool and two performance tools with complementary features - into a single, coherent environment for collaborative static and dynamic application tuning. Application codes of varying complexity supplied by our application partner will motivate our development work as well as test and demonstrate our results. The result will be a powerful, integrated environment that can be used to obtain traditional performance data via program monitoring, event tracing and/or the extraction of hardware counter information, and to obtain support for the static or dynamic tuning of an application code. Intellectual Merit The proposed environment integrates several different existing technologies to provide a new level of support for optimizing hybrid MPI+OpenMP codes. Support for experimentation with the hybrid programming model is provided. The range of information that may be exploited by the compiler to optimize code is expanded to cover many system and application-level phenomena and a variety of optimization scenarios. Interactions between tools will facilitate the provision of an approach that is able to handle extreme-scale computations. Integration issues will be addressed with the goal of creating a deployable, extensible system. Broader Impacts The tools, ideas, and results of this project will be freely distributed and made available to the HPC community, nationally and internationally. Besides the general dissemination of results, the project has strong ties to performance engineering experts at NCSA. The tools will be installed on NCSA systems for testing and evaluation and will be made available to other users. The research brings together compiler, performance tool, and application developers, enriching the research experience of graduate students to create a well-rounded IT workforce. The PI is active in the OpenMP community and the project team has close working relationships with DOE and DOD. New knowledge generated will be integrated into advanced graduate coursework.

当前的高端应用程序通常只利用大型平台理论性能的一小部分。硬件、系统软件、编程接口和算法之间的交互非常复杂，对MPI+ OpenMPFortran/C/C++混合应用程序的开发具有挑战性。新一代的机器将更加复杂，利用它们的应用程序也将更加复杂。典型的应用程序开发和调优场景涉及手动和单独使用编译器和性能工具，以及基于从其输出中辛苦收集的见解进行程序修改。 在这个提案中，我们打算通过创建一个集成的环境，减少现有方法的手工劳动和猜测，以提高应用程序开发和调优过程的质量。我们将开发策略和相应的接口，使应用程序开发人员，编译器和性能工具协作，以根据各种反馈来源（包括来自. offline的性能数据）生成优化的代码。开发从. online运行得很好。生产运行。我们将构建和部署一个灵活的工作系统，该系统结合了强大的现有开源软件。一个编译器，一个程序分析工具和两个具有互补功能的性能工具-整合到一个单一的、一致的环境中，用于协作的静态和动态应用程序调优。我们的应用程序合作伙伴提供的不同复杂性的应用程序代码将激励我们的开发工作，以及测试和展示我们的结果。 其结果将是一个功能强大的集成环境，可用于通过程序监视、事件跟踪和/或硬件计数器信息的提取来获得传统的性能数据，并获得对应用程序代码的静态或动态调优的支持。 智力优点所提出的环境集成了几种不同的现有技术，为优化混合MPI+OpenMP代码提供了一个新的支持水平。支持实验的混合编程模型。可以被编译器利用来优化代码的信息的范围被扩展以覆盖许多系统和应用级现象以及各种优化场景。工具之间的相互作用将有助于提供一种能够处理极端规模计算的方法。 集成问题将以创建可部署、可扩展的系统为目标来解决。 更广泛的影响本项目的工具、想法和成果将免费分发并提供给国内和国际的HPC社区。除了一般性传播成果外，该项目还与国家能力自评局的性能工程专家有着密切的联系。这些工具将安装在国家能力自评系统上，供测试和评估之用，并将提供给其他用户。这项研究汇集了编译器，性能工具和应用程序开发人员，丰富了研究生的研究经验，创造了一个全面的IT劳动力。PI在OpenMP社区中非常活跃，项目团队与DOE和DOD有着密切的工作关系。产生的新知识将被纳入高级研究生课程。