SI2-SSE: PAPI Unifying Layer for Software-Defined Events (PULSE)

SI2-SSE：软件定义事件的 PAPI 统一层 (PULSE)

• 批准号: 1642440
• 负责人: Anthony Danalis
• 金额: $ 50万
• 依托单位: University of Tennessee Knoxville
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-11-01 至 2020-10-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1642440&HistoricalAwards=false
• 关键词: SI2; SSE; PAPI; Unifying; Layer

Leading scientific domains, such as physics, chemistry, climate science, and advanced materials design, utilize high-performance computing (HPC) to understand and solve problems of unprecedented complexity. Overcoming such challenges requires the ability to perform advanced scientific and engineering simulations, and to analyze the extreme amount of data these computer models involve. But the ever increasing scale of these problems also means that the complexity of software systems needed to address them is rising, and this fact raises new challenges for the scientific application communities that require HPC in order to achieve their goals. In particular, HPC application developers who want to understand the performance characteristics of their application had previously been able to monitor the way it interacted with the underlying hardware, but they had no access to a standardized way of accessing the behavior of the complex software stack that their application depends on. The PULSE project will fill this major software infrastructure gap. It offers an integrated solution that enables different layers of a complex software stack to communicate with one another and provide information about their internal behavior. Thus, PULSE makes it possible for the scientific applications of the future to harness ever increasing amounts of computing power, despite anticipated increases in the complexity of both future hardware and software technologies. By providing the infrastructure that developers need in order to achieve an analytical understanding of the behavior of whole programs, it will substantially improve the insight computational scientists have into how various modern software systems interact with one another and the underlying hardware technologies. 
The abstraction and standardization layer provided by the Performance Application Programming Interface (PAPI) has played a critical role in enabling application profiling for over a decade. It has enabled performance conscious developers to gain insights about their application by simply instrumenting their code using a handful of PAPI functions that interoperate across different hardware substrates. At the same time, the abstraction layer offered by PAPI has enabled sophisticated profiling toolkits to focus on combining, organizing and visualizing information in a way that is useful to the end user, instead of re-implementing the hardware access layer for every new platform that comes to market. However, this abstraction layer that PAPI offers has been limited to profiling information generated by hardware. Information regarding the behavior of the software stack underneath the application that is being profiled has to be acquired either through low level binary instrumentation, or through custom APIs. Now, through this PULSE project, abstraction and unification layer for profiling software events has emerged. PULSE will extend the abstraction and unification layer that PAPI has provided to hardware events to also encompass software events. On one end, it will provide a standard, well defined and well documented API that high level profiling software can utilize to acquire and present to application developers performance information about the libraries used by their application. On the other end, it will provide standard APIs that library and runtime writers can utilize to communicate to higher software layers information about the behavior of their software. The project is expected to have a direct influence on the state of the art in whole program profiling and understanding. The success of PULSE will substantially improve the insight of computational scientists and engineers into the way that different modules of modern software interact with one another and the underlying hardware. Broadening the applicability of PAPI, as proposed under PULSE, is expected to dramatically increase PAPI's impact in this area.

物理、化学、气候科学和先进材料设计等领先的科学领域利用高性能计算 (HPC) 来理解和解决前所未有的复杂问题。克服这些挑战需要能够执行先进的科学和工程模拟，并分析这些计算机模型涉及的大量数据。但这些问题的规模不断扩大也意味着解决这些问题所需的软件系统的复杂性正在上升，这一事实给需要 HPC 来实现其目标的科学应用社区带来了新的挑战。特别是，想要了解其应用程序性能特征的 HPC 应用程序开发人员以前能够监控其与底层硬件交互的方式，但他们无法使用标准化方法来访问其应用程序所依赖的复杂软件堆栈的行为。 PULSE 项目将填补这一主要的软件基础设施空白。它提供了一种集成解决方案，使复杂软件堆栈的不同层能够相互通信并提供有关其内部行为的信息。因此，尽管未来硬件和软件技术的复杂性预计会增加，但 PULSE 使未来的科学应用能够利用不断增加的计算能力。通过提供开发人员所需的基础设施来实现对整个程序行为的分析理解，它将大大提高计算科学家对各种现代软件系统如何相互交互以及底层硬件技术的洞察力。十多年来，性能应用程序编程接口 (PAPI) 提供的抽象和标准化层在实现应用程序分析方面发挥了关键作用。它使注重性能的开发人员能够通过使用少量跨不同硬件底层互操作的 PAPI 函数来简单地检测其代码，从而获得有关其应用程序的见解。同时，PAPI 提供的抽象层使复杂的分析工具包能够专注于以对最终用户有用的方式组合、组织和可视化信息，而不是为每个上市的新平台重新实现硬件访问层。然而，PAPI 提供的这个抽象层仅限于分析硬件生成的信息。有关正在分析的应用程序下的软件堆栈行为的信息必须通过低级二进制工具或自定义 API 来获取。现在，通过这个 PULSE 项目，用于分析软件事件的抽象和统一层已经出现。 PULSE 将扩展 PAPI 为硬件事件提供的抽象和统一层，以涵盖软件事件。一方面，它将提供一个标准的、定义良好且记录良好的 API，高级分析软件可以利用该 API 来获取并向应用程序开发人员提供有关其应用程序所使用的库的性能信息。另一方面，它将提供标准 API，库和运行时编写者可以利用这些 API 向更高的软件层传达有关其软件行为的信息。该项目预计将对整个程序分析和理解的最新技术产生直接影响。 PULSE 的成功将极大地提高计算科学家和工程师对现代软件不同模块之间以及底层硬件交互方式的洞察力。正如 PULSE 所提议的那样，扩大 PAPI 的适用性预计将显着提高 PAPI 在该领域的影响。

项目成果

PAPI Software-Defined Events for in-Depth Performance Analysis

用于深入性能分析的 PAPI 软件定义事件

• 发表时间: 2019
• 期刊: International journal of high performance computing applications
• 影响因子: 3.1
• 作者: Jagode, H.

Software-Defined Events through PAPI

通过 PAPI 的软件定义事件

• 发表时间: 2019
• 期刊: 24th International Workshop on High-Level Parallel Programming Models and Supportive Environments (HIPS
• 作者: Danalis, A.