EAGER: Measuring Real World Application Performance on Next-Generation Computing Systems

EAGER：测量下一代计算系统上的实际应用程序性能

• 批准号: 1842623
• 负责人: Robert Henschel
• 金额: $ 30万
• 依托单位: Indiana University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-10-01 至 2021-03-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1842623&HistoricalAwards=false
• 关键词: EAGER; Measuring; Real; World; Application

The project proposes to create a benchmark suite using real-world scientific applications. The benchmark suite will be developed jointly with the High-Performance Group (HPG) of the Standard Performance Evaluation Corporation (SPEC), a non-profit organization with the goal of creating and maintaining standardized benchmarks to evaluate performance and energy efficiency for the newest generation of computing systems. The project will leverage SPEC infrastructure to ensure continuous maintenance of the benchmark suite, as well as support for result submission, review, and publication on the SPEC website. Furthermore, the project will use the published results of the benchmark suite to create a public ranking of High-Performance Computing (HPC) systems deployed across the world. Partnership with SPEC will ensure that the results of the project will be disseminated to industry.The creation of a new real-world application benchmark suite jointly with SPEC/HPG, as well as the development of performance metrics suitable for application benchmarks, will lead to improved HPC system design and enable the better understanding of how next-generation computing systems must evolve. In addition to evaluating HPC systems, the proposed application benchmark suite will also enable the comparative performance evaluation of novel software and hardware ecosystems. Moreover, the proposed work builds on NSF investment in domain science application development by including these applications in the suite. Importantly, the project will be an opportunity to bring the benchmark community together to develop and define performance and throughput metrics for real world scientific applications. Finally, the project will deliver a benchmark suite that will be freely available to non-profit organizations and sustained by SPEC.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该项目建议使用真实世界的科学应用程序创建一个基准套件。该基准套件将与标准性能评估公司（SPEC）的高性能小组（HPG）联合开发，该公司是一家非营利组织，其目标是创建和维护标准化基准，以评估最新一代计算系统的性能和能效。该项目将利用SPEC基础设施来确保基准套件的持续维护，以及对结果提交、审查和在SPEC网站上发布的支持。此外，该项目还将使用已发布的基准测试结果，对部署在世界各地的高性能计算（HPC）系统进行公开排名。与SPEC/HPG合作创建一个新的实际应用基准套件，以及开发适用于应用基准的性能指标，将改进HPC系统设计，并使人们更好地了解下一代计算系统必须如何发展。除了评估HPC系统外，拟议的应用程序基准套件还将对新型软件和硬件生态系统进行比较性能评估。 此外，拟议的工作建立在NSF投资领域科学应用程序开发，包括这些应用程序的套件。重要的是，该项目将是一个机会，将基准社区聚集在一起，为真实的世界科学应用开发和定义性能和吞吐量指标。最后，该项目将提供一个基准套件，将免费提供给非营利组织，并由SPEC维持。该奖项反映了NSF的法定使命，并已被认为是值得通过使用基金会的知识价值和更广泛的影响审查标准进行评估的支持。