OAC Core: Cost-Adaptive Monitoring and Real-Time Tuning at Function-Level

该项目旨在通过开发一种工具来解决超级计算机上性能监控的挑战，该工具可以以最小的开销提供功能级的洞察力，从而实现应用程序的实时调优。该倡议解决了理解不同科学领域内计算实践的差距，从而有助于系统设计和数字库优化的知情决策。这一进展有望提高现有超级计算基础设施的效率，并通过支持科学进步和教育多样性为NSF的使命做出贡献，最终催化更广泛的科学突破。该项目旨在改进高性能计算中的性能监控。它旨在解决科学研究、工程、大数据和人工智能应用日益复杂和多样化的问题。该方法包括通过动态二进制检测实现功能级监视，并使用心跳机制管理监视开销。此外，它还集成了实时调优功能，用于在运行时优化数字库。这项工作旨在显著提高传统的作业级资源利用监控工具。该研究将确定标准函数调用，评估仪器开销，并开发和验证控制开销和准确性的策略。它还将涉及创建用于评估实时调优的性能基准。这个项目的智力价值源于它提供了一种新的工具的潜力，该工具提供了更精确的应用程序行为解析，并支持实时性能调优。通过在大型计算平台的功能层面引入自适应监控和实时调优，本项目旨在加速科学进步。此外，它通过积极让代表性不足的少数群体参与进来，促进多样性和包容性，为高性能计算领域更加多样化和熟练的劳动力做出贡献。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

This project aims to address the challenge of performance monitoring on supercomputers by developing a tool that provides function-level insights with minimal overhead, enabling real-time tuning of applications. The initiative addresses the gap in understanding computational practices within diverse scientific domains, thus aiding in informed decision-making for system design and numerical library optimization. This advancement promises to enhance the efficiency of existing supercomputing infrastructures and contributes to the NSF's mission by supporting scientific progress and educational diversity, ultimately catalyzing a broader spectrum of scientific breakthroughs.This project is designed to improve performance monitoring within high-performance computing. It aims to address the increasing complexity and diversity of applications spanning scientific research, engineering, big data, and artificial intelligence. The approach involves implementing function-level monitoring through dynamic binary instrumentation and managing the monitoring overhead with a heartbeat mechanism. Additionally, it integrates real-time tuning capabilities for optimizing numerical libraries at runtime. This endeavor seeks to enhance traditional job-level resource utilization monitoring tools significantly. The research will identify standard function calls, evaluate the instrumentation overhead, and develop and validate policies for controlling overhead and accuracy. It will also involve creating a performance benchmark for assessing real-time tuning. The intellectual merit of this project stems from its potential to provide a novel tool that offers a more precise resolution of application behaviors and enables real-time performance tuning. By introducing adaptive monitoring and real-time tuning at the function level for large computational platforms, this project aims to accelerate scientific progress. Furthermore, it promotes diversity and inclusivity by actively involving underrepresented minority groups, contributing to a more diverse and skilled workforce in high-performance computing.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.