SHF:Small: Collaborative Research: Understanding, Modeling, and System Support for HPC Data Reduction

SHF:Small：协作研究：HPC 数据缩减的理解、建模和系统支持

• 批准号: 1812861
• 负责人: Qing Liu
• 金额: $ 25.9万
• 依托单位: New Jersey Institute of Technology
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-07-01 至 2023-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1812861&HistoricalAwards=false
• 关键词: SHF; Small; Collaborative; Research; Understanding

High-performance computing (HPC) enables high fidelity science missions that capture microscopic phenomena that were impossible to study in the past. In order to allow science missions to be accomplished in a timely manner, it is critical to manage the massive datasets that HPC generates in efficient way so that the time to knowledge can be shortened. This project aims to understand the role and usage of data reduction in large computational applications. Research and educational opportunities are provided to train a new generation of computer scientists and engineers, particularly those under-represented groups, to ensure the U.S. competitiveness in high-performance computing. The goal of this project is to address a number of critical gaps in using data reduction for HPC-based science missions. In particular, 1) the impact of reduction error on scientific discovery is mathematically and experimentally studied; 2) analytical models are formulated to estimate the reduction performance, without forcing users to compress the full data. For data-intensive applications, having this capability is important so that domain scientists do not have to go through the cumbersome trial-and-error process to figure out what reduction can offer; 3) the project provides potentially more efficient data analysis and reduction capabilities for exascale computing. The integrated research activities in this NSF project will significantly improve the understanding and usage of data reduction on future systems.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

高性能计算（HPC）使高保真的科学任务，捕捉微观现象，是不可能在过去的研究。为了使科学任务能够及时完成，以有效的方式管理HPC生成的大量数据集至关重要，以便缩短获得知识的时间。这个项目的目的是了解在大型计算应用程序中数据简化的作用和使用。提供研究和教育机会，以培养新一代的计算机科学家和工程师，特别是那些代表性不足的群体，以确保美国在高性能计算方面的竞争力。 该项目的目标是解决在基于HPC的科学任务中使用数据缩减的一些关键差距。具体而言，1）在数学和实验上研究了归约误差对科学发现的影响; 2）制定了分析模型来估计归约性能，而无需强制用户压缩完整数据。对于数据密集型应用程序，拥有这种能力很重要，这样领域科学家就不必通过繁琐的试错过程来找出减少可以提供什么; 3）该项目为exascale计算提供了潜在的更有效的数据分析和减少能力。NSF项目中的综合研究活动将显著提高对未来系统数据简化的理解和使用。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Taming I/O Variation on QoS-Less HPC Storage: What Can Applications Do?

控制无 QoS HPC 存储上的 I/O 变化：应用程序可以做什么？

• DOI: 10.1109/sc41405.2020.00015
• 发表时间: 2020
• 期刊: 2020.
• 作者: Qiao, Zhenbo;Liu, Qing;Podhorszki, Norbert;Klasky, Scott;Chen, Jieyang
• 通讯作者: Chen, Jieyang

High-Ratio Lossy Compression: Exploring the Autoencoder to Compress Scientific Data

• DOI: 10.1109/tbdata.2021.3066151
• 发表时间: 2023-02
• 期刊: IEEE Transactions on Big Data
• 影响因子: 7.2
• 作者: Tong Liu;Jinzhen Wang;Qing Liu;Shakeel Alibhai;Tao Lu;Xubin He

Can I/O Variability Be Reduced on QoS-Less HPC Storage Systems?

• DOI: 10.1109/tc.2018.2881709
• 发表时间: 2019-05
• 期刊: IEEE Transactions on Computers
• 影响因子: 3.7
• 作者: Dan Huang;Qing Liu;J. Choi;N. Podhorszki;S. Klasky;Jeremy S. Logan;G. Ostrouchov;Xubin He;M. Wolf

zMesh: Exploring Application Characteristics to Improve Lossy Compression Ratio for Adaptive Mesh Refinement

• DOI: 10.1109/ipdps49936.2021.00048
• 发表时间: 2021-05
• 期刊: 2021 IEEE International Parallel and Distributed Processing Symposium (IPDPS)
• 作者: Huizhang Luo;Junqi Wang;Qing Liu;Jieyang Chen;S. Klasky;N. Podhorszki

Estimating Lossy Compressibility of Scientific Data Using Deep Neural Networks

使用深度神经网络估计科学数据的有损压缩性

• DOI: 10.1109/locs.2020.2971940
• 发表时间: 2020
• 期刊: IEEE Letters of the Computer Society
• 作者: Qin, Zhenlu;Wang, Jinzhen;Liu, Qing;Chen, Jieyang;Pugmire, Dave;Podhorszki, Norbert;Klasky, Scott
• 通讯作者: Klasky, Scott