CAREER: Towards Full-Stack Crash Consistency

职业生涯：实现全栈崩溃一致性

• 批准号: 1943204
• 负责人: Mai Zheng
• 金额: $ 51.24万
• 依托单位: Iowa State University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-09-01 至 2025-08-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1943204&HistoricalAwards=false
• 关键词: CAREER; Towards; Full; Stack; Crash

Storage systems are an essential component of modern computers. The enormous data generated every day (e.g., financial transactions, scientific computations) make the robustness of all hardware and software layers in storage systems increasingly important. When facing unexpected crash events (e.g., power outage, operating system panic), a robust system must handle the crashes gracefully and maintain crash consistency, which is extremely difficult to achieve in practice due to the system complexity. This project takes a holistic view to analyze the crash consistency of diverse storage systems. It takes into account the hardware characteristics, the interactions between software layers (e.g., device drivers, file systems, key-value stores), and the lifecycle of system execution (e.g., normal execution paths and recovery code paths) to ensure the completeness, and leverages virtualization to minimize the disturbance for high fidelity.This project hopes to advance the robustness of storage systems that serve as a fundamental building block of modern society. For financial institutions where one minute downtime may lead to millions of dollars lost, such improved robustness is valuable; for scientific exploration where any piece of data may advance human knowledge, the benefit is immeasurable. The full-stack approach is expected to stimulate synergistic research in computer architecture, operating systems, databases, software engineering, disaster response, etc., and will benefit a wide range of practitioners including hardware manufacturers, software developers, and system administrators. Moreover, by collaborating with multiple experts in education and entrepreneurship, the project will spur curriculum development and industry collaboration, promote open source and reproducibility, and broaden participation.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

存储系统是现代计算机的重要组成部分。每天产生的大量数据（例如，金融交易、科学计算）使得存储系统中所有硬件和软件层的鲁棒性变得越来越重要。当面临意外的崩溃事件时（例如，断电、操作系统恐慌），健壮的系统必须优雅地处理崩溃并保持崩溃一致性，由于系统的复杂性，这在实践中极难实现。该项目从整体上分析了不同存储系统的崩溃一致性。它考虑了硬件特性、软件层之间的交互（例如，设备驱动器、文件系统、键值存储），以及系统执行的生命周期（例如，正常执行路径和恢复代码路径），以确保完整性，并利用虚拟化来最大限度地减少干扰，以实现高保真度。该项目希望提高作为现代社会基本构建块的存储系统的健壮性。对于金融机构来说，一分钟的停机时间可能导致数百万美元的损失，这种改进的鲁棒性是有价值的;对于任何数据都可能促进人类知识的科学探索，这种好处是不可估量的。全栈方法有望促进计算机体系结构、操作系统、数据库、软件工程、灾难响应等方面的协同研究，并将使包括硬件制造商、软件开发商和系统管理员在内的广泛从业者受益。此外，通过与教育和创业领域的多位专家合作，该项目将促进课程开发和行业合作，促进开源和可重复性，并扩大参与度。该奖项反映了NSF的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

On the Reproducibility of Bugs in File-System Aware Storage Applications

关于文件系统感知存储应用程序中错误的再现性

• 发表时间: 2022
• 期刊: and Storage
• 作者: Zhang, Duo;Mahmud, Tabassum;Gatla, Om Rameshwar;Han, Runzhou;Chen, Yong;Zheng, Mai.
• 通讯作者: Zheng, Mai.

Drill: Log-based Anomaly Detection for Large-scale Storage Systems Using Source Code Analysis

• DOI: 10.1109/ipdps54959.2023.00028
• 发表时间: 2023-05
• 期刊: 2023 IEEE International Parallel and Distributed Processing Symposium (IPDPS)
• 作者: Di Zhang;Chris Egersdoerfer;Tabassum Mahmud;Mai Zheng;Dong Dai

Understanding Persistent-memory-related Issues in the Linux Kernel

• DOI: 10.1145/3605946
• 发表时间: 2023-07
• 期刊: ACM Transactions on Storage
• 影响因子: 1.7
• 作者: Om Rameshwar Gatla;Duo Zhang;Wei Xu;Mai Zheng

ConfD: Analyzing Configuration Dependencies of File Systems for Fun and Profit

ConfD：分析文件系统的配置依赖性以获得乐趣和利润

• 发表时间: 2023
• 期刊: 21st USENIX Conference on File and Storage Technologies (FAST
• 作者: Mahmud, Tabassum;Gatla, Om R.;Zhang, Duo;Love, Carson;Bumann, Ryan;Zheng, Mai
• 通讯作者: Zheng, Mai

PROV-IO: An I/O-Centric Provenance Framework for Scientific Data on HPC Systems

PROV-IO：HPC 系统上以 I/O 为中心的科学数据来源框架

• DOI: 10.1145/3502181.3531477
• 发表时间: 2022
• 期刊: Proceedings of the 31st International Symposium on High-Performance Parallel and Distributed Computing (HPDC
• 作者: Han, Runzhou;Byna, Suren;Tang, Houjun;Dong, Bin;Zheng, Mai
• 通讯作者: Zheng, Mai