CSR: Medium: Rethinking Distributed SSD Storage Systems

现代存储技术，如固态硬盘(SSD)，通过增加密度来增加其容量：在相同的物理介质中表示更多的数字比特。为了做到这一点，他们表示数据的误差率缩小了，由此导致的误码率上升。虽然磁盘使用纠错码来掩盖这样的比特错误，但这些错误率随着磁盘块的老化而上升，因为(重写)，最终磁盘出现故障。因此，随着密度的增加，磁盘的预期寿命大幅下降。这项研究重新思考了如何通过存储堆栈的跨层设计来构建可扩展且经济高效的存储。对于大多数数据中心应用程序，对象已经在多个设备之间复制，并且可以利用这种应用层冗余来提高可靠性。因此，本研究探索了一种实现固态硬盘存储系统端到端可靠性的新方法：数据中心闪存设备的可靠性应大大降低，并将错误可见性和纠错功能向上推送到分布式应用层。通过三个研究重点探讨了提供这种全面、跨层方法的设计挑战和影响：在单个磁盘层、在本地文件系统层和在分布式存储系统层。通过将磁盘的生命周期延长几个数量级，这项研究有可能采用新的SSD存储技术，显著节省成本，并使新的应用程序能够使用SSD。由于新一代固态硬盘技术的生命周期急剧下降，大型数据中心应用程序已无法在许多情况下集成这些新一代技术(例如，具有高写入速率的工作负载，包括数据库和缓存)。考虑到这项研究在可靠性改进方面的潜力，它提供了一条摆脱硬件可靠性悬崖的潜在途径。与这项研究相关的代码、数据和结果将通过https://github.com/princeton-sns/crosslayer-storage/.上公开托管的GIT存储库提供获奖材料将在整个获奖期间和至少五年后提供。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

Modern storage technologies, such as solid-state disks (SSDs), have increased their capacity by increasing density: representing more digital bits in the same physical media. To do so, their margin of error for representing data has shrunk, and the resulting bit error rate has risen. While disks employ error correcting codes to mask such bit errors, these error rates rise as disk blocks age, by being (over)written, and eventually the disk fails. Thus, as density has risen, disks' expected lifetimes have plunged. This research rethinks how to build scalable and cost-effective storage through a cross-layer design to the storage stack.For most datacenter applications, objects are already replicated between multiple devices, and this application-layer redundancy can be leveraged for increased reliability. This research thus explores a new approach for end-to-end reliability for SSD storage systems: datacenter flash devices should be far less reliable and push error visibility and correction up to the distributed application layer. The design challenges and implications of providing such a holistic, cross-layer approach are explored through three research thrusts: at the individual disk layer, at the local file system, and at the distributed storage system layer.By extending the lifecycle of disks by several orders of magnitude, this research has the potential for the adoption of new SSD storage technologies, significant cost savings, and enabling new applications to use SSDs. Due to the plunging lifecycles of newer generations of SSD technologies, large datacenter applications have been unable to integrate these new generations in a number of scenarios (e.g., workloads with heavy write rates, including databases and caches). Given this research's potential for orders of magnitude of reliability improvements, it provides a potential path out from this reliability cliff of the hardware.Code, data, and results relating to this research will be made available via a git repository, hosted publicly at https://github.com/princeton-sns/crosslayer-storage/. Materials will be available throughout the Award term and at least five years following it.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.