Collaborative Research: CNS CORE: Medium: The Case for Blended Storage

近年来，数据存储技术的设计有两个目标：提高性能或降低每位成本。因此，大量的工作已经投入到构建新的存储系统中，这些系统被组织为非常快（但昂贵）或非常便宜（但缓慢）。该提案采用了不同的方法：它为混合存储系统提供了理由，即，广泛使用的存储数据结构和算法是为单个存储介质设计的，这导致当它们在具有不同特性的多种不同存储技术上运行时性能很差。因此，该提案重新思考了支撑混合存储的现代存储系统的基本数据结构和算法，包括：索引、数据放置、日志记录、缓存、预取和近似成员结构。本研究将在一个专门为混合存储设计的键值存储原型中设计和实现这些数据结构和算法，并重新设计广泛使用的键值存储数据结构和算法，以利用混合存储技术实现低成本的快速数据访问。由于键值存储是许多云数据系统的基础，因此直接的好处将包括以更低的成本实现高性能的数据系统。这些将反过来转化为面向最终用户的具有成本效益的云服务。PI将在开源许可证下发布软件工件，以支持其他研究人员，并将与硬件和云提供商合作，将研究转化为实践。该教育计划将提升以存储为中心的系统设计作为系统教育的一个组成部分。项目存储库将托管在Github上https://github.com/princeton-sns并无限期维护。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

In recent years, data storage technology has been designed for one of two objectives: either improved performance or a lower cost per bit. Consequently, significant effort has gone into building new storage systems that are organized either to be very fast (but expensive) or very cheap (but slow). This proposal takes a different approach: it makes the case for blended storage systems, i.e., software systems that combine multiple different storage technologies, to achieve both high performance and low cost per bit.Widely-used storage data structures and algorithms are designed for a single storage medium in mind, which leads to poor performance when they are run on multiple different storage technologies with different characteristics. Therefore, the proposal rethinks the fundamental data structures and algorithms that underpin modern storage systems for blended storage, including: indexing, data placement, logging, caching, prefetching and approximate membership structures. The proposal will design and implement these data structures and algorithms in a prototype key-value store that is designed specifically for blended storage.The proposed research will redesign widely-used data structures and algorithms for key-value stores to take advantage of blended storage technologies for fast data access at a low cost. Since key-value stores underpin many cloud data systems, the immediate benefits will include high performing data systems at a reduced cost. These will in turn translate to cost-effective cloud services for end users. The PIs will release the software artifacts under open-source licenses to enable other researchers and will work with hardware and cloud providers to transition the research into practice. The education plan will elevate storage-centric systems design as an integral part of systems education.The project repository will be hosted on Github at https://github.com/princeton-sns and maintained indefinitely.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.