Multi-Tier Buffer Management and Storage System Design for Non-Volatile Memory
Multi-Tier Buffer Management and Storage System Design for Non-Volatile Memory
复制标题
DOI：
--
复制
发表时间：
2019-01
期刊：
影响因子：
--
通讯作者：
Joy Arulraj;Andrew Pavlo;Krishna T. Malladi
中科院分区：
文献类型：
--
作者：
Joy Arulraj;Andrew Pavlo;Krishna T. Malladi
数据库管理系统(DBMS)中缓冲区管理器的设计受易失性存储器(DRAM)和非易失性存储器(例如，SSD)的性能特性的影响。关键的设计假设是，数据必须迁移到DRAM，DBMS才能在其上运行，并且存储速度比DRAM慢几个数量级。但是，速度几乎与DRAM一样快的新的非易失性存储器(NVM)技术的到来，推翻了这些先前的假设。本白皮书介绍了管理和设计由DRAM、NVM和SSD组成的多层存储层次结构的技术。我们的主要技术贡献是利用NVM特性的多层缓冲区管理器和存储系统设计器。我们提出了一套优化方案，以最大化存储层次结构中不同设备之间的数据迁移的效用。我们演示了这些优化必须根据设备和工作负载特征量身定做。鉴于此，我们提出了一种技术，用于调整这些优化，以实现任意工作负载和存储层次结构的接近最佳的缓冲区管理策略，而不需要任何手动调整。最后，我们提出了一个针对目标工作负载和系统成本预算来设计多层存储层次结构的推荐系统。我们的结果表明，支持NVM的缓冲区管理器和存储系统设计器提高了吞吐量，并降低了不同事务和分析处理工作负载的系统成本。
The design of the buffer manager in database management systems (DBMSs) is influenced by the performance characteristics of volatile memory (DRAM) and non-volatile storage (e.g., SSD). The key design assumptions have been that the data must be migrated to DRAM for the DBMS to operate on it and that storage is orders of magnitude slower than DRAM. But the arrival of new non-volatile memory (NVM) technologies that are nearly as fast as DRAM invalidates these previous assumptions. This paper presents techniques for managing and designing a multi-tier storage hierarchy comprising of DRAM, NVM, and SSD. Our main technical contributions are a multi-tier buffer manager and a storage system designer that leverage the characteristics of NVM. We propose a set of optimizations for maximizing the utility of data migration between different devices in the storage hierarchy. We demonstrate that these optimizations have to be tailored based on device and workload characteristics. Given this, we present a technique for adapting these optimizations to achieve a near-optimal buffer management policy for an arbitrary workload and storage hierarchy without requiring any manual tuning. We finally present a recommendation system for designing a multi-tier storage hierarchy for a target workload and system cost budget. Our results show that the NVM-aware buffer manager and storage system designer improve throughput and reduce system cost across different transaction and analytical processing workloads.