CSR: Small: Exploiting the Potential for Fine-Grained Memory Management via a Virtual Memory Framework Enhanced by Page Overlays

近年来，由于在超大数据集上进行计算，许多科学和技术领域经历了变革性的变化。为了帮助实现未来在科学技术方面的突破，我们还需要在计算机高效执行数据密集型计算的能力方面取得突破。也许操作系统和计算机硬件历史上最重要的发明之一是创建虚拟内存支持。虚拟内存支持不仅实现了让操作系统以方便程序员的方式灵活管理硬件内存资源的最初动机，而且还提供了意想不到的好处，例如启用了显著降低复制大量内存的有效成本的“写入时复制”机制。虽然虚拟内存是一个强大的工具，但它有一个主要缺点：它只在相对较粗的粒度上提供灵活性(例如，8KB的连续内存的“页面”)。这项研究正在探索一种消除这一缺陷的新技术如何使许多新的基本机制能够更高效地执行数据密集型计算。该项目的关键见解是，通过适度扩展支持虚拟内存的硬件(称为页面覆盖)，可以以更精细的粒度提供虚拟内存的好处：例如，32B而不是8KB。精度的这种数量级的提高不仅使现有的启用虚拟内存的优化更有效：它还实现了以前不切实际的基本新优化。例如，初步工作表明，这种新的页面覆盖机制可以通过启用新的(更有效的)“写入时覆盖”机制来显著提高“写入时复制”优化的性能。该项目正在探索页面覆盖如何实现额外的六种基本新机制，以使数据密集型计算更快、更节能。有了这六种新机制，未来的计算机系统应该更适合未来日益数据密集型的工作负荷。

Many areas of science and technology have experienced transformational changes in recent years as a result of computing on extremely large data sets. To help enable future breakthroughs in science and technology, we also need breakthroughs in the ability of computers to efficiently perform data-intensive computations. Perhaps one of the most important inventions in the history of operating systems and computer hardware was the creation of virtual memory support. Virtual memory support not only fulfilled its original motivation of giving the operating system the flexibility to manage the hardware memory resources in a way that is convenient for programmers, it also provided unexpected benefits, such as enabling the 'copy-on-write' mechanism that dramatically reduces the effective cost of duplicating large amounts of memory. While virtual memory is a powerful tool, it has one major shortcoming: it provides flexibility at only a relatively coarse granularity (e.g., 8KB "pages" of contiguous memory). This research is exploring how a new technique for eliminating this shortcoming can enable a number of new fundamental mechanisms for performing data-intensive computations much more efficiently.The key insight in this project is that through a modest extension of the hardware that supports virtual memory (called 'page overlays'), the benefits of virtual memory can be provided at a much finer granularity: e.g., 32B rather than 8KB. This orders-of-magnitude improvement in precision does not simply make existing virtual-memory-enabled optimizations more efficient: it enables fundamental new optimizations that had previously been impractical. For example, preliminary work has demonstrated that this new page overlays mechanism can dramatically improve the performance of the 'copy-on-write' optimization by enabling a new (much more efficient) 'overlay-on-write' mechanism. This project is exploring how page overlays can enable six additional fundamental new mechanisms for making data-intensive computations faster and more energy-efficient. With these six new mechanisms, future computer systems should be better suited to the increasingly data-intensive workloads of the future.