Memory Diplomat (MD)

新兴的和破坏性的存储器技术，例如非易失性存储器（NVM）、高带宽存储器（HBM）、计算存储器等，允许应用程序，特别是以数据为中心的应用程序，如数据库系统和操作系统（OS），优化所提供技术的使用和维护。例如，具有降低的单元耐久性的NVM需要特定的损耗均衡。此外，HBM需要决定哪些存储器内容应该存储在HBM中。到目前为止，应用程序需要有关底层内存技术的专业知识，以便最佳地使用和管理这种破坏性的内存技术。类似地，操作系统或内存控制器需要精确的应用程序知识，以便进行适当的内存管理。在这个项目中，我们设想通过采用内存外交官，一个中央软件实例，它知道部署的硬件和运行的应用程序，来规避应用程序中精确的硬件知识的要求，以及操作系统和硬件中精确的应用程序知识的要求。内存外交官在协商过程中调查来自硬件和应用程序的所有需求、要求和约束，并决定对内存硬件进行适当的管理和优化。我们计划通过从应用程序侧（应用程序特性）和硬件侧（硬件特性）设计一个非常合适的行为特性抽象来实现这一目标。我们选择这些特征的方式，他们构造一个抽象的，但特定于域的接口，它可以用来表征内存硬件和应用程序。每个应用程序和硬件特征形成对应物，这允许内存外交官采用优化和管理算法，以使应用程序最佳地使用内存硬件。在项目的第一阶段之后，内存外交官的工作实现将可用，它集成了广泛的硬件和应用程序特征，针对数据库系统作为主要应用程序，并且允许许多存储器技术被表征。沿着Memory Diplomat的概念设计，我们始终致力于对所有研究方法和特征的真实的实现进行现实的端到端评估。因此，我们将不断地将新功能集成到我们的实现中，并在整个项目期间维护工作记忆外交官框架。

Emerging and Disruptive Memory Technologies, such as non-volatile memory (NVM), high bandwidth memory (HBM), computational memory and many more, allow applications, especially data-centric applications like database systems, and operating systems (OSes) to optimize for the usage and maintenance of the provided technologies. For instance, NVM with reduced cell endurance requires specific wear-leveling. Furthermore, HBM requires a decision which memory contents should be stored in HBM. Up to now, applications require specialized knowledge about the underlying memory technology in order to optimally use and manage such disruptive memory technologies. Similarly, operating systems or memory controllers require precise knowledge about the application in order to conduct proper memory management.Within this project, we envision to circumvent the requirement of precise hardware knowledge within the application and the requirement of precise application knowledge in the OS and hardware by employing Memory Diplomat, a central software instance, which is aware of the deployed hardware and of the running application. The Memory Diplomat investigates all needs, requirements and constraints from the hardware and application within a negotiation process and decides for a proper management and optimization of the memory hardware. We plan to achieve this by designing a well suited abstraction of behavioral characteristics from the application side (application characteristics) and from the hardware side (hardware characteristics). We choose these characteristics in such a way, that they construct an abstract, yet domain-specific interface, which can be used to characterize the memory hardware and the application. Each of the application and hardware characteristics form counterparts, which allow the Memory Diplomat to employ optimization and management algorithms in order to make the application optimally use the memory hardware.After the first phase of the project, a working implementation of the memory diplomat will be available, which integrates a broad range of hardware and application characteristics, targeting database systems as the main applications, and allows many memory technologies to be characterized. All along the conceptual design of Memory Diplomat, we permanently target to conduct realistic and end-to-end evaluation of real implementations of all investigated methods and characteristics. Thus, we will continuously integrate new features into our implementation and maintain the working memory diplomat framework over all the project duration.