SHF:Small:Data Structures and Transactions for Emerging Nonvolatile Memory

SHF：Small：新兴非易失性存储器的数据结构和事务

• 批准号: 1717712
• 负责人: Michael Scott
• 金额: $ 44.99万
• 依托单位: University of Rochester
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-09-01 至 2021-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1717712&HistoricalAwards=false
• 关键词: SHF; Small; Data; Structures; Transactions

Data that need to be persistent, either for the sake of long-term access or for recovery from system crashes, have traditionally been kept on disk and flash drives, which are very slow. Within the next few years, much faster persistent memory is expected to be widely available at reasonable cost, raising the possibility that file systems might be replaced, at least in part, by memory that is simply "always available." The intellectual merits of the project lie in addressing two key challenges to such "always available memory": first, ensuring that the values in memory in the wake of a system crash are always mutually consistent, despite the possibility that traditional caches often pass data to the memory out of order; second, safeguarding the structural integrity of persistent data despite the possibility that buggy programs may erroneously modify arbitrary memory locations. The project's broader significance and importance lie in the promise of significant improvements in programmability, reliability, and system performance, and in the ability to survive power outages and hardware failures at much lower cost than has previously been possible. This latter benefit may be of particular importance for ubiquitous sensors in the Internet of Things.The project builds on prior work by the principal investigator and colleagues, which has developed formal correctness criteria for persistent data, together with automatic methods to guarantee this correctness. The current project is pursuing three major research thrusts. First, it is developing a library of reusable, high-performance persistent data structures, with particular emphasis on exploiting high-level semantics to minimize instrumentation overhead, maintaining sufficient information to complete or undo partial operations in the wake of a program or system crash, and formalizing and proving correctness. Second, the project is developing techniques to compose persistent operations into larger atomic transactions. This work builds on past experience with hardware and software transactional memory, and encompasses both nonblocking and lock-based approaches. Particular emphasis is being placed on "boosting" the operations of persistent data structures so that they can serve as reversible high-level operations of a transactional system. Third, the project is developing mechanisms (including user-level daemons, compiler-based sandboxing, fine-grain memory protection, and the use of virtualization hardware) to ensure that persistent data is modified only by trusted library code, thereby safeguarding its structural integrity in the presence of buggy applications.

传统上将需要持久的数据，无论是为了长期访问还是从系统崩溃中恢复，都将其保存在磁盘和闪存驱动器上，这非常慢。 在接下来的几年中，预计将以合理的成本将持久内的内存更快，从而提高了文件系统的可能性，至少部分是通过“始终可用”的内存更换的。该项目的智力优点在于针对这种“始终可用内存”的两个关键挑战：首先，确保系统崩溃后内存中的值始终是相互一致的，尽管传统的卡切斯可能经常将数据传递到存储器中；其次，尽管有可能错误地修改任意内存位置，但仍可以保护持久数据的结构完整性。 该项目的更广泛的意义和重要性在于有望在可编程性，可靠性和系统性能上有重大改善，以及能够以比以前可能更低的成本生存停电和硬件故障的能力。 后一种利益对于物联网中的无处不在传感器可能非常重要。该项目以先前的工作为基础，该项目的工作是为持续数据制定了正式的正确性标准，以及自动方法，以及保证这种正确性。 当前的项目正在追求三个主要的研究作用。 首先，它正在开发一个可重复使用的高性能持久数据结构的库，特别是强调利用高级语义，以最大程度地限制仪器开销，维护足够的信息以在程序或系统崩溃之后完成或撤销部分操作，并正式化和证明和证明正确性。 其次，该项目正在开发将持久操作构成较大原子交易的技术。 这项工作以硬件和软件交易内存的过去经验为基础，并涵盖了非封锁和基于锁定的方法。 特别强调“促进”持续数据结构的操作，以便它们可以作为交易系统的可逆高级操作。 第三，该项目正在开发机制（包括用户级守护程序，基于编译器的沙箱，细粒度内存保护和使用虚拟化硬件），以确保仅通过受信任的库代码修改持久数据，从而在存在货物应用程序的情况下保护其结构完整性。

项目成果

Hodor: intra-process isolation for high-throughput data plane libraries

Hodor：高吞吐量数据平面库的进程内隔离

• 发表时间: 2019
• 期刊: Proceedings of the 2019 Usenix Annual Technical Conference
• 作者: Mohammad Hedayati, Spyridoula Gravani

Nonblocking Persistent Software Transactional Memory

非阻塞持久软件事务内存

• DOI: 10.1109/hipc50609.2020.00042
• 发表时间: 2020
• 期刊: and Analytics (HiPC
• 作者: Beadle, H. Alan;Cai, Wentao;Wen, Haosen;Scott, Michael L.
• 通讯作者: Scott, Michael L.

Interval-based memory reclamation

基于间隔的内存回收

• DOI: 10.1145/3178487.3178488
• 发表时间: 2018
• 期刊: Proceedings of the 23rd ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming
• 作者: Wen, Haosen;Izraelevitz, Joseph;Cai, Wentao;Beadle, H. Alan;Scott, Michael L.
• 通讯作者: Scott, Michael L.

Understanding and optimizing persistent memory allocation

• DOI: 10.1145/3381898.3397212
• 发表时间: 2020-03
• 期刊: Proceedings of the 2020 ACM SIGPLAN International Symposium on Memory Management
• 作者: Wentao Cai;Haosen Wen;H. A. Beadle;Chris Kjellqvist;Mohammad Hedayati;M. Scott

Multi-queue fair queueing

多队列公平排队

• 发表时间: 2019
• 期刊: Proceedings of the 2019 Usenix Annual Technical Conference
• 作者: Mohammad Hedayati, Kai Shen