Sequentially consistent reads at wire speed

以线速连续一致读取

• 批准号: 531857-2018
• 负责人: AlKiswany, Samer
• 金额: $ 2.95万
• 依托单位: University of Waterloo
• 依托单位国家: 加拿大
• 项目类别: Collaborative Research and Development Grants
• 财政年份: 2020
• 资助国家: 加拿大
• 起止时间: 2020-01-01 至 2021-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=699281
• 关键词: Sequentially; consistent; reads; wire; speed

Modern data-storage systems are fundamentally inefficient. The main reason for this inefficiency is the data-consistency mechanism that ensures that read operations return the value written by the last successful write operation. Although every data item is replicated on multiple storage nodes, for any data item, only a single node is used to serve read requests, limiting the system's performance, efficiency, and scalability for supporting popular data. The goal of this project is to explore new designs for a highly efficient and performant consensus protocol that can utilize all replicas for serving read requests. The main enablers for the new protocol are recent advances in networking technology that introduced programmable switching devices. The new protocol will leverage this new network programmability to monitor every read and write request, determine when a write is completed and which subset of replicas acknowledged it, and detect node and switch failures. The new protocol will be able to not only utilize multiple replicas for serving read requests but also load balance read requests and avoid failed nodes. This innovative project will have a potentially wide influence on technology, including on many Canadian companies that build KV stores (e.g., Huawei, NetApp, Ericsson, and IBM) and the more than 150 Canadian data centers that use these systems. Finally, this program will provide an invaluable opportunity for training highly qualified personnel on cutting-edge networking and storage technology.

现代数据存储系统从根本上来说是低效的。这种低效的主要原因是数据一致性机制，该机制确保读操作返回由上次成功的写操作写入的值。虽然每个数据项都被复制到多个存储节点上，但对于任何数据项，只有一个节点用于服务读取请求，从而限制了系统支持流行数据的性能、效率和可扩展性。 这个项目的目标是探索一种高效和高性能的共识协议的新设计，该协议可以利用所有副本来服务读取请求。新协议的主要推动因素是引入了可编程交换设备的网络技术的最新进展。新协议将利用这种新的网络可编程性来监控每个读写请求，确定写入何时完成以及哪个副本子集确认了它，并检测节点和交换机故障。新协议不仅能够利用多个副本为读请求提供服务，而且能够对读请求进行负载均衡，并避免出现故障的节点。 这一创新项目将对技术产生潜在的广泛影响，包括许多建设KV商店的加拿大公司(例如，华为、NetApp、爱立信和IBM)以及使用这些系统的150多个加拿大数据中心。最后，该计划将为培训尖端网络和存储技术方面的高素质人员提供宝贵的机会。