Sequentially consistent reads at wire speed
Sequentially consistent reads at wire speed
批准号:
531857-2018
负责人:
AlKiswany, Samer
金额:
$2.95万
依托单位:
依托单位国家:
加拿大
项目类别:
Collaborative Research and Development Grants
财政年份:
2020
资助国家:
加拿大
项目状态:
已结题
起止时间:
2020-01-01 至 2021-12-31
中文摘要
现代数据存储系统从根本上来说是低效的。这种低效率的主要原因是数据一致性机制,该机制确保读操作返回由最后一次成功的写操作写入的值。 虽然每个数据项都复制在多个存储节点上,但对于任何数据项,只有单个节点用于服务读取请求,限制了系统的性能,效率和可扩展性以支持流行数据。
这个项目的目标是探索一个高效和高性能的共识协议,可以利用所有的副本服务的读请求的新设计。新协议的主要推动力是引入可编程交换设备的网络技术的最新进展。新协议将利用这种新的网络可编程性来监控每个读写请求,确定写入何时完成以及哪个副本子集对其进行了确认,并检测节点和交换机故障。新协议不仅能够利用多个副本来服务读请求,还能够负载平衡读请求并避免失败节点。
这一创新项目将对技术产生潜在的广泛影响,包括对许多建立KV商店的加拿大公司(例如,华为、华为、爱立信和IBM)以及使用这些系统的150多个加拿大数据中心。最后,该计划将为培训尖端网络和存储技术的高素质人员提供宝贵的机会。
英文摘要
Modern data-storage systems are fundamentally inefficient. The main reason for this inefficiency is the data-consistency mechanism that ensures that read operations return the value written by the last successful write operation. Although every data item is replicated on multiple storage nodes, for any data item, only a single node is used to serve read requests, limiting the system's performance, efficiency, and scalability for supporting popular data.
The goal of this project is to explore new designs for a highly efficient and performant consensus protocol that can utilize all replicas for serving read requests. The main enablers for the new protocol are recent advances in networking technology that introduced programmable switching devices. The new protocol will leverage this new network programmability to monitor every read and write request, determine when a write is completed and which subset of replicas acknowledged it, and detect node and switch failures. The new protocol will be able to not only utilize multiple replicas for serving read requests but also load balance read requests and avoid failed nodes.
This innovative project will have a potentially wide influence on technology, including on many Canadian companies that build KV stores (e.g., Huawei, NetApp, Ericsson, and IBM) and the more than 150 Canadian data centers that use these systems. Finally, this program will provide an invaluable opportunity for training highly qualified personnel on cutting-edge networking and storage technology.
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
Exploring a New Design Paradigm for Distributed Systems in Modern Data Centers
-
批准号:RGPIN-2017-04180
-
项目类别:Discovery Grants Program - Individual
-
资助金额:$2.26万
-
财政年份:2022
-
负责人:AlKiswany, Samer
-
依托单位:
Exploring a New Design Paradigm for Distributed Systems in Modern Data Centers
-
批准号:RGPIN-2017-04180
-
项目类别:Discovery Grants Program - Individual
-
资助金额:$2.26万
-
财政年份:2021
-
负责人:AlKiswany, Samer
-
依托单位:
Disaggregated Cloud
-
批准号:537905-2018
-
项目类别:Collaborative Research and Development Grants
-
资助金额:$7.96万
-
财政年份:2021
-
负责人:AlKiswany, Samer
-
依托单位:
Disaggregated Cloud
-
批准号:537905-2018
-
项目类别:Collaborative Research and Development Grants
-
资助金额:$7.96万
-
财政年份:2020
-
负责人:AlKiswany, Samer
-
依托单位:
Exploring a New Design Paradigm for Distributed Systems in Modern Data Centers
-
批准号:RGPIN-2017-04180
-
项目类别:Discovery Grants Program - Individual
-
资助金额:$2.26万
-
财政年份:2020
-
负责人:AlKiswany, Samer
-
依托单位:
Exploring a New Design Paradigm for Distributed Systems in Modern Data Centers
-
批准号:RGPIN-2017-04180
-
项目类别:Discovery Grants Program - Individual
-
资助金额:$2.26万
-
财政年份:2019
-
负责人:AlKiswany, Samer
-
依托单位:
Disaggregated Cloud
-
批准号:537905-2018
-
项目类别:Collaborative Research and Development Grants
-
资助金额:$3.22万
-
财政年份:2019
-
负责人:AlKiswany, Samer
-
依托单位:
Sequentially consistent reads at wire speed
-
批准号:531857-2018
-
项目类别:Collaborative Research and Development Grants
-
资助金额:$3.95万
-
财政年份:2019
-
负责人:AlKiswany, Samer
-
依托单位:
Exploring a New Design Paradigm for Distributed Systems in Modern Data Centers
-
批准号:RGPIN-2017-04180
-
项目类别:Discovery Grants Program - Individual
-
资助金额:$2.26万
-
财政年份:2018
-
负责人:AlKiswany, Samer
-
依托单位:
A Study of the Impact of Network Partitioning Faults on Cloud Systems
-
批准号:528813-2018
-
项目类别:Engage Grants Program
-
资助金额:$1.82万
-
财政年份:2018
-
负责人:AlKiswany, Samer
-
依托单位:
Improving Object Storage Performance and Efficiency through Network Integration
-
批准号:518304-2017
-
项目类别:Engage Grants Program
-
资助金额:$1.82万
-
财政年份:2017
-
负责人:AlKiswany, Samer
-
依托单位:
Exploring a New Design Paradigm for Distributed Systems in Modern Data Centers
-
批准号:RGPIN-2017-04180
-
项目类别:Discovery Grants Program - Individual
-
资助金额:$2.26万
-
财政年份:2017
-
负责人:AlKiswany, Samer
-
依托单位:
Meeting with NetApp Team to Explore Possible Collaborations
-
批准号:514844-2017
-
项目类别:Connect Grants Level 1
-
资助金额:$0.19万
-
财政年份:2017
-
负责人:AlKiswany, Samer
-
依托单位:
Sequoia: Hardware/Software co-design for Big-Data Analytics
-
批准号:438979-2013
-
项目类别:Postdoctoral Fellowships
-
资助金额:$2.91万
-
财政年份:2014
-
负责人:AlKiswany, Samer
-
依托单位:
Sequoia: Hardware/Software co-design for Big-Data Analytics
-
批准号:438979-2013
-
项目类别:Postdoctoral Fellowships
-
资助金额:$2.91万
-
财政年份:2013
-
负责人:AlKiswany, Samer
-
依托单位:
海外基金