Unifying Consensus and Atomic Commitment for Effective Cloud Data Management
Unifying Consensus and Atomic Commitment for Effective Cloud Data Management
复制标题
DOI：
10.14778/3303753.3303765
复制
发表时间：
2019-01
期刊：
影响因子：
--
通讯作者：
Sujaya Maiyya;Faisal Nawab;D. Agrawal;A. E. Abbadi
中科院分区：
文献类型：
--
作者：
Sujaya Maiyya;Faisal Nawab;D. Agrawal;A. E. Abbadi
云中的数据存储需要具有可伸缩性和容错性。两阶段提交（Two Phase Commit, 2PC）等原子提交协议为对分片数据的事务访问提供了ACID保证，并有助于实现可伸缩性。而像Paxos这样的共识协议在不同的服务器上一致地复制数据并提供容错性。如今，基于云的数据中心通常将可伸缩性和容错问题分开处理。在这项工作中，我们建议将这两种不同的范式统一为一个框架，称为共识和承诺（C&C）框架。C&C框架可以对现有的和众所周知的数据管理协议进行建模，也可以提出新的数据管理协议。我们通过开发一个新的原子提交协议Paxos原子提交（PAC）来展示C&C框架的优势，该协议以类似Paxos的方式集成了提交和恢复。我们还实例化了C&C框架中针对不同云数据管理技术的提交协议。特别是，我们提出了一种新的协议，通用PAC (G-PAC)，它在涉及数据分片和复制的云范式中集成了原子承诺和容错。我们将G-PAC的性能与类似spanner的协议进行了比较，其中2PC用于逻辑数据级别，Paxos用于逻辑数据的一致复制。实验结果突出了将共识和承诺结合到单一集成协议中的好处。
Data storage in the Cloud needs to be scalable and fault-tolerant. Atomic commitment protocols such as Two Phase Commit (2PC) provide ACID guarantees for transactional access to sharded data and help in achieving scalability. Whereas consensus protocols such as Paxos consistently replicate data across different servers and provide fault tolerance. Cloud based datacenters today typically treat the problems of scalability and fault-tolerance disjointedly. In this work, we propose a unification of these two different paradigms into one framework called Consensus and Commitment (C&C) framework. The C&C framework can model existing and well known data management protocols as well as propose new ones. We demonstrate the advantages of the C&C framework by developing a new atomic commitment protocol, Paxos Atomic Commit (PAC), which integrates commitment with recovery in a Paxos-like manner. We also instantiate commit protocols from the C&C framework catered to different Cloud data management techniques. In particular, we propose a novel protocol, Generalized PAC (G-PAC) that integrates atomic commitment and fault tolerance in a cloud paradigm involving both sharding and replication of data. We compare the performance of G-PAC with a Spanner-like protocol, where 2PC is used at the logical data level and Paxos is used for consistent replication of logical data. The experimental results highlight the benefits of combining consensus along with commitment into a single integrated protocol.