TopoCommit: A Topological Commit Protocol for Cross-Ledger Transactions in Scientific Computing
TopoCommit: A Topological Commit Protocol for Cross-Ledger Transactions in Scientific Computing
复制标题
DOI：
10.1109/cluster52292.2023.00038
复制
发表时间：
2023-10
期刊：
影响因子：
--
通讯作者：
Olamide Timothy Tawose;Lei Yang;Dongfang Zhao
中科院分区：
文献类型：
--
作者：
Olamide Timothy Tawose;Lei Yang;Dongfang Zhao
虽然越来越多的应用程序试图在去中心化系统（如区块链或分布式账本）中管理其数据，但跨多个潜在异构的去中心化系统的数据交换仍然是一个悬而未决的问题：最先进的协议无法满足一个或多个核心需求，例如原子性、活动性和可扩展性。具体而言，在科学计算领域，虽然最近为科学计算环境开发了区块链服务，但不支持不同分类账之间的数据交换和事务。观察到许多现代科学应用是由多个团队合作完成的，并且其工作流程日益复杂，我们认为迫切需要为不同的分类账实现有效且可扩展的协议，以便在科学计算中交换数据。本文提出了一种拓扑方法，在协作科学计算的背景下，在任意数量的科学分类账之间实现原子的、非阻塞的和可扩展的数据交换。具体来说，我们构建了一个由这些分类账构成的拓扑空间——将跨分类账交易中的节点抽象为抽象单纯形和简单复形等拓扑对象。在实际假设下，这些拓扑对象依次充当拓扑协议（即TopoCommit）的构建块。我们实现了TopoCommit并将其集成到最近发布的用于跟踪科学数据来源的分布式分类账scicchain中。对CloudLab上多达1008个节点和144个不同分类账的广泛评估表明，TopoCommit的性能比最先进的协议高出70倍。
While increasingly more applications are tempted to manage their data in decentralized systems, such as blockchains or distributed ledgers, the data exchange across multiple, potentially heterogeneous, decentralized systems remains an open problem: State-of-the-art protocols cannot meet one or more of the core requirements, such as atomicity, liveness, and scalability. Specifically, in the field of scientific computing, although a blockchain service was recently developed for scientific computing environments, the data exchanges and transactions among distinct ledgers are not supported. Observing that many modern scientific applications are collaborated on by multiple teams and the increasingly complicated (in-situ) workflows thereof, we argue that there is a pressing need to realize an efficient and scalable protocol for distinct ledgers to exchange data in scientific computing. This paper proposes a topological approach to enabling atomic, nonblocking, and scalable data exchanges among an arbitrary number of scientific ledgers in the context of collaborative scientific computing. Specifically, we construct a topological space formed by these ledgers—abstracting those nodes in a cross-ledger transaction as topological objects such as abstract simplex and simplicial complex. These topological objects, in turn, serve as the building blocks of a topological protocol, namely TopoCommit, under practical assumptions. We implement TopoCommit and integrate it into SciChain, a recently published distributed ledger for tracking scientific data provenance. The extensive evaluation of up to 1,008 nodes and 144 distinct ledgers on CloudLab shows that TopoCommit outperforms state-of-the-art protocols by up to 70×.