CNS Core: Small: Paxos Unpacked

由于其出色的容错特性，Paxos协议已被许多云计算系统用于计算机集群的一致协调。该项目旨在表明，当适当定制时，Paxos系列协议也可以提供目前缺乏的一流性能和可扩展性。为此，该项目将为不同的部署和用例设计高性能、可扩展、实用和可用的Paxos变体。该项目不是开发不相交的点解决方案，而是对解决方案空间进行系统和原则性的探索。扩展Paxos并使其实用和可定制涉及许多挑战，需要各种分布式算法工具和技术。为了水平扩展Paxos，该项目将研究由灵活的法定人数结果实现的新型协议内分片和重新配置策略。为了垂直扩展Paxos，该项目将通过将控制与通信流解耦以及采用协议内聚合优化来缓解领导者的瓶颈。为了将共识作为轻量级的无服务器原语提供，该项目将开发高效的单实例细粒度共识作为系统原语，并展示其在应用程序中的使用。该项目中开发的技术将广泛适用于一般的协调协议。为了加速向学术界和工业界转让技术，该项目将在全球分布式数据库原型的背景下展示这些技术。该项目还将通过加强科学/技术理解，向社区分发工具和软件，吸引本科生和代表性不足的学生，并接触K-12学生，从而产生更广泛的影响。新的工具，软件和材料将被创建，以教学生分布式系统的原理和分布式协议的推理。该项目将通过Github存储库https://github.com/muratdem与公众公开共享所有软件，文档和技术论文。这些材料将包括协议的TLA+/Pluscal模型，协议在Go语言中的实现，展示协议的分布式数据库的实现，用于设计和开发协调协议的原语和工具的实现，分布式协调的课程模块，研究论文，演示文稿和博客文章。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

Due to their excellent fault-tolerance properties, Paxos protocols have been employed by many cloud computing systems for consistent coordination of clusters of computers. This project aims to show that when properly customized, Paxos family of protocols can also deliver top-notch performance and scalability, which they currently lack. To this end, the project will design high-performance, scalable, practical, and usable Paxos variants customized for different deployments and use cases. Instead of developing disjoint point-solutions, the project will provide a systematic and principled exploration of the solution space.Scaling Paxos and making it practical and customizable involves many challenges and requires an assortment of distributed algorithmic tools and techniques. For scaling Paxos horizontally, the project will investigate novel in-protocol sharding and reconfiguration strategies enabled by the flexible quorums result. For scaling Paxos vertically, the project will alleviate the bottleneck at the leaders by decoupling control from communication flow and by employing in-protocol aggregation optimizations. To provide consensus as a lightweight serverless primitive, the project will develop efficient single-instance fine-granularity consensus as a systems primitive and showcase its use in applications.The techniques developed in this project will have broader applicability to coordination protocols in general. In order to accelerate technology transfer to academia and industry, the project will showcase these techniques in the context of a globally distributed database prototype. The project will also enable broader impact through enhancing scientific/technological understanding, distributing tools and software to the community, engaging undergraduate and underrepresented students, and reaching out to K-12 students. New tools, software, and material will be created to teach students the principles of distributed systems and reasoning about distributed protocols.The project will share all the software, documentation, and technical papers generated with the public openly as open source via Github repositories at https://github.com/muratdem. These material will include TLA+/Pluscal models of the protocols, implementations of the protocols in Go language, implementation of a distributed database showcasing the protocols, implementation of primitives and tools for designing and developing coordination protocols, course modules on distributed coordination, research papers, presentations, and blog posts. The material will be stored and preserved for at least three years beyond the award period.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.