SHF: Small: A Distributed Scalable End-to-End Tail Latency SLO Guaranteed Resource Management Framework for Microservices

微服务体系结构通常产生高度可伸缩、可维护、可测试和松耦合的系统。因此，云计算服务正在从传统的单片架构转向微服务架构，以实现快速开发，轻松调试和频繁的软件更新。云计算的主要设计目标是提供以用户为中心的服务，以满足不同的端到端应用查询尾延迟服务水平目标（SLO）要求，同时最大化系统资源利用率。该提案旨在开发这样一种方法，称为分布式可扩展的端到端尾部延迟SLO保证的微服务资源管理框架（Distributed scalable End-to-end Tail lAtency SLO Guaranteed rEssource Management framework for microservices，简称SGGEM）。EQUIPGEM探索基本原则，为资源分配的全面解决方案建立坚实的理论基础，并保证每个查询的尾延迟SLO。 该项目开发的算法和工具将使广大研究人员、工程师和教育工作者受益，从而推动其他一系列领域的研究。此外，该项目所取得的成果将持续纳入现有的本科生和研究生课程。德克萨斯大学阿灵顿分校的代表性不足的学生参与这项拟议的研究将提高他们在未来就业市场的竞争力。RIGGEM采取的方法是（a）基于在运行时在各个微服务处测量的卸载任务响应时间的统计数据，导出将用于查询的有向无环图（DAG）工作流的SLO映射到其各自微服务处的队列中的任务的任务排队预算的数学基础;以及（B）基于测量的任务排队违规率来开发任务排队违规感知的违规管理方案和资源自动缩放方案。 目标是确保所有微服务满足各自的任务排队预算，然后保证满足查询的端到端查询尾延迟SLO。该项目的成功完成将极大地推动微服务架构的方法论、理论和实践解决方案的发展。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

Microsevice architecture typically yields highly scalable, maintainable, testable and loosely coupled systems. For this reason, cloud-computing services are shifting from traditional monolithic architectures to microservice architectures to enable fast development, easy debugging and frequent software updating. A primary design goal of cloud computing is to provide user-centric services that meet diverse end-to-end application query tail-latency Service Level Objective (SLO) requirements, while maximizing system-resource utilization. This proposal aims at developing such an approach, known as Distributed scalable End-to-end Tail lAtency SLO Guaranteed rEsource Management framework for microservices (DETAGEM). DETAGEM explores foundational principles to establish a solid theoretical foundation towards a comprehensive solution for resource allocation with guaranteed per-query tail-latency SLO. The algorithms and tools developed in DETAGEM will be made available to benefit a broad set of researchers, engineers and educators, and thereby advancing research across a range of other areas. Moreover, the obtained results from this project will be integrated into existing undergraduate and graduate curricula on a continuous basis. The involvement of underrepresented students in this proposed research at The University of Texas at Arlington will enhance their competitiveness in the future job market.DETAGEM is a comprehensive distributed scalable solution rooted in fundamental principles. The approach taken by DETAGEM is to (a) derive a mathematical foundation that maps the SLO for Directed Acyclic Graph (DAG) workflows for queries to the task queuing budgets for tasks in the queies at their respective microservices, based on the statistics of unloaded task response time measured at individual microservices at runtime; and (b) develop task-queuing-budget-aware queue-management schemes and resource-auto-scaling schemes based on measured task-queuing budget-violation ratios. The objective is to ensure that all the microservices meet their respective task-queuing budgets, which will then guarantee that the end-to-end query tail-latency SLO for the queries are satisfied. The successful completion of the proposed project is expected to greatly advance the state-of-the-art in terms of methodologies, theories, and practical solutions for the microservice architecture.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.