NeTS: Small: Collaborative Research: Enabling Application-Level Performance Predictability in Public Clouds

当今数据中心和计算云中最先进的资源共享机制与应用程序级别的性能要求无关，导致无法预测的性能。对于网络来说，情况尤其如此。与CPU、内存或磁盘不同，云运营商不为网络提供任何保证。许多租户依赖过度调配和静态分配来实现性能隔离，这会导致利用率低，并增加成本和环境影响。该项目旨在构建一套解决方案，以实现高资源利用率的短期和长期业绩可预测性。其目标是使来自不同租户的共存应用程序能够满足各种性能目标，包括获得及时响应并将连续响应的差异降至最低，同时遵守单个租户的组织层次结构。该项目的关键技术挑战包括开发短期和长期资源分配算法、准确的需求估计以及快速有效的执行，所有这些都因网络的多资源和共享性质而变得更加复杂。两项关键技术指导着拟议的工作：(I)时间调度通过短期和长期性能隔离确保可预测的性能；(Ii)空间布局通过初始放置和租户的虚拟机的定期迁移确保更高的利用率。可预测的、高效的数据分析将产生重大的社会经济后果。它还将支持任务关键型应用程序，例如异常检测、欺诈保护、自动驾驶车辆和机器人，这些应用程序需要高度一致和可靠的性能水平，才能与不太敏感的应用程序共存。该项目的算法和软件将被整合到现有的开源大数据堆栈中，供公众重复使用。通过利用与行业的持续关系，来自该项目的构件将以快速的方式从研究转化为实践。该项目有重要的教育和宣传部分，其中包括根据该项目的成果在研究生和本科生层面引入新课程，以及安排针对高中生、妇女和代表性不足的少数群体参加的云计算新兵训练营。

State-of-the-art resource sharing mechanisms in today's datacenters and compute clouds are agnostic to application-level performance requirements, resulting in unpredictable performance. This is especially true for the network. Unlike, CPU, memory, or disk, cloud operators do not provide any guarantees for the network. Many tenants rely on over-provisioning and static allocation for performance isolation, which results in low utilization and increased cost and environmental impacts. This project aims to build a set of solutions to achieve short- and long-term performance predictability with high resource utilization. The goal is to enable coexisting applications from different tenants to meet a variety of performance objectives including obtaining timely responses and minimizing variance of successive responses, while adhering to organizational hierarchies of individual tenants. The key technical challenges in this project include developing short- and long-term resource allocation algorithms, accurate demand estimation, as well as fast and efficient enforcement, all of which are compounded by the multi-resource and shared nature of the network. Two key techniques guide the proposed work: (i) temporal scheduling ensures predictable performance through short- and long-term performance isolation, and (ii) spatial placement ensures higher utilization through initial placement and periodic migration of tenants' virtual machines.Predictable, efficient data analytics will have significant socio-economic ramifications. It will also enable mission-critical applications, e.g., anomaly detection, fraud protection, autonomous vehicles, and robotics-- that require a highly consistent and reliable level of performance to coexist with the less sensitive ones. Algorithms and software from the project will be incorporated into existing open-source big data stacks for public reuse. By leveraging ongoing relationships with the industry, artifacts from this project will be converted from research into practice in a fast manner. The project has significant educational and outreach components, which include introducing new courses at both graduate and undergraduate levels based on the outcomes of this project as well as arranging cloud computing boot camps aimed at students from high schools and involving women and under-represented minorities.