CNS Core: Small: Embracing cross stack heterogeneity in next-generation cloud platforms

云计算已经成为一种极具吸引力的计算模式，可以为许多应用领域实现更好的规模经济和灵活性。为了迎合这些应用日益增长的服务需求，云平台稳步发展，提供了无数种资源和服务类型。由于在资源配置、计费复杂性和资源需求估计不准确方面的挑战，这使得采用云的过程变得复杂。这让受云束缚的租户面临着一项艰巨的任务，即在公共云资源上托管其应用程序时，实现最佳性价比。另一方面，不断增长的云市场通过快速采用最先进的硬件(例如图形处理单元(GPU)、现场可编程门阵列(FGA)等)和软件(例如虚拟机(VM)、容器和无服务器功能)开发，推动提供商接受硬件和软件级别的异构性。然而，应用程序和底层云计算基础设施之间的主要中介者，即资源管理器和调度器，没有完全准备好充分利用不断发展的系统异构性和软件复杂性。因此，云资源管理和调度框架需要重新审视，以适应新出现的硬件和软件异构性，以最大限度地提高云基础设施的交付性能和能效。该项目通过研究开发租户和提供商认知的可扩展云调度框架的双重方法来解决这些挑战。首先，从租户的角度来看，我们正在开发一个高效的云配置框架，以满足应用程序在成本和性能方面的需求。其次，从提供商的角度来看，我们正在开发一个高效和自适应的资源管理框架，该框架可以利用云堆栈中可用的异构性。资源管理框架将与Kubernetes等商业资源协调器集成，并将使用具有真实工作负载的公共云平台进行评估。该项目的成果应能有效利用云提供商提供的异构性，以提高多个应用领域的性能和能效。这项研究的结果将在云计算的几个领域培育新的研究方向，并将公开调度框架。此外，通过这项研究还将促进本科生的学生培训和研究机会。外展活动包括指导女性和少数族裔学生，参与K-12活动，以及加强部门内的扩大参与计算(BPC)计划。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

Cloud computing has emerged as an attractive computing paradigm to achieve better economy of scale and flexibility for many application domains. For catering to the increasing service demands of these applications, cloud platforms have steadily evolved to offer a myriad of resource and service types. This has complicated the cloud adoption process due to challenges with respect to resource provisioning, billing complexity, and inaccurate resource demand estimation. This leaves cloud-bound tenants with an uphill task of achieving an optimal cost-to-performance ratio when hosting their applications on public cloud resources. On the other hand, the ever-growing cloud market has pushed providers to embrace heterogeneity, both at the hardware and software levels, through the rapid adoption of state-of-the-art hardware (e.g. Graphics Processing Units (GPUs), Field-Programmable Gate Arrays (FPGAs), etc.,) and software (e.g. Virtual Machines (VMs), containers, and serverless functions) developments. However, the main mediator between the applications and the underlying cloud computing infrastructure, which is the resource manager and scheduler, is not fully equipped to make the best use of the ever-evolving system heterogeneity and software complexity. Thus, the cloud resource management and scheduling framework needs a fresh look in order to adapt to the emerging hardware and software heterogeneity to maximize the deliverable performance and energy efficiency of cloud infrastructures. This project adresses these challenges by investigating a two-fold approach for developing a tenant- and provider-cognizant scalable cloud scheduling framework. First, from a tenant's perspective, we are developing an efficient cloud configuration framework that caters to the application requirements in terms of cost and performance. Second, from a provider's perspective, we are developing an efficient and adaptive resource management framework that can exploit the available heterogeneity across the cloud stack. The resource management framework will be integrated with commercial resource orchestrators like Kubernetes and will be evaluated using public cloud platforms with real-world workloads. The outcomes of this project should enable the effective utilization of heterogeneity offered by cloud providers for enhanced performance and energy efficiency across many application domains. The results of this research will foster new research directions in several areas of cloud computing, and the scheduling framework will be made publicly available. Furthermore, student training and research opportunities for undergraduate students will be facilitated through this research. The outreach activities include mentoring of women and minority students, participation in K-12 activities, and strengthening the Broadening Participation in Computing (BPC) program in the department.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.