CSR: Small: Collaborative Research: Enhancing Cloud Performance With On-Demand Isolation

计算系统的现代趋势是向包含大量异类计算和I/O资源的系统体系结构发展。不幸的是，虽然规模的增加允许增加工作负载整合，其中单个系统并行运行多个独立的应用程序，但其代价是在不同的应用程序工作负载之间引入更多的干扰。工作负载干扰是一个应用程序的行为影响另一个应用程序性能的结果，即使两个应用程序运行在不同的硬件资源上。这可能是由于对共享硬件资源(如末级缓存、内存控制器或I/O设备)或甚至操作系统管理的软件资源的争用。跨工作负载干扰对于云托管服务等大规模共享基础设施来说尤其成问题，这些基础设施依赖于在单个数据中心环境中共同托管大量完全不同的工作负载。防止干扰效应对于云计算完全兑现其作为通用计算底层的承诺至关重要。该项目通过提供一个整体系统来解决跨工作负载干扰的问题，该系统既能检测干扰对应用程序的影响，又能通过在底层系统软件中提供动态隔离功能来减轻干扰的影响。该方法依赖于对底层硬件资源进行动态分区的能力，从而在硬件层实现隔离，同时还允许对系统软件进行分区以避免对系统软件本身中存在的更抽象的资源的争用。为了实现这些目标，这项工作实现了“虚拟平台”抽象，表示分配给特定任务或工作负载的单个且可隔离的系统域，并由一个或多个虚拟机实例组成。虚拟平台本身被分配了由独立的“可隔离单元”组成的硬件资源分配。这些单元是通过将本地硬件资源分解为资源的最细粒度细分来创建的，这些资源既可以单独分配，也可以有效地与系统的其余部分隔离。虽然向虚拟平台提供分区的硬件资源提供了硬件级别的隔离，但它不解决由系统软件产生的干扰。通过多堆栈虚拟化对系统软件本身进行分区，可避免软件级别的干扰。通过将多个独立的系统软件层的托管资源限制在分配给虚拟平台的集合中，多堆栈虚拟化允许多个独立的系统软件层在同一本地系统上共存。总而言之，该系统在硬件层和软件层都提供了完全的隔离能力。

The modern trend in computing systems is towards system architectures containing a large numbers of heterogeneous computational and I/O resources. Unfortunately, while the increase in scale allows increased workload consolidation, wherein a single system runs multiple independent applications in parallel, it does come at the cost of introducing increased interference across the different application workloads. Workload interference is the result of the behavior of one application impacting the performance of another, even if both applications are running on different hardware resources. This can be due to contention on shared hardware resources (such as last level caches, memory controllers, or I/O devices) or even software resources managed by the operating system. Cross workload interference is especially problematic for large scale shared infrastructures such as cloud hosting services, which rely on co-hosting large numbers of widely disparate workloads inside a single datacenter environment. Preventing interference effects is critical for cloud computing to fully deliver on its promise as a universal computing substrate. This project addresses the problem of cross workload interference, by providing a holistic system that both detects the impact of interference on applications and mitigates its effects by providing dynamic isolation capabilities in the underlying system software. This approach relies on the ability to dynamically partition the underlying hardware resources such that isolation is achieved at the hardware layer, while also allowing the partitioning of system software to avoid contention on more abstract resources present in the system software itself. To achieve these goals this work implements a "Virtual Platform" abstraction representing an individual and isolatable system domain assigned to a particular task or workload and consisting of one or more virtual machine instances. The virtual platform itself is assigned an allocation of hardware resources consisting of independent "isolatable units." These units are created through the decomposition of local hardware resources into the finest grained subdivision of resources that can be both individually allocated and effectively isolated from the rest of the system. While providing partitioned hardware resources to a virtual platform provides hardware level isolation, it does not address interference generated by the system software. Avoiding software level interference is achieved by partitioning the system software itself through Multi-Stack Virtualization. Multi-stack virtualization allows multiple independent system software layers to co-exist on the same local system by restricting their managed resources to the set allocated to a virtual platform. Taken together this system provides full isolation capabilities at both the hardware and software layers.