A data-driven approach to improving data center efficiency

数据的大规模处理和存储已经成为我们现代社会的基础。几乎所有行业都依赖高效的数据管理和存储，因为推动其业务和最终用户的引擎已变得越来越依赖大规模信息处理和存储所提供的服务。因此，数量惊人的资源(包括货币和环境资源)专门用于数据的存储和管理可能并不令人惊讶。例如，最近的一项研究得出结论，到2025年，管理“数据海啸”可能会消耗全球五分之一的电力。因此，就未来的经济成功和环境影响而言，最佳利用大规模处理和存储数据的系统是至关重要的。当然，计算集群和数据中心的效率问题并不新鲜。近年来，许多研究都集中在问题的许多不同方面，实际上太多了，无法在这项提案中进行详尽的调查。一些例子包括更节能的硬件和能源比例服务器、优化数据中心冷却系统以改善气流、提高数据中心温度、新的存储介质、灵活且可扩展的调度器、分散存储以允许单独扩展存储和计算资源、更轻量级的虚拟化机制、不断提高ML和AI算法的效率等等。推动这一提议的关键观察是，即使在今天，我们仍然严重低效地利用数据中心和集群资源。针对高密度进行了优化的服务器虚拟化和超大规模数据中心的出现，以及关于该主题的丰富的学术文献给人的印象是，当今的计算基础设施总体上得到了有效利用。相比之下，PI最近与几家运营自己的数据中心的大公司的讨论显示，数据中心的利用率仍然很低，典型的利用率水平在5%-25%之间，即使是超大规模的数据中心也是如此。对于较小的系统，据信利用率更低。本提案中工作的长期目标是确定、表征和消除当今存储和计算基础架构中效率低下的主要来源，并提高它们的利用率。该方法将遵循PI标志性的研究方法：与行业合作，从生产机器获得真实数据，分析这些数据以表征和识别问题，并使用严格的统计和算法方法来解决核心问题。该提案概述了一套具体的近期目标，国际和平倡议在她最近的工作中确定了这些目标，并计划在5年内解决这些目标。她预计，这些结果将开辟新的研究线索，为更长期的研究议程提供信息。

Large-scale processing and storage of data has become the underpinning of our modern society. Nearly all industry sectors depend on efficient data management and storage as the engine that moves their business and end-users have grown dependent on services enabled by large-scale processing and storing of information. Consequently, it is maybe not surprising that a staggering amount of resources (both monetary as well as environmental) are dedicated to the storage and management of data. For example, a recent study concludes that managing the `Tsunami of data' could consume one fifth of global electricity by 2025. As a result, making optimal use of systems for processing and storing data at large scale is critical both in terms of future economic success and environmental impact. Of course, the problem of efficiency in compute clusters and data centers is not new. Much research in recent years has focused on many different facets of the problem, too many in fact to include an exhaustive survey in this proposal. Some examples include more energy-efficient hardware and energy-proportional servers, optimizations to the data center cooling system to improve airflow, increasing data center temperatures, new storage media, flexible and scalable schedulers, disaggregated storage to allow separate scaling of storage and compute resources, more light-weight virtualization mechanisms, continuous improvements in the efficiency of ML and AI algorithms and many more. The key observation motivating this proposal is that even today we are still making terribly inefficient use of data center and cluster resources. The advent of server virtualization and hyper-scale data centers, which are optimized for high density, and the rich academic literature on the topic create the impression that today's compute infrastructure is generally efficiently utilized. In contrast, the PI's recent discussions with several large companies operating their own data centers revealed that data centers are still greatly under-utilized, with typical utilization levels in the 5-25% range, even for hyper-scale data centers. For smaller systems utilization is believed to be even worse. The long-term goal of the work in this proposal is to identify, characterize and remove major sources of inefficiency in today's storage and compute infrastructures, and increase their utilization. The methodology will follow the PI's signature approach to research: form collaborations with industry to gain access to real data from production machines, analyze said data to characterize and identify problems, and use rigorous statistical and algorithmic methods to tackle core problems. The proposal outlines a set of specific near-term objectives that the PI identified in her recent work and plans to address over a 5-year horizon. She expects the results will open up new threads of research that will inform a longer term research agenda.