CSR: Small: Collaborative Research: Software Defined Energy Adaptation in Large Scale Data Centers

如今，许多计算和数据密集型应用程序都在数据中心的计算机上运行。因此，数据中心消耗大量的能源。在数据中心内，许多计算、存储和网络组件被协调在一起以支持这些应用。本项目研究如何在保证服务质量（QoS）的同时，有效地分配数据中心的资源，以满足这些应用的要求，同时利用可再生（绿色）能源，以减少总能源消耗。随着数据中心的规模和复杂性的增加，越来越明显的是，传统的分布式资源控制在确保企业应用程序所需的敏捷性和QoS支持方面带来了令人生畏的问题。该问题由于需要积极的能量管理以最小化能量成本、科普与功率和热相关的约束以及适应从本地“绿色”源产生的能量的可变性而进一步复杂化。 能量的分布式管理是特别困难的，因为能量本质上是一种中央资源，必须在各种基础设施组件之间适当地划分，以便产生可接受的应用性能。 该项目探索了一种灵活的、策略驱动的、软件定义的机制，用于管理数据中心各级以及包括网络、存储系统和计算服务器在内的所有主要资源的能源。在这项研究中的一个重要方面是协调能源管理决策在各个层面上，这是必不可少的，以实现最佳性能下给定的能源/热约束。 该项目引入了软件定义资源管理的新兴概念，以无缝解决数据中心的能源可持续性和相应的QoS问题。该项目还形成了软件定义数据中心的试点实现，因为能源适应需要对所有主要数据中心资源进行熟练的管理。在资源分配、资源监控、QoS实施、能量分配和分配等方面设计和开发了一套新的算法。这些算法将被实现到一个特定的框架中，以展示和验证研究的用途和好处。 该项目的更广泛影响包括增强数据中心能源可持续性的机制和大型计算系统软件控制的综合机制。该项目还加强了NSF工业/大学合作研究中心（IUCRC）在智能存储方面的研究，并将其用作行业采用这项研究的渠道。

Today many compute and data intensive applications are running on the computers in data centers. Therefore, data centers consume large amounts of energy. Within a data center, many compute, storage and networking components are coordinated together to support these applications. This project studies how to efficiently allocate resources in data centers to satisfy the requirements of these applications with guaranteed quality of service (QoS) and at the same time taking advantage of the available renewable (green) energy to reduce the total energy to be consumed. As the data centers increase in size and complexity, it is becoming clear that the traditional distributed control of their resources poses daunting problems in ensuring the desired agility and QoS support demanded by the enterprise applications. This problem is further compounded by the need for aggressive energy management in order to minimize energy cost, cope with power and thermal related constraints, and adapt to variability in the energy produced from local "green" sources. A distributed management of energy is particularly difficult since energy by its nature is a central resource that must be properly divided up among various infrastructure components in order to yield acceptable application performance. This project explores a flexible, policy driven, software defined mechanism to manage energy at all levels of the data center and for all major resources including networks, storage systems, and compute servers. A crucial aspect in this research is the coordination of energy management decisions at various levels which is essential to achieve optimal performance under given energy/thermal constraints. The project brings in the emerging concept of software defined resource management to seamlessly tackle the energy sustainability and corresponding QoS issues in data centers. The project also forms a pilot realization of the software defined data center, since energy adaptation requires an adept management of all major data center resources. A set of new algorithms in resource allocation, resource monitoring, QoS enforcement, energy allocation and distribution will be designed and developed. These algorithms will be implemented into a specific framework to demonstrate and validate the usage and benefits of the research. The broader impacts of the project include mechanisms to enhance energy sustainability of data centers and a comprehensive mechanism for software control of large computing systems. The project also augments the research being done in the NSF Industry/University Cooperative Research Center (IUCRC) on intelligent storage and will use it as a conduit for industry adoption of this research.