CSR: Medium: Limiting Manipulation in Data Centers and the Cloud

CSR：中：限制数据中心和云中的操纵

• 批准号: 1161813
• 负责人: Ion Stoica
• 金额: $ 29.95万
• 依托单位: International Computer Science Institute
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2012
• 资助国家: 美国
• 起止时间: 2012-09-01 至 2016-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1161813&HistoricalAwards=false
• 关键词: CSR; Medium; Limiting; Manipulation; Data

Datacenters and clouds have become the main compute platform for many large scale corporations. Petabyte-scale datasets are stored throughout the datacenter and hundreds to thousands of different users submit jobs to collect business intelligence, gather statistics, or to compute essential data, such as a large scale index or a list of top users or their message posts. However, a significant challenge to these centers arises from user manipulation by some or all of the many tenants (both intentional and unintentional) of the underlying resource allocation mechanisms through misreporting of true job characteristics.This project is designing and testing new algorithms combining ideas from computer science and economics which will make datacenters and clouds more robust to user manipulations. It is initially focusing on two important abstractions. The first allocates the total amount of resources and the second allocates individual machines (or virtual machines). The former is the standard abstraction for datacenters and the latter for many clouds, such as Facebook's internal cluster and Amazon's public EC2. For the former, where there are existing non-manipulable algorithms, the PIs are developing extensions to support new requirements, such as jobs with constraints. For the latter, the PIs are inventing new non-manipulable algorithms based on their preliminary studies. In addition, this project is applying recent results from algorithmic mechanism design and game theory to develop general procedures for converting existing manipulable protocols into non-manipulable ones.This project will lead to more robust mechanisms for datacenters and clouds, reducing costs and energy usage.

数据中心和云已经成为许多大型企业的主要计算平台。PB级数据集存储在整个数据中心，数百到数千个不同的用户提交作业以收集商业智能，收集统计数据或计算基本数据，例如大规模索引或顶级用户列表或他们的消息帖子。然而，这些中心面临的一个重大挑战是，用户通过误报真实作业特征来操纵底层资源分配机制的部分或全部租户（有意或无意）。该项目正在设计和测试结合计算机科学和经济学思想的新算法，这将使云计算中心和云计算对用户操纵更具鲁棒性。它最初集中在两个重要的抽象。第一个分配资源总量，第二个分配单个机器（或虚拟机）。前者是云计算中心的标准抽象，后者适用于许多云，例如Facebook的内部集群和Amazon的公共EC2。对于前者，有现有的不可操纵的算法，PI正在开发扩展，以支持新的要求，如作业的约束。对于后者，PI正在根据他们的初步研究发明新的不可操作的算法。此外，该项目还将应用算法机制设计和博弈论的最新成果，开发将现有可操作协议转换为不可操作协议的通用程序。该项目将为数据中心和云提供更强大的机制，从而降低成本和能源使用。