CAREER: Heterogeneous Elastic Computing over the Cloud - from Theory to Practice

职业：云上的异构弹性计算 - 从理论到实践

• 批准号: 2145835
• 负责人: Mingyue Ji
• 金额: $ 51.86万
• 依托单位: University of Utah
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-02-01 至 2027-01-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2145835&HistoricalAwards=false
• 关键词: CAREER; Heterogeneous; Elastic; Computing; over

Modern cloud-services rely on virtual machines due to their high efficiency and flexibility. Alongside regular services, current new offerings from cloud-service providers allow exploiting under-utilized virtual machines at a fraction of the original cost. Such computing resources, however, are highly heterogeneous and elastic. Heterogeneity means that virtual machines can have different computational speeds and storage constraints. Elasticity means that these virtual machines can be preempted under short notice (on the order of minutes) if a high-priority job appears; on the other hand, new virtual machines may be available over time to compensate for any shortage of computing resources. Such behavior can result in computational failure or significantly increase computing time. In response to the challenges of both heterogeneity and elasticity in cloud systems, this project will formulate new heterogeneous elastic computing frameworks, aiming for optimal and implementable solutions. The results of this project can lead to sizable economic benefits. The project's educational activities are designed to integrate research into teaching, and include mentoring both graduate and undergraduate students, alongside outreach programs to undergraduate and K-12 students, women, and underrepresented minorities with the goal of fostering interest in transformational computing technologies. Another highlight of this project is the newly developed YouTube channel by the investigator that is intended to educate everyone regardless of age, gender, or race. Motivated by practical measurements and constraints, this project formulates new heterogeneous elastic computing frameworks with both coded and uncoded storage placements. Then, it develops novel methodologies using combinatorial and information-theoretic tools to establish fundamental tradeoffs for such systems. Using these theoretical tools, the project designs low-complexity algorithms for real applications and evaluates them on Amazon Elastic Compute Cloud (Amazon EC2) in order to show significant gains of the proposed approaches compared to the state-of-the-art solutions. The project is structured around research topics: (1) heterogeneous coded storage elastic computing; (2) heterogeneous uncoded storage elastic computing; (3) secure uncoded storage elastic computing from user’s perspective and (4) heterogeneous elastic computing: convert theory to practice.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

现代云服务依赖于虚拟机，因为它们具有高效率和灵活性。除了常规服务外，云服务提供商目前提供的新产品允许以原始成本的一小部分开发未充分利用的虚拟机。然而，这样的计算资源是高度异构和弹性的。异构意味着虚拟机可以具有不同的计算速度和存储限制。弹性意味着如果出现高优先级的作业，这些虚拟机可以在短时间内（大约几分钟）被抢占；另一方面，随着时间的推移，新的虚拟机可能会出现，以弥补计算资源的不足。这种行为可能导致计算失败或显著增加计算时间。针对云系统异构性和弹性的双重挑战，本项目将制定新的异构弹性计算框架，旨在寻求最优和可实现的解决方案。该项目的成果可产生可观的经济效益。该项目的教育活动旨在将研究与教学相结合，包括指导研究生和本科生，以及针对本科生和K-12学生、妇女和代表性不足的少数民族的外展项目，目的是培养对转型计算技术的兴趣。该项目的另一个亮点是研究者新开发的YouTube频道，旨在不分年龄，性别或种族教育每个人。在实际测量和约束的推动下，该项目制定了具有编码和非编码存储位置的新的异构弹性计算框架。然后，它开发了使用组合和信息理论工具的新方法，以建立这些系统的基本权衡。使用这些理论工具，该项目为实际应用设计了低复杂度的算法，并在Amazon Elastic Compute Cloud （Amazon EC2）上对它们进行了评估，以显示与最先进的解决方案相比，所提出的方法的显著收益。本项目围绕以下研究主题展开：(1)异构编码存储弹性计算；(2)异构无编码存储弹性计算；(3)用户视角下的安全无编码存储弹性计算；(4)异构弹性计算：将理论转化为实践。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Matrix Multiplication with Straggler Tolerance in Coded Elastic Computing via Lagrange Code

• DOI: 10.1109/icc45041.2023.10279134
• 发表时间: 2023-05
• 期刊: ICC 2023 - IEEE International Conference on Communications
• 作者: Xi Zhong;Jörg Kliewer;Mingyue Ji

GroupSecAgg: Information Theoretic Secure Aggregation with Uncoded Groupwise Keys

• DOI: 10.1109/icc45041.2023.10279171
• 发表时间: 2023-05
• 期刊: ICC 2023 - IEEE International Conference on Communications
• 作者: Kai Wan;Yin Yao;Hua Sun;Mingyue Ji;Giuseppe Caire

A New Design Framework for Heterogeneous Uncoded Storage Elastic Computing

• DOI: 10.23919/wiopt56218.2022.9930566
• 发表时间: 2021-07
• 期刊: 2022 20th International Symposium on Modeling and Optimization in Mobile, Ad hoc, and Wireless Networks (WiOpt)
• 作者: Mingyue Ji;Xiang Zhang;Kai Wan