CSR: Small: Cost-Aware Cloud Profiling, Prediction, and Provisioning as a Service

CSR：小：具有成本意识的云分析、预测和配置即服务

• 批准号: 1816611
• 负责人: Kyle Chard
• 金额: $ 50万
• 依托单位: University of Chicago
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-10-01 至 2023-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1816611&HistoricalAwards=false
• 关键词: CSR; Small; Cost; Aware; Cloud

Cloud computing has the potential to transform computational practice by enabling immediate, on-demand access to large-scale computing resources. But large-scale cloud computing can easily be costly. The Scalable Cost-Aware Cloud Infrastructure Management and Provisioning (SCRIMP) project aims to develop new cloud access methods that will reduce the complexity and cost and improve the efficiency of using cloud resources. The project will innovate in three areas: profiling, prediction, and provisioning. Its new machine learning-based profiling techniques aim to predict application performance, at different levels of accuracy, across a diverse set of cloud resources, based upon derivation of comparable and related instance classes, explorative profiling techniques, and analysis of historical usage. Its ensemble-based market prediction models will allow the many existing cloud market prediction models to be easily compared and then combined so that their collective strengths can be used to predict costs with the aim of minimizing cost, price risk, and likelihood of instance revocation. Finally, its overarching provisioning model will combine application profiles and market prediction models to enable automated, cost-efficient, policy-based cloud provisioning as well as efficient placement and migration of workload within the resulting dynamically provisioned environment.SCRIMP will advance the use of computation across the sciences, particularly within smaller institutions, by simplifying access to on-demand cloud computing and improving the efficiency with which researchers make use of cloud infrastructure. By lowering scientific computing costs and complexity for many users, SCRIMP will enable more efficient use of cloud credits (whether from cloud providers or funding agencies), democratize access to cloud computing by researchers without dedicated computing infrastructure or expertise, and allow researchers and students to conduct increasingly complex analytics, on larger datasets, and at higher resolution. SCRIMP will also be directly relevant in education, allowing educators to provide access to large resource pools at low cost with guaranteed performance.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

云计算有可能通过实现对大规模计算资源的即时、按需访问来改变计算实践。但大规模云计算很容易成本高昂。可扩展的成本感知云基础设施管理和配置（SCRIMP）项目旨在开发新的云访问方法，以降低复杂性和成本，提高云资源的使用效率。该项目将在三个领域进行创新：分析，预测和供应。其新的基于机器学习的分析技术旨在基于可比较和相关实例类的推导、探索性分析技术和历史使用分析，以不同的准确度水平预测各种云资源中的应用程序性能。其基于集成的市场预测模型将允许许多现有的云市场预测模型轻松进行比较，然后进行组合，以便它们的集体优势可用于预测成本，以最大限度地降低成本，价格风险和实例撤销的可能性。最后，其总体配置模型将结合联合收割机应用程序配置文件和市场预测模型，以实现自动化、经济高效、基于策略的云配置，以及在动态配置的环境中有效地放置和迁移工作负载。SCRIMP将推动跨科学计算的使用，特别是在较小的机构中，通过简化对按需云计算的访问并提高研究人员利用云基础设施的效率。通过降低许多用户的科学计算成本和复杂性，SCRIMP将能够更有效地使用云信用（无论是来自云提供商还是资助机构），使没有专用计算基础设施或专业知识的研究人员能够民主化地访问云计算，并允许研究人员和学生在更大的数据集上以更高的分辨率进行越来越复杂的分析。SCRIMP还将直接与教育相关，使教育工作者能够以低成本提供对大型资源库的访问，并保证性能。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Measuring, Quantifying, and Predicting the Cost-Accuracy Tradeoff

测量、量化和预测成本准确性权衡

• DOI: 10.1109/bigdata47090.2019.9006370
• 发表时间: 2019
• 期刊: IEEE International Conference on Big Data (Big Data
• 作者: Baughman, Matt;Chakubaji, Nifesh;Truong, Hong-Linh;Kreics, Krists;Chard, Kyle;Foster, Ian
• 通讯作者: Foster, Ian

Profiling and Predicting Application Performance on the Cloud

• DOI: 10.1109/ucc.2018.00011
• 发表时间: 2018-12
• 期刊: 2018 IEEE/ACM 11th International Conference on Utility and Cloud Computing (UCC)
• 作者: Matt Baughman;Ryan Chard;Logan T. Ward;Jason Pitt;K. Chard;Ian T Foster

FLoX: Federated Learning with FaaS at the Edge

• DOI: 10.1109/escience55777.2022.00016
• 发表时间: 2022-10
• 期刊: 2022 IEEE 18th International Conference on e-Science (e-Science)
• 作者: Nikita Kotsehub;Matt Baughman;Ryan Chard;Nathaniel Hudson;Panos Patros;Omer F. Rana;I. Foster;K. Chard

Enhancing Automated FaaS with Cost-aware Provisioning of Cloud Resources

通过具有成本意识的云资源配置来增强自动化 FaaS

• DOI: 10.1109/escience51609.2021.00053
• 发表时间: 2021
• 期刊: 2021 IEEE 17th International Conference on eScience (eScience
• 作者: Baughman, Matt;Foster, Ian;Chard, Kyle
• 通讯作者: Chard, Kyle

Deconstructing the 2017 Changes to AWS Spot Market Pricing

解读 2017 年 AWS 现货市场定价变化

• DOI: 10.1145/3322795.3331465
• 发表时间: 2019
• 期刊: 10th Workshop on Scientific Cloud Computing
• 作者: Baughman, Matt;Caton, Simon;Haas, Christian;Chard, Ryan;Wolski, Rich;Foster, Ian;Chard, Kyle
• 通讯作者: Chard, Kyle