CSR:Medium:Collaborative Research: An Analytical Approach to Quantifying Availability (AQUA) for Cloud Resource Provisioning and Allocation
CSR:中:协作研究:量化云资源配置和分配的可用性 (AQUA) 的分析方法
基本信息
- 批准号:1409809
- 负责人:
- 金额:$ 30万
- 依托单位:
- 依托单位国家:美国
- 项目类别:Standard Grant
- 财政年份:2014
- 资助国家:美国
- 起止时间:2014-09-01 至 2017-08-31
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
Cloud computing will significantly transform the landscape of the IT industry and also impact the economy and society in many ways. The reliability and availability of cloud services, affected by various hardware and software component failures, becomes increasingly more critical, as government agencies, business and people are expected to rely more and more on these services. Lack of a guaranteed high availability of cloud services and applications is considered by many IT professionals as the top concern for preventing a successful implementation of cloud services, followed by device based security and cloud application performance. This project aims to predict the service availability for a given setting, and design effective resource provisioning and allocation algorithms to guarantee a high availability level required by cloud services. The project is expected to significantly advance the state-of-the-art by offering deep insights into the knowledge about accurate prediction and cost-effective guarantee of availability/reliability of cloud services. The outputs from this project can be used to 1) improve service availability, performance and resource utilization while minimizing the cost of overprovisioning, 2) reduce huge losses in revenue and productivity due to service outages while enabling new (mission-critical) applications and services.The existing approaches to ensuring availability are qualitative in that they use heuristics to duplicate data or restrict the number of virtual machines (VMs) that should be placed in the same rack/server to improve reliability/availability of cloud services. However, it is essential to be able to quantify availability for a given setting. Quantifying availability for an often finite service duration via analysis (as opposed to measurement or qualitative evaluation) requires transient, instead of steady state probability analysis based on a wide range of failure and repair/backup models. This project takes a holistic approach to addressing the open challenges via both rigorous analysis and extensive experiments. More specifically, the project leverages two large-scale HPC/Cloud production systems at PI?s institutions to generate a rich set of fine-grained data about physical component failures (which is not available in the public domain). The data is then analyzed to build and verify/validate failure models. Based on the failure models and for a given Infrastructure-as-a-Service (IaaS) request for n virtual machines (VMs), a service duration of t time units and a desired availability level a 1, the project develops an analytical model to predict the availability that can be achieved for the service duration (t), if an additional k backup VMs are allocated. The project also develops cost-effective, multi-objective optimization based cloud resource provisioning and allocation algorithms that determine the appropriate value for k (and the placement of these n+k VMs) in order to achieve the required availability level a.
云计算将显著改变IT行业的格局,并在许多方面影响经济和社会。云服务的可靠性和可用性受到各种硬件和软件组件故障的影响,变得越来越重要,因为政府机构,企业和人们越来越依赖这些服务。许多IT专业人士认为,缺乏云服务和应用程序的高可用性是阻碍云服务成功实施的首要问题,其次是基于设备的安全性和云应用程序性能。该项目旨在预测给定环境下的服务可用性,并设计有效的资源配置和分配算法,以保证云服务所需的高可用性水平。该项目预计将通过深入了解有关准确预测和云服务可用性/可靠性的成本效益保证的知识来显着推进最先进的技术。该项目的产出可用于:1)提高服务可用性、性能和资源利用率,同时最大限度地降低过度配置的成本,2)减少由于服务中断而造成的收入和生产力的巨大损失,同时实现新的(关键任务)应用程序和服务。现有的确保可用性的方法是定性的,因为它们使用数据库复制数据或限制虚拟机的数量(虚拟机),这些虚拟机应放置在同一机架/服务器中,以提高云服务的可靠性/可用性。但是,必须能够量化给定环境的可用性。通过分析(而不是测量或定性评估)来量化通常有限的服务持续时间的可用性需要基于广泛的故障和维修/备份模型的瞬态而不是稳态概率分析。该项目通过严格的分析和广泛的实验,采用整体方法来解决开放的挑战。更具体地说,该项目利用两个大规模的HPC/云生产系统在PI?的机构来生成一组丰富的关于物理组件故障的细粒度数据(这些数据在公共领域中不可用)。然后分析数据以构建和验证/确认故障模型。基于故障模型,对于给定的n个虚拟机(VM)的IaaS请求,t个时间单位的服务持续时间和期望的可用性级别a1,该项目开发了一个分析模型来预测在服务持续时间(t)内可以实现的可用性,如果额外分配k个备份VM。该项目还开发了具有成本效益的、基于多目标优化的云资源配置和分配算法,这些算法可以确定k的适当值(以及这些n+k个虚拟机的位置),以实现所需的可用性级别a。
项目成果
期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
数据更新时间:{{ journalArticles.updateTime }}
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Chunming Qiao其他文献
Decentralized Machine Learning Through Experience-Driven Method in Edge Networks
通过边缘网络中的经验驱动方法进行去中心化机器学习
- DOI:
10.1109/jsac.2021.3118424 - 发表时间:
2022-02 - 期刊:
- 影响因子:16.4
- 作者:
Hongli Xu;Min Chen;Zeyu Meng;Yang Xu;Lun Wang;Chunming Qiao - 通讯作者:
Chunming Qiao
Demo: Attacking LiDAR Semantic Segmentation in Autonomous Driving
演示:攻击自动驾驶中的 LiDAR 语义分割
- DOI:
- 发表时间:
2022 - 期刊:
- 影响因子:0
- 作者:
Yi Zhu;Chenglin Miao;Foad Hajiaghajani;Mengdi Huai;Lu Su;Chunming Qiao - 通讯作者:
Chunming Qiao
Achieving Fine-Grained Flow Management Through Hybrid Rule Placement in SDNs
通过 SDN 中的混合规则放置实现细粒度流量管理
- DOI:
10.1109/tpds.2020.3030630 - 发表时间:
2021-03 - 期刊:
- 影响因子:5.3
- 作者:
Gongming Zhao;Hongli Xu;Jingyuan Fan;Liusheng Huang;Chunming Qiao - 通讯作者:
Chunming Qiao
Integrating Coflow and Circuit Scheduling for Optical Networks
集成光网络协流和电路调度
- DOI:
10.1109/tpds.2018.2889251 - 发表时间:
2019-06 - 期刊:
- 影响因子:5.3
- 作者:
Haibo Wang;Xiwen Yu;Hongli Xu;Jingyuan Fan;Chunming Qiao;Liusheng Huang - 通讯作者:
Liusheng Huang
Spectrum allocation in spectrum-sliced elastic optical path networks using traffic prediction
- DOI:
10.1007/s11107-015-0489-z - 发表时间:
2015-03-24 - 期刊:
- 影响因子:1.700
- 作者:
Sunny Shakya;Xiaojun Cao;Zilong Ye;Chunming Qiao - 通讯作者:
Chunming Qiao
Chunming Qiao的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Chunming Qiao', 18)}}的其他基金
PFI-TT: Crowdsourced Road Geometry Estimation using Smartphones
PFI-TT:使用智能手机进行众包道路几何估计
- 批准号:
2044670 - 财政年份:2021
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
Collaborative Research: CCRI: New: Medium: A Development and Experimental Environment for Privacy-preserving and Secure (DEEPSECURE) Machine Learning
合作研究:CCRI:新:媒介:隐私保护和安全(DEEPSECURE)机器学习的开发和实验环境
- 批准号:
2120369 - 财政年份:2021
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
SCC-IRG Track 2: Towards Quality Aware Crowdsourced Road Sensing for Smart Cities
SCC-IRG 第 2 轨:迈向智慧城市的质量意识众包道路传感
- 批准号:
1737590 - 财政年份:2017
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
MRI: Development of iCAVE2 (Instrument for Connected and Autonomous Vehicle Evaluation and Experimentation)
MRI:开发 iCAVE2(联网和自动驾驶车辆评估和实验仪器)
- 批准号:
1626374 - 财政年份:2016
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
Collaborative Research: Preserving User Privacy in Server-driven Dynamic Spectrum Access System
合作研究:在服务器驱动的动态频谱接入系统中保护用户隐私
- 批准号:
1547223 - 财政年份:2016
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
Collaborative Research: RIPS Type 2: Strategic Analysis and Design of Robust and Resilient Interdependent Power and Communications Networks
合作研究:RIPS 类型 2:稳健且有弹性的相互依赖的电力和通信网络的战略分析和设计
- 批准号:
1441284 - 财政年份:2014
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
CPS: Medium: Addressing Design and Human Factors Challenges in Cyber Transportation Systems
CPS:中:解决网络运输系统中的设计和人为因素挑战
- 批准号:
1035733 - 财政年份:2010
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
EAGER: Create a Socially-aware Single System Image (S3I) in GENI
EAGER:在 GENI 中创建具有社交意识的单一系统映像 (S3I)
- 批准号:
1049775 - 财政年份:2010
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
SGER-Explorying Sociological Orbits in Mobile Users' Mobility Pattern
SGER-探索移动用户移动模式中的社会学轨道
- 批准号:
0553273 - 财政年份:2005
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
Collaborative Research: NeTS-NR: Ultra-Broadband Optical Wireless Communication Networks
合作研究:NeTS-NR:超宽带光无线通信网络
- 批准号:
0435155 - 财政年份:2004
- 资助金额:
$ 30万 - 项目类别:
Continuing Grant
相似海外基金
Collaborative Research: CSR: Medium: Scaling Secure Serverless Computing on Heterogeneous Datacenters
协作研究:CSR:中:在异构数据中心上扩展安全无服务器计算
- 批准号:
2312206 - 财政年份:2023
- 资助金额:
$ 30万 - 项目类别:
Continuing Grant
Collaborative Research: CSR: Medium: Architecting GPUs for Practical Homomorphic Encryption-based Computing
协作研究:CSR:中:为实用的同态加密计算构建 GPU
- 批准号:
2312276 - 财政年份:2023
- 资助金额:
$ 30万 - 项目类别:
Continuing Grant
Collaborative Research: CSR: Medium: Fortuna: Characterizing and Harnessing Performance Variability in Accelerator-rich Clusters
合作研究:CSR:Medium:Fortuna:表征和利用富含加速器的集群中的性能变异性
- 批准号:
2312689 - 财政年份:2023
- 资助金额:
$ 30万 - 项目类别:
Continuing Grant
Collaborative Research: CSR: Medium: Fortuna: Characterizing and Harnessing Performance Variability in Accelerator-rich Clusters
合作研究:CSR:Medium:Fortuna:表征和利用富含加速器的集群中的性能变异性
- 批准号:
2401244 - 财政年份:2023
- 资助金额:
$ 30万 - 项目类别:
Continuing Grant
Collaborative Research: CSR: Medium: Scaling Secure Serverless Computing on Heterogeneous Datacenters
协作研究:CSR:中:在异构数据中心上扩展安全无服务器计算
- 批准号:
2312207 - 财政年份:2023
- 资助金额:
$ 30万 - 项目类别:
Continuing Grant
Collaborative Research: CSR: Medium: Adaptive Environmental Awareness for Collaborative Augmented Reality
协作研究:企业社会责任:媒介:协作增强现实的自适应环境意识
- 批准号:
2312760 - 财政年份:2023
- 资助金额:
$ 30万 - 项目类别:
Continuing Grant
Collaborative Research: CSR: Core: Medium: Scaling Unix/Linux Shell Programs
协作研究:CSR:核心:中:扩展 Unix/Linux Shell 程序
- 批准号:
2312346 - 财政年份:2023
- 资助金额:
$ 30万 - 项目类别:
Continuing Grant
Collaborative Research: CSR: Medium: MemDrive: Memory-Driven Full-Stack Collaboration for Autonomous Embedded Systems
协作研究:CSR:媒介:MemDrive:自主嵌入式系统的内存驱动全栈协作
- 批准号:
2312397 - 财政年份:2023
- 资助金额:
$ 30万 - 项目类别:
Continuing Grant
Collaborative Research: CSR: Medium: MemDrive: Memory-Driven Full-Stack Collaboration for Autonomous Embedded Systems
协作研究:CSR:媒介:MemDrive:自主嵌入式系统的内存驱动全栈协作
- 批准号:
2312396 - 财政年份:2023
- 资助金额:
$ 30万 - 项目类别:
Continuing Grant
Collaborative Research: CSR: Medium: Adaptive Environmental Awareness for Collaborative Augmented Reality
协作研究:企业社会责任:媒介:协作增强现实的自适应环境意识
- 批准号:
2312761 - 财政年份:2023
- 资助金额:
$ 30万 - 项目类别:
Continuing Grant