Predictive and Adaptive Failure Mitigation to Avert Production Cloud VM Interruptions
Predictive and Adaptive Failure Mitigation to Avert Production Cloud VM Interruptions
复制标题
DOI：
--
复制
发表时间：
2020-12
期刊：
影响因子：
--
通讯作者：
Sebastien Levy;Randolph Yao;Youjiang Wu;Yingnong Dang;Peng Huang;Zheng Mu;Pu Zhao;Tarun Ramani;N. Govindaraju;Xukun Li;Qingwei Lin;Gil Lapid Shafriri;Murali Chintalapati
中科院分区：
文献类型：
--
作者：
Sebastien Levy;Randolph Yao;Youjiang Wu;Yingnong Dang;Peng Huang;Zheng Mu;Pu Zhao;Tarun Ramani;N. Govindaraju;Xukun Li;Qingwei Lin;Gil Lapid Shafriri;Murali Chintalapati
本技术报告是我们的OSDI 2020论文的扩展版本：避免生产云VM中断的预测性和自适应故障缓解。摘要：当生产系统中发生故障时，最高优先级是快速缓解故障。尽管其重要性，但故障缓解是以被动和临时的方式完成的：仅在观察到严重症状后才采取一些固定的操作。对于云系统来说，这样的策略是不够的。在本文中，我们提出了一种预防性和自适应故障缓解服务NARYA，该服务集成在生产云（Microsoft Azure的计算平台）中。Narya根据多层系统信号预测即将发生的主机故障，然后决定智能缓解措施。目标是避免VM故障。Narya的决策引擎采用新颖的在线实验方法，不断探索最佳缓解措施。Narya通过强化学习进一步增强了自适应决策能力。Narya已经投入生产15个月了。与以前的静态策略相比，它平均减少了26%的VM中断。
This technical report is an extended version of our OSDI 2020 paper: Predictive and Adaptive Failure Mitigation to Avert Production Cloud VM Interruptions. Abstract: When a failure occurs in production systems, the highest priority is to quickly mitigate it. Despite its importance, failure mitigation is done in a reactive and ad-hoc way: taking some fixed actions only after a severe symptom is observed. For cloud systems, such a strategy is inadequate. In this paper, we propose a preventive and adaptive failure mitigation service, NARYA, that is integrated in a production cloud, Microsoft Azure’s compute platform. Narya predicts imminent host failures based on multi-layer system signals and then decides smart mitigation actions. The goal is to avert VM failures. Narya’s decision engine takes a novel online experimentation approach to continually explore the best mitigation action. Narya further enhances the adaptive decision capability through reinforcement learning. Narya has been running in production for 15 months. It on average reduces VM interruptions by 26% compared to previous static strategy.