CSR:Small: Online System Anomaly Prediction and Diagnosis for Large-Scale Hosting Infrastructures

大规模托管基础设施已成为云计算、企业数据中心、海量数据分析和网络托管服务等许多现实系统的重要平台。遗憾的是，今天的大规模托管基础设施仍然容易受到各种系统异常的影响，如性能瓶颈、资源热点、违反服务级别目标(SLO)以及各种软硬件故障。该项目的目标是评估用于大型托管基础设施的在线预测异常管理解决方案的可行性。我们将开发新的技术，用于1)执行轻量级在线系统异常预测；2)提供自我演化的异常预测模型以实现对真实世界动态系统的高质量预测；以及3)执行推测性的“热门”系统异常诊断，在系统接近异常状态时搜索可能的异常原因并建议纠正措施。我们的研究将通过与我们的行业合作伙伴在现实平台上进行实验和案例研究来进行评估。受该项目支持的学生将通过与我们的行业合作伙伴的互动、实习和现场实验，获得开发和测试强大的真实托管基础设施的经验。这项工作将通过吸收来自代表性不足群体的学生来促进多样性。特别是，本项目开发的原型将应用于NCSU的虚拟计算实验室(VCL)，这是一个为K-12、社区学院和大学提供更好教育体验的平台。该奖项是根据2009年《美国复苏和再投资法案》(公法111-5)提供资金的。

Large-scale hosting infrastructures have become important platforms for many real-world systems such as cloud computing, enterprise data centers, massive data analytics, and web hosting services. Unfortunately, today's large-scale hosting infrastructures are still vulnerable to various system anomalies such as performance bottlenecks, resource hotspots, service level objective (SLO) violations, and various software/hardware failures. The goal of this project is to assess the viability of an online predictive anomaly management solution for large-scale hosting infrastructures. We will develop novel techniques for 1) performing light-weight online system anomaly prediction; 2) providing self-evolving anomaly prediction models to achieve high-quality prediction for real-world dynamic systems; and 3) performing speculative, ``hot" system anomaly diagnosis that search possible anomaly causes and suggest corrective actions while the system approaches the anomaly state. Our research will carry out evaluation by conducting experiments and case studies with our industrial partners on realistic platforms. Students supported by this project will gain experience with development and testing of robust real-world hosting infrastructures through interactions with our industrial partners, through internships and onsite experimentation. This work will advance diversity by involving students from under-represented groups. Particularly, the prototype developed in this project will be applied to the Virtual Computing Lab (VCL) at NCSU, a platform for providing a better educational experience for K-12, community colleges, and universities. This award is funded under the American Recovery and Reinvestment Act of 2009 (Public Law 111-5).