Scouts: Improving the Diagnosis Process Through Domain-customized Incident Routing
Scouts: Improving the Diagnosis Process Through Domain-customized Incident Routing
复制标题
DOI：
10.1145/3387514.3405867
复制
发表时间：
2020-07
期刊：
影响因子：
--
通讯作者：
Jiaqi Gao;Nofel Yaseen;Robert MacDavid;F. Frujeri;Vincent Liu;R. Bianchini;Ramaswamy Aditya;Xiaohang Wang;Henry Lee;D. Maltz;Minlan Yu;Behnaz Arzani
中科院分区：
文献类型：
--
作者：
Jiaqi Gao;Nofel Yaseen;Robert MacDavid;F. Frujeri;Vincent Liu;R. Bianchini;Ramaswamy Aditya;Xiaohang Wang;Henry Lee;D. Maltz;Minlan Yu;Behnaz Arzani
事件路由对于在云中维护服务级别目标至关重要：由于路由错误，诊断时间可能会增加10倍。由于当今数据中心（DC）应用程序及其依赖关系的复杂性，正确路由事件具有挑战性。例如，在VM上运行的应用程序可能依赖于正常运行的主机服务器、远程存储服务以及虚拟和物理网络组件。对于任何一个团队，基于规则的系统，甚至机器学习解决方案来说，都很难完全了解事件路由问题的复杂性并解决问题。我们提出了一个不同的方法，使用每队童子军。每个队伍的侦察兵都是守门人-它将相关事件发送给队伍，并将不相关的事件发送出去。我们通过收集这些童子军来解决问题。仅我们的PhyNet Scout--目前部署在生产中--就减少了我们数据集中65%的错误路由事件的缓解时间。
Incident routing is critical for maintaining service level objectives in the cloud: the time-to-diagnosis can increase by 10x due to mis-routings. Properly routing incidents is challenging because of the complexity of today's data center (DC) applications and their dependencies. For instance, an application running on a VM might rely on a functioning host-server, remote-storage service, and virtual and physical network components. It is hard for any one team, rule-based system, or even machine learning solution to fully learn the complexity and solve the incident routing problem. We propose a different approach using per-team Scouts. Each teams' Scout acts as its gate-keeper --- it routes relevant incidents to the team and routes-away unrelated ones. We solve the problem through a collection of these Scouts. Our PhyNet Scout alone --- currently deployed in production --- reduces the time-to-mitigation of 65% of mis-routed incidents in our dataset.