III-COR: Exploiting History in Continuous Monitoring Systems

这个名为Moirae的研究项目的目标是调查将历史集成到接近实时的监控系统中的好处和挑战，并构建支持这种集成的新的连续查询引擎。为了实现这一目标，该项目采取了以下步骤：(1)开发针对实时和历史数据的集成查询的新的查询模型；(2)开发有效匹配新事件与相似历史观测的新算法；(3)开发有效支持新查询模型的新的连续查询引擎(该引擎包括分区流数据存储、公平和增量历史查询执行的调度器、用于将历史数据与数据流合并的新算子以及用户反馈机制)；以及(4)评估系统在来自真实应用领域的数据跟踪上的实用性和性能。项目资金支持博士生的培养。然而，该项目包括一个大型系统开发部分，用于培训研究生和本科生进行研究和系统建设。该项目的成果将提供一种新型的连续处理引擎，该引擎将更好地支持从计算机系统监控到网络监控和基于传感器的环境监控等领域的监控应用。这种大规模监控应用程序对于大规模运营的企业至关重要。这些企业需要仔细监控其基础设施，以便有效地处理和诊断故障，并为客户提供高质量的服务。该项目产生的软件和技术论文将通过项目website(http://data.cs.washington.edu/moirae/moirae.shtml).传播

The goal of this research project, called Moirae, is to investigate the benefits and challenges of integrating history into a near-real-time monitoring system and to build a new continuous query engine that supports this integration. To achieve this goal, the project takes the following steps: (1) develop new query models for integrated queries over live and historical data; (2) develop new algorithms that effectively match new events with similar past observations; (3) develop a new continuous query engine that effectively supports the new query model (the engine includes a partitioned stream data store, a scheduler for fair and incremental historical query execution, new operators for merging historical data with data streams, and mechanisms for user-feedback); and (4) evaluate the practicality and performance of the system on data traces from real application domains. Project funds support the training of PhD students. However, the project includes a large system development component that serves to train both graduate and undergraduate students in research and systems building. The result of this project will provide a new type of continuous processing engine that will better support monitoring applications in domains ranging from computer system monitoring, to network monitoring, and sensor-based environment monitoring. Such large-scale monitoring applications are critical for enterprises that operate at large scales. These enterprises need to carefully monitor their infrastructures to effectively handle and diagnose failures and deliver high-quality services to their customers. The software and technical papers resulting from this project will be disseminated through the project website(http://data.cs.washington.edu/moirae/moirae.shtml).