III-COR: Exploiting History in Continuous Monitoring Systems

这个名为Moirae的研究项目的目标是研究将历史记录集成到近实时监控系统中的好处和挑战，并构建一个支持这种集成的新的连续查询引擎。为了实现这一目标，该项目采取了以下步骤：(1)为实时数据和历史数据的集成查询开发新的查询模型；(2)开发新算法，将新事件与相似的过去观测结果有效匹配；(3)开发一个新的连续查询引擎，有效地支持新的查询模型（该引擎包括一个分区流数据存储，一个公平和增量历史查询执行的调度程序，一个将历史数据与数据流合并的新操作符，以及用户反馈机制）；(4)对系统在实际应用领域的数据轨迹上的实用性和性能进行了评价。项目资金支持博士生的培养。然而，该项目包括一个大型的系统开发组件，用于在研究和系统构建方面培训研究生和本科生。该项目的结果将提供一种新型的连续处理引擎，它将更好地支持从计算机系统监测到网络监测和基于传感器的环境监测等领域的监测应用。这种大规模监控应用程序对于大规模运营的企业至关重要。这些企业需要仔细监控其基础设施，以便有效地处理和诊断故障，并向客户提供高质量的服务。本项目产生的软件和技术文件将通过项目网站（http://data.cs.washington.edu/moirae/moirae.shtml）发布。

The goal of this research project, called Moirae, is to investigate the benefits and challenges of integrating history into a near-real-time monitoring system and to build a new continuous query engine that supports this integration. To achieve this goal, the project takes the following steps: (1) develop new query models for integrated queries over live and historical data; (2) develop new algorithms that effectively match new events with similar past observations; (3) develop a new continuous query engine that effectively supports the new query model (the engine includes a partitioned stream data store, a scheduler for fair and incremental historical query execution, new operators for merging historical data with data streams, and mechanisms for user-feedback); and (4) evaluate the practicality and performance of the system on data traces from real application domains. Project funds support the training of PhD students. However, the project includes a large system development component that serves to train both graduate and undergraduate students in research and systems building. The result of this project will provide a new type of continuous processing engine that will better support monitoring applications in domains ranging from computer system monitoring, to network monitoring, and sensor-based environment monitoring. Such large-scale monitoring applications are critical for enterprises that operate at large scales. These enterprises need to carefully monitor their infrastructures to effectively handle and diagnose failures and deliver high-quality services to their customers. The software and technical papers resulting from this project will be disseminated through the project website(http://data.cs.washington.edu/moirae/moirae.shtml).