State-Aware Load Shedding From Input Event Streams in Complex Event Processing

State-Aware Load Shedding From Input Event Streams in Complex Event Processing
复制标题

复杂事件处理中输入事件流的状态感知负载卸载

DOI:
--
复制
发表时间:
2022
影响因子:
7.2
通讯作者:
K. Rothermel
K. Rothermel
中科院分区:
计算机科学2区
文献类型:
--
作者:
Ahmad Slo;Sukanya Bhowmik;K. Rothermel

文献摘要

参考文献

被引文献

相似文献

在复杂事件处理(CEP)中,当存在资源限制时,在过载情况下执行减负以维持给定的延迟界限。然而,减负意味着结果质量(QOR)的下降。因此,以对QOR影响最小的方式执行减载是至关重要的。在CEP领域,研究人员建议在超载情况下放弃事件或部分匹配(PM)。他们通过考虑事件的重要性或PM的重要性来为事件或PM分配实用程序,但不能同时考虑两者。在本文中,我们结合了这些方法,其中我们建议通过同时考虑事件重要性和PM的重要性来为事件分配实用程序。我们针对CEP系统提出了两种减负载方法。第一种方法从PM中删除事件,而第二种方法从窗口中删除事件。我们采用概率模型,利用事件在窗口中的类型和位置以及PM的状态来为事件分配效用。我们还提出了一种预测效用阈值的方法,该阈值用于丢弃维持给定延迟界限所需的事件数量。通过对两个真实世界的数据集和几个有代表性的查询的广泛评估,我们表明,在大多数情况下,我们的负载卸载方法的性能优于最新的负载卸载方法w.r.t.库尔。
In complex event processing (CEP), load shedding is performed to maintain a given latency bound during overload situations when there is a limitation on resources. However, shedding load implies degradation in the quality of results (QoR). Therefore, it is crucial to perform load shedding in a way that has the lowest impact on QoR. Researchers, in the CEP domain, propose to drop either events or partial matches (PMs) in overload cases. They assign utilities to events or PMs by considering either the importance of events or the importance of PMs but not both together. In this article, we combine these approaches where we propose to assign a utility to an event by considering both the event importance and the importance of PMs. We propose two load shedding approaches for CEP systems. The first approach drops events from PMs, while the second approach drops events from windows. We adopt a probabilistic model that uses the type and position of an event in a window and the state of a PM to assign a utility to an event. We, also, propose an approach to predict a utility threshold that is used to drop the required amount of events to maintain a given latency bound. By extensive evaluations on two real-world datasets and several representative queries, we show that, in the majority of cases, our load shedding approach outperforms state-of-the-art load shedding approaches, w.r.t. QoR.
复杂事件处理的减载:基于输入和基于状态的技术
DOI: 10.1109/icde48307.2020.00099
发表时间: 2020
期刊: 2020 IEEE 36th International Conference on Data Engineering (ICDE)
影响因子: --
作者:
Bo Zhao;Nguyen Quoc Viet Hung;Matthias Weidlich
通讯作者: Matthias Weidlich