State-Aware Load Shedding From Input Event Streams in Complex Event Processing
State-Aware Load Shedding From Input Event Streams in Complex Event Processing
复制标题
复杂事件处理中输入事件流的状态感知负载卸载
DOI:
--
复制
发表时间:
2022
影响因子:
7.2
通讯作者:
K. Rothermel
中科院分区:
文献类型:
--
作者:
Ahmad Slo;Sukanya Bhowmik;K. Rothermel
In complex event processing (CEP), load shedding is performed to maintain a given latency bound during overload situations when there is a limitation on resources. However, shedding load implies degradation in the quality of results (QoR). Therefore, it is crucial to perform load shedding in a way that has the lowest impact on QoR. Researchers, in the CEP domain, propose to drop either events or partial matches (PMs) in overload cases. They assign utilities to events or PMs by considering either the importance of events or the importance of PMs but not both together. In this article, we combine these approaches where we propose to assign a utility to an event by considering both the event importance and the importance of PMs. We propose two load shedding approaches for CEP systems. The first approach drops events from PMs, while the second approach drops events from windows. We adopt a probabilistic model that uses the type and position of an event in a window and the state of a PM to assign a utility to an event. We, also, propose an approach to predict a utility threshold that is used to drop the required amount of events to maintain a given latency bound. By extensive evaluations on two real-world datasets and several representative queries, we show that, in the majority of cases, our load shedding approach outperforms state-of-the-art load shedding approaches, w.r.t. QoR.
DOI:
10.1109/icde48307.2020.00099
发表时间:
2020
期刊:
2020 IEEE 36th International Conference on Data Engineering (ICDE)
影响因子:
--
作者:
Bo Zhao;Nguyen Quoc Viet Hung;Matthias Weidlich
通讯作者:
Matthias Weidlich