Accelerating Online Change-Point Detection Algorithm Using 10 GbE FPGA NIC

Accelerating Online Change-Point Detection Algorithm Using 10 GbE FPGA NIC
复制标题

使用 10 GbE FPGA NIC 加速在线变化点检测算法

DOI:
10.1007/978-3-030-10549-5_40
复制
发表时间:
2018
期刊:
--
影响因子:
--
通讯作者:
Hiroki Matsutani
Hiroki Matsutani
中科院分区:
--
文献类型:
--
作者:
Takuma Iwata;K. Nakamura;Yuta Tokusashi;Hiroki Matsutani

文献摘要

相似文献

在统计分析和数据挖掘中,识别作为时间序列的概率分布改变的时间的变点的变点检测已经被用于各种目的,例如对网络流量和交易数据的异常检测。然而,传统的AR(自回归)模型为基础的方法的计算成本太高,不可行的在线。本文提出了一种基于AR模型的在线变点检测算法-ChangeBook,并在基于FPGA(现场可编程门阵列)的网卡上实现。建议的系统计算从10 GbE(10 Gbit以太网)接收的时间序列数据的变点分数。更具体地说,它在主机应用程序之前计算10 GbE NIC上的变点分数。本文旨在减少主机的工作负载,提高变点检测性能,从主机到网卡卸载ChangeData算法。作为评估,在FPGA NIC的变点检测相比,基线软件实现和增强的两个网络优化技术,使用DPDK和Netfilter的吞吐量。结果表明,与基线软件实现相比,变化点检测吞吐量提高了16.8倍。吞吐量达到10 GbE线路速率的83.4%。
In statistical analysis and data mining, change-point detection that identifies the change-points which are times when the probability distribution of time series changes has been used for various purposes, such as anomaly detections on network traffic and transaction data. However, computation cost of a conventional AR (Auto-Regression) model based approach is too high and infeasible for online. In this paper, an AR model based online change-point detection algorithm, called ChangeFinder, is implemented on an FPGA (Field Programmable Gate Array) based NIC (Network Interface Card). The proposed system computes the change-point score from time series data received from 10 GbE (10 Gbit Ethernet). More specifically, it computes the change-point score at the 10 GbE NIC in advance of host applications. This paper aims to reduce the host workload and improve change-point detection performance by offloading ChangeFinder algorithm from host to the NIC. As evaluations, change-point detection in the FPGA NIC is compared with a baseline software implementation and those enhanced by two network optimization techniques using DPDK and Netfilter in terms of throughput. The result demonstrates 16.8x improvement in change-point detection throughput compared to the baseline software implementation. The throughput achieves 83.4% of the 10 GbE line rate.