ANLS: Adaptive Non-Linear Sampling Method for Accurate Flow Size Measurement
ANLS: Adaptive Non-Linear Sampling Method for Accurate Flow Size Measurement
复制标题
DOI：
10.1109/tcomm.2011.112311.100622
复制
发表时间：
2012-03
影响因子：
8.3
通讯作者：
Chengchen Hu;B. Liu;Sheng Wang;J. Tian;Y. Cheng;Yan Chen
中科院分区：
文献类型：
--
作者：
Chengchen Hu;B. Liu;Sheng Wang;J. Tian;Y. Cheng;Yan Chen
采样技术已广泛部署在网络测量系统中，以控制内存消耗和处理开销。然而，大多数现有方法对于小规模流量的估计存在较大误差。为了解决这个问题，我们提出了一种自适应非线性采样（ANLS）方法来估计流量大小。 ANLS不是静态预先配置采样率，而是根据相应计数器的值动态调整每个流的采样率。当计数器值较大时，采用较小的采样率，而计数器较小时，采用较大的采样率。本文通过理论分析和实验评估，研究了无偏流大小估计、相对误差和所需计数器大小。分析和实验表明，ANLS可以显着提高估计精度（特别是对于小规模流），并节省内存消耗，同时保持与现有方法相当的处理开销。此外，我们通过实现基于 FPGA 的原型来验证 ANLS 的设计，该原型能够测量高达 26.5 Gbps 的流量吞吐量。
Sampling technology has been widely deployed in network measurement systems to control memory consumption and processing overhead. However, most of the existing methods suffer from large errors for the estimation of small-size flows. To address this problem, we propose an adaptive non-linear sampling (ANLS) method for flow size estimation. Instead of statically pre-configuring the sampling rate, ANLS dynamically adjusts the sampling rate for each flow according to the value of a corresponding counter. A smaller sampling rate is utilized when the counter value is large, while a larger sampling rate is employed for a smaller counter. In this paper, the unbiased flow size estimation, the relative error, and the required counter size are studied through theoretical analysis and experimental evaluations. The analysis and experiments demonstrate that ANLS can significantly improve the estimation accuracy (particularly for small-size flows), and save memory consumption, while maintaining processing overhead comparable to existing methods. Moreover, we validate the design of ANLS by implementing an FPGA-based prototype, which is capable of measuring traffic throughput up to 26.5 Gbps.