Collaborative Research: Modular Strategies For Global Internetwork Monitoring

这个项目解决了从多个监测点检测和分类空间分布网络异常这一长期存在的难题。为了描述互联网的基线与异常行为，需要部署协作数据收集、异常检测和复杂大规模系统的模式识别。该项目结合了三个互补学科的主要研究人员的力量：(i)网络和数据收集；（ii）统计数据分析及信号处理；（三）分散决策。这项研究远远超出了中央管理网络的最先进的异常检测。特别是，正在开发工具和实用的数据共享算法，用于检测协调入侵、分布式拒绝服务攻击和互联网等分散网络中的服务质量下降。该项目还包括具有更广泛影响的活动，包括：创建公共网络异常数据库、K-12教育推广和大学-工业合作。该研究方法基于模块化和分布式监控范例，该范例被组织为三个层次结构：来自服务器、路由器和交换机的本地级数据测量；中级数据分析和处理端到端的流量测量、汇总统计和从本地传输的警报；而上层的决策和处理信息则传递给中层。这种模块化结构可扩展到大型监测站点网络。然而，这种结构也对数据分析施加了限制，这需要开发新的方法。目前正在采用三种方法：利用小波对图进行分布式时空数据分析；使用分布式模式分析和学习进行事件检测和分类；利用离散事件动力系统和分散随机系统进行多点事件关联。

ABSTRACT0325701Eric D. KolaczykBoston UThis project addresses the longstanding and difficult problem of detecting and classifying spatially distributed network anomalies from multiple monitoring sites. To characterize baseline vs. anomalous behavior of the Internet requires deployment of collaborative data collection, anomaly detection and pattern recognition for complex largescale systems. The project combines the forces of leading researchers in three complementary disciplines: (i) networking and data collection; (ii) statistical data analysis and signal processing; (iii) decentralized decision-making. The research goes well beyond the state-of-the art anomaly detection for centrally administered networks. In particular tools and practical data sharing algorithms are being developed for detecting coordinated intrusions, distributed denial of service attacks, and quality-of-service degradations in decentralized networks such as the Internet. The project also includes activities with broader impact including: creation of a public network anomaly database, K-12 educational outreach, and university-industry collaborations.The research approach is based on a modular and distributed monitoring paradigm that is organized into a three level hierarchy: local level measurement of data from servers, routers and switches; intermediate level data analysis and processing of end-to-end traffic measurements, summary statistics and alarms transmitted from the local level; and upper level decision-making and processing of information transmitted from the intermediate level. This modular structure is scalable to large networks of monitoring sites. However, this structure also imposes constraints on data analysis, which requires development of new approaches. Three approaches are being pursued: distributed spatio-temporal data analysis using wavelets over graphs; event detection and classification using distributed pattern analysis and learning; and multi-site event correlation using discrete event dynamical systems and decentralized stochastic systems.