Collaborative Research: IMR: MM-1A: Scalable Statistical Methodology for Performance Monitoring, Anomaly Identification, and Mapping Network Accessibility from Active Measurements

该合作项目旨在开发和实施新的统计方法，用于检测和绘制计算机网络中延迟和带宽质量的各个方面。该项目的第一部分将开发所谓的极端延迟断层扫描，其中将识别经历极端延迟或拥塞的网络链路。这样做的目的是只使用来自网络外围的端到端测量，而不直接观察所有链路。该项目的第二部分将侧重于结合多个数据集和测量方法，以美国人口普查区的分辨率建立一个全州乃至可能全国范围的宽带可及性地图。该项目汇集了来自密歇根大学、加州大学洛杉矶分校和Merit Network的研究人员，他们在网络断层扫描、极端统计和网络测量研究方面具有专业知识。一个核心目标是利用和发展极端统计的新理论，可用于从端到端延迟测量中检测和识别网络中的异常延迟。这将扩展统计、网络断层扫描领域，并为态势感知和服务质量提供新的工具。该项目的第二项核心活动将提供新的统计方法，将多个观测数据集与现有的人口协变量结合起来，以便绘制宽带接入图。这一研究活动将有助于数据集成和迁移学习领域的研究。该项目的广泛影响将是多方面的。该研究的直接影响将是：(i)为网络态势感知和安全开发新的实用工具；绘制宽带可用性地图，这将有助于了解和确定公共政策的优先目标，并有助于解决由于宽带差距造成的社会差距；（iii）该项目将吸引研究生和本科生参与，从而有助于培训下一代网络测量研究人员和统计学家。该项目的成果将通过新颖的理论、方法和算法发展、数据产品和软件，对统计和网络测量研究领域产生更广泛的影响。后者将通过期刊出版物、会议发言和开放源码软件向更广泛的研究界传播。有关研究目标、成就和里程碑的说明将在https://www.merit.edu/initiatives/#activeresearchprojects上公开。此地址将保留与赞助研究相关的数据产品、研究报告、演示文稿和活动的指针。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

This collaborative project aims to develop and implement new statistical methodology for the detection and mapping of various aspects of delays and bandwidth quality in computer networks. Part I of the project will develop the so-called extreme delay tomography, where network links experiencing extreme delays or congestion will be identified. The goal is to do so by using only end-to-end measurements from the perimeter of the network without observing all links directly. Part II of the project will focus on combining multiple data sets and measurements to build a state-wide and potentially nation-wide map(s) of broadband accessibility at the resolution of a US-census block. The project brings together researchers from the University of Michigan, the University of California, Los Angeles, and Merit Network, with expertise in network tomography, statistics of extremes, and network measurement research. One core goal is to utilize and develop new theory on statistics of extremes that can be used to detect and identify anomalous delays in the network from end-to-end delay measurements. This will expand the fields of statistics, network tomography, and provide novel tools for situational awareness and quality of service. The second core activity of the project will contribute new statistical methodology for integrating multiple observational data sets with existing demographic covariates for the purpose of mapping broadband access. This research activity will contribute to the fields of data integration and transfer learning.The broader impacts of the project will be manifold. The direct impact of the research will be on: (i) Developing novel practical tools for network situational awareness and security; (ii) Mapping the broadband availability that will aid in understanding and identifying priority goals for public policy and also in addressing social disparities due to the broadband gap; (iii) The project will engage graduate and undergraduate students and thus contribute to training of the next generation of network measurement researchers and statisticians. The outcomes of the project will have a broader impact on the fields of statistics and network measurement research through novel theoretical, methodological, and algorithmic developments, data products and software. The latter will be disseminated to the broader research communities through journal publications, conference presentations and open-source software.An account of the research goals, achievements, and landmarks will be made publicly available on https://www.merit.edu/initiatives/#activeresearchprojects. This address will maintain pointers to data products, research reports, presentations, and events related to the sponsored research.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.