CNS Core: Small: Causal Reasoning for Data-Driven Networking

CNS 核心：小型：数据驱动网络的因果推理

• 批准号: 2212160
• 负责人: Bruno Ribeiro
• 金额: $ 60万
• 依托单位: Purdue University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-10-01 至 2025-09-30
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2212160&HistoricalAwards=false
• 关键词: CNS; Core; Small; Causal; Reasoning

A critical part of providing high quality services over the Internet is optimizing the performance of the underlying networks. With the rise of data analytics and machine learning, network providers have been able to steadily improve the user experience. However, as anyone who has waited a long time for a webpage or video to load knows, there remains a need for ever-better network service. This project tackles this challenge and breaks new ground by applying a different form of machine learning to networking that could potentially offer significant benefits. Here, the goal is answering what-if questions -- i.e., given recorded data of an existing deployed system, what would be the performance impact if we changed the design of the system (e.g., deployed a new video streaming algorithm)? Answering what-if questions of this nature is known as causal reasoning, which considers the effect of events that did not occur while the data was being recorded. Widely used machine learning (ML) tools (e.g., off-the-shelf neural networks) are inadequate for causal reasoning since they merely capture correlations in collected data. This limits them to predictions that pertain to how a deployed system with an existing design performs in the future, and they incur biases when faced with "what-if" questions. Other approaches such as Randomized Control Trials may be disruptive to the performance of live users. This project aims to significantly increase the user experience of Internet services, while making these services cheaper to operate (cost savings that can be passed on to consumers), by allowing operators to ask what-if questions about new networking algorithms on passively collected networked data.This project will bring together network systems, machine learning, and causal inference. More specifically, this project will develop: (i) Causal dependency graphs for real-world networking case studies, and approaches for causal adjustments that consider the ease of measurement in networking, estimator variance, and accuracy of predictions; (ii) Novel approaches to infer latent variables through network models, and through instrumentation to collect additional data that can serve as proxies for these latent variables in a manner that does not impact live users; and (iii) Techniques to bridge ML techniques for inferring latent variables and modeling the proposed changes, with unique challenges posed by incorporating network models. The ideas in this project can be more generally applied in many networking and machine learning domains.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

在互联网上提供高质量服务的一个关键部分是优化底层网络的性能。随着数据分析和机器学习的兴起，网络提供商已经能够稳步改善用户体验。然而，任何等待网页或视频加载很长时间的人都知道，仍然需要更好的网络服务。该项目解决了这一挑战，并通过将一种不同形式的机器学习应用于网络，从而开辟了新的天地，这可能会带来巨大的好处。这里的目标是回答假设问题--即，给定现有已部署系统的记录数据，如果我们更改系统设计(例如，部署新的视频流算法)，会对性能产生什么影响？回答这种性质的假设问题被称为因果推理，它考虑了在记录数据时没有发生的事件的影响。广泛使用的机器学习(ML)工具(例如，现成的神经网络)不足以进行因果推理，因为它们仅捕获收集的数据中的相关性。这将他们限制在与使用现有设计的已部署系统在未来如何表现相关的预测上，并且当面对“假设”问题时，他们会招致偏见。其他方法，如随机对照试验，可能会对现场用户的表现造成干扰。该项目旨在显著提高互联网服务的用户体验，同时使这些服务的运营成本更低(成本节约可以传递给消费者)，允许运营商询问关于被动收集的网络数据的新网络算法的假设问题。该项目将结合网络系统、机器学习和因果推理。更具体地说，这个项目将开发：(I)现实世界网络案例研究的因果依赖图，以及考虑到网络测量的简易性、估计符方差和预测准确性的因果调整方法；(Ii)通过网络模型推断潜在变量的新方法，并通过仪器收集额外的数据，这些数据可以作为这些潜在变量的替代数据，而不影响现场用户；(Iii)将推断潜在变量和对拟议变化进行建模的ML技术与纳入网络模型带来的独特挑战相结合的技术。这个项目中的想法可以更广泛地应用于许多网络和机器学习领域。这个奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Causal lifting and link prediction

• DOI: 10.1098/rspa.2023.0121
• 发表时间: 2023-02
• 期刊: Proceedings of the Royal Society A
• 作者: Leonardo Cotta;Beatrice Bevilacqua;Nesreen Ahmed;Bruno Ribeiro