NGNI-Medium: Collaborative Research: MUNDO: Managing Uncertainty in Networks with Declarative Overlays

我们正在进入信息生产的工业革命。 过去，数据是通过键盘输入“手工制作”的，而今天的数据越来越多地由机器制造：传感器、摄像头、软件日志等。为了在这些情况下提供有用的信息，多个位置的计算机必须通过网络进行协调，因为数据分布广泛且数量庞大，并且不能及时地在单个位置“存储”。 更糟糕的是，传感器数据是典型的“噪音”或错误的各种方式，所以统计方法必须采用原始的“证据”数据转换成概率可靠的信息。在这个项目中，我们开发新的技术，从人工智能的统计推理方法与覆盖网络算法开发的点对点和无线设置。我们设计了新的覆盖网络算法定制的分布式推理。 我们还开发了网络感知的推理算法，可以权衡推理近似质量的通信效率和鲁棒性网络故障。 最后，我们探讨了使用一个高层次的声明性语言编程的网络和推理逻辑。 高级语言使我们能够研究编译技术，以共同优化推理和覆盖网络任务，以实现最大效用。 我们通过在Emulab和Planetlab等测试平台上部署的开源实现来原型化和评估我们的想法。软件和研究论文在http://declarativity.net上发布。

We are entering an Industrial Revolution in the production of information. While in the past data was "handmade" by typing on keyboards, today data are increasingly manufactured by machines: sensors, cameras, software logs, etc. When harnessed in a timely manner, these data can have significant positive impact in many contexts, including early warning and rapid response in natural disasters, air quality monitoring, and improved Internet security. To provide useful information in these contexts, computers in multiple locations must coordinate over networks, because the data are both widely distributed and massive, and cannot be "warehoused" at a single location in a timely manner. Worse, sensor data is typical "noisy" or erroneous in various ways, so statistical methods must be employed to convert the raw "evidence" data into probabilistically reliable information.In this project we develop new techniques to integrate statistical inference methods from AI with overlay network algorithms developed for peer-to-peer and wireless settings. We design new overlay network algorithms customized for distributed inference. We also develop network-aware inference algorithms that can trade off inference approximation quality for communication efficiency and robustness to network failure. Finally, we explore the use of a high-level declarative language for programming both the networking and inference logic. The high-level language enables us to investigate compilation techniques to co-optimize the inference and overlay network tasks for maximal utility. We prototype and evaluate our ideas via open-source implementations deployed on testbeds like Emulab and Planetlab. Software and research papers are disseminated at http://declarativity.net.