ITR: Hyperion - next generation measurement infrastructure and application use

处理（特别是网络处理器）和存储方面的最新进展为新一代连续监测测量系统提供了技术基础，这些系统可以连续和有选择地捕获、处理和存储高带宽链路的包/包头信息，时间从几小时到几天。使用这些测量系统，无论是单独的还是集体的，都将反过来实现一套丰富的实时、自适应网络管理和流量分析功能，并进一步增强我们对网络现象的基本理解。在本提案中，我们描述了旨在设计、开发和应用下一代分布式、高性能无源网络测量基础设施的基础、跨学科研究。我们的提案汇集了硬件和架构、操作系统、数据库以及网络各个方面（测量、协议设计和分析、路由、安全性和应用程序级覆盖）所需的专业知识的研究人员。我们的项目，我们称之为Hyperion，大致分为四个方面：(i)我们的第一个重点是基于使用新兴网络处理器（NP）芯片的新型适应性，资源感知，网络测量节点架构的设计，开发和原型实现。（ii）虽然单个测量节点必须提供短视的网络视图，但Hyperion节点系统将实现更丰富的网络管理和流量分析功能。对于多个Hyperion节点，随之而来的是节点同步、节点放置、节点协调和分布式数据压缩等问题。（iii）我们还探索了Hyperion节点的一些应用级使用，包括故障检测、覆盖支持和流量表征。这个应用程序将有助于定义和完善Hyperion api、整体功能、内部结构和操作。（iv）我们拟议研究的一个重要部分将是与网络提供商（我们的部门网络、第二级区域网络和第一级骨干网）合作，以了解网络管理需求，并展示Hyperion的能力。我们还将向外部研究人员分发一些Hyperion节点，并使我们收集的数据可供其他人使用。

Recent advances in processing (in particular, network processors) and storage provide the technological foundation for a new generation of continuous-monitoring measurement systems that can continuously and selectively capture, process, and store packet/packet-header information for high-bandwidth links for periods of time ranging from hours to days. Use of these measurement systems, both individually and collectively will in turn enable a rich new set of real-time, adaptive network-management and traffic-profiling capabilities, and further enhance our fundamental understanding of network phenomena. In this proposal, we describe fundamental, cross-disciplinary research aimed at the design, development, and application-use of a next generation of distributed, high-performance passive network measurement infrastructure. Our proposal brings together researchers with the needed expertise in hardware and architecture, operating systems, databases, and various aspects of networking (measurement, protocol design and analysis, routing, security, and application-level overlays). Our project, which we refer to as Hyperion, divides broadly into four efforts (i) Our first focus is on the design, development, and prototype implementation of a new adaptable, resource-aware, network measurement node architecture based on the use of emerging network processor (NP) chips. (ii) While a single measurement node necessarily provides a myopic network view, a system of Hyperion nodes will enable a much richer set of network-management and traffic-profiling capabilities. With multiple Hyperion nodes comes the attendant concerns of node synchronization, node placement, node coordination, and distributed data compression. (iii) We also explore a number of application-level uses of Hyperion nodes, including fault-detection, overlay support, and traffic characterization. This application-use will help define and refine Hyperion APIs, overall functionality, and internal structure and operation. (iv) An important part of our proposed research will be to work with network providers (of our departmental networks, a tier-II regional network, and a tier-I backbone network) to understand network-management needs, and demonstrate Hyperion capabilities. We will also distribute a number of Hyperion nodes to external researchers, and make data we collect available to others.