ITR: Hyperion - next generation measurement infrastructure and application use

处理(特别是网络处理器)和存储方面的最新进展为新一代连续监控测量系统提供了技术基础，该系统可以连续和选择性地捕获、处理和存储高带宽链路的分组/分组报头信息，时间从几小时到几天不等。无论是单独还是共同使用这些测量系统，反过来都将实现一套丰富的实时、自适应网络管理和流量分析功能，并进一步增强我们对网络现象的基本理解。在本提案中，我们描述了旨在设计、开发和应用下一代分布式、高性能无源网络测量基础设施的基础、跨学科研究。我们的建议将拥有硬件和体系结构、操作系统、数据库以及网络各个方面(测量、协议设计和分析、路由、安全和应用层覆盖)方面所需专业知识的研究人员聚集在一起。我们的项目，我们称之为Hyperion，大致分为四个工作：(I)我们的第一个重点是设计、开发和原型实施基于新兴网络处理器(NP)芯片的新的适应性、资源感知型网络测量节点架构。(2)虽然单个测量节点必然提供短视的网络视角，但Hyperion节点系统将提供更丰富的网络管理和流量概况分析能力。随着多个Hyperion节点的出现，随之而来的是节点同步、节点放置、节点协调和分布式数据压缩。(Iii)我们还探讨了Hyperion节点的许多应用程序级别的使用，包括故障检测、覆盖支持和流量特征。该应用程序的使用将有助于定义和改进Hyperion API、整体功能以及内部结构和操作。(Iv)我们建议的研究的一个重要部分将是与网络提供商(我们的部门网络、二级区域网络和一级主干网络)合作，以了解网络管理需求，并展示Hyperion的能力。我们还将向外部研究人员分发一些Hyperion节点，并将我们收集的数据提供给其他人使用。

Recent advances in processing (in particular, network processors) and storage provide the technological foundation for a new generation of continuous-monitoring measurement systems that can continuously and selectively capture, process, and store packet/packet-header information for high-bandwidth links for periods of time ranging from hours to days. Use of these measurement systems, both individually and collectively will in turn enable a rich new set of real-time, adaptive network-management and traffic-profiling capabilities, and further enhance our fundamental understanding of network phenomena. In this proposal, we describe fundamental, cross-disciplinary research aimed at the design, development, and application-use of a next generation of distributed, high-performance passive network measurement infrastructure. Our proposal brings together researchers with the needed expertise in hardware and architecture, operating systems, databases, and various aspects of networking (measurement, protocol design and analysis, routing, security, and application-level overlays). Our project, which we refer to as Hyperion, divides broadly into four efforts (i) Our first focus is on the design, development, and prototype implementation of a new adaptable, resource-aware, network measurement node architecture based on the use of emerging network processor (NP) chips. (ii) While a single measurement node necessarily provides a myopic network view, a system of Hyperion nodes will enable a much richer set of network-management and traffic-profiling capabilities. With multiple Hyperion nodes comes the attendant concerns of node synchronization, node placement, node coordination, and distributed data compression. (iii) We also explore a number of application-level uses of Hyperion nodes, including fault-detection, overlay support, and traffic characterization. This application-use will help define and refine Hyperion APIs, overall functionality, and internal structure and operation. (iv) An important part of our proposed research will be to work with network providers (of our departmental networks, a tier-II regional network, and a tier-I backbone network) to understand network-management needs, and demonstrate Hyperion capabilities. We will also distribute a number of Hyperion nodes to external researchers, and make data we collect available to others.