ITR: Hyperion - next generation measurement infrastructure and application use

处理（特别是网络处理器）和存储方面的最新进展为新一代连续监控测量系统提供了技术基础，该系统可以连续地和选择性地捕获、处理和存储高带宽链路的数据包/数据包报头信息，持续时间从数小时到数天不等。单独和共同使用这些测量系统将反过来实现一组丰富的新的实时，自适应网络管理和流量分析功能，并进一步增强我们对网络现象的基本理解。在这个建议中，我们描述了基础，跨学科的研究，旨在设计，开发和应用程序使用的下一代分布式，高性能的被动网络测量基础设施。我们的提案汇集了在硬件和架构、操作系统、数据库以及网络各个方面（测量、协议设计和分析、路由、安全和应用级覆盖）具有所需专业知识的研究人员。我们的项目，我们称之为网络测量，大致分为四个方面的努力（i）我们的第一个重点是设计，开发和原型实现一个新的适应性强，资源感知，网络测量节点架构的基础上使用新兴的网络处理器（NP）芯片。(ii)虽然单个测量节点必须提供近视的网络视图，但多个测量节点的系统将实现更丰富的网络管理和流量分析功能。使用多个分布式数据库节点，随之而来的问题是节点同步、节点放置、节点协调和分布式数据压缩。(iii)我们还探讨了一些应用程序级的使用，包括故障检测，覆盖支持，和交通特征的节点。这种应用程序使用将有助于定义和完善CNAS API、整体功能以及内部结构和操作。(iv)我们建议的研究的一个重要部分将是与网络提供商（我们的部门网络，第二层区域网络和第一层骨干网络）合作，以了解网络管理需求，并展示可扩展性。 我们还将向外部研究人员分发一些数据库节点，并将我们收集的数据提供给其他人。

Recent advances in processing (in particular, network processors) and storage provide the technological foundation for a new generation of continuous-monitoring measurement systems that can continuously and selectively capture, process, and store packet/packet-header information for high-bandwidth links for periods of time ranging from hours to days. Use of these measurement systems, both individually and collectively will in turn enable a rich new set of real-time, adaptive network-management and traffic-profiling capabilities, and further enhance our fundamental understanding of network phenomena. In this proposal, we describe fundamental, cross-disciplinary research aimed at the design, development, and application-use of a next generation of distributed, high-performance passive network measurement infrastructure. Our proposal brings together researchers with the needed expertise in hardware and architecture, operating systems, databases, and various aspects of networking (measurement, protocol design and analysis, routing, security, and application-level overlays). Our project, which we refer to as Hyperion, divides broadly into four efforts (i) Our first focus is on the design, development, and prototype implementation of a new adaptable, resource-aware, network measurement node architecture based on the use of emerging network processor (NP) chips. (ii) While a single measurement node necessarily provides a myopic network view, a system of Hyperion nodes will enable a much richer set of network-management and traffic-profiling capabilities. With multiple Hyperion nodes comes the attendant concerns of node synchronization, node placement, node coordination, and distributed data compression. (iii) We also explore a number of application-level uses of Hyperion nodes, including fault-detection, overlay support, and traffic characterization. This application-use will help define and refine Hyperion APIs, overall functionality, and internal structure and operation. (iv) An important part of our proposed research will be to work with network providers (of our departmental networks, a tier-II regional network, and a tier-I backbone network) to understand network-management needs, and demonstrate Hyperion capabilities. We will also distribute a number of Hyperion nodes to external researchers, and make data we collect available to others.