NeTS-NBD: The Internet Measurements Marketplace

NeTS-NBD：互联网测量市场

• 批准号: 0520105
• 负责人: Michael Rabinovich
• 金额: $ 20万
• 依托单位: Case Western Reserve University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2005
• 资助国家: 美国
• 起止时间: 2005-08-01 至 2007-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0520105&HistoricalAwards=false
• 关键词: NeTS; NBD; Internet; Measurements; Marketplace

Internet measurements drive improvements in Internet infrastructure and provide the foundation for the Internet performance research. Thus, the availability and quality of measurements is of fundamental importance to continued progress in these areas. There have been a number of research projects, such as IDMaps, NIMI, King, and Internet Weather Service, that collect general Internet measurements, and then answer specific measurement requests by estimating the requested values from the collected generic data. At the same time, a need often arises for a focused, on-demand measurement of a certain feature. As a typical example, a company selecting a content delivery network for accelerating its Web site may need to compare the performance of several content delivery networks with respect to a specific client population. While some platforms (most notably, Scriptroute service deployed on PlanetLab and, commercially, Keynote Systems) offer measuring hosts to serve this need, they can provide only a limited number of measuring hosts, and hence a limited perspective on the Internet performance. It is clearly not feasible for a single company to provide a representative sample of the entire Internet. Worse, having a limited number of well-known measuring hosts allows systems being measured to "game the system", by optimizing specifically for those hosts. Finally, the closed proprietary system for Internet measurements limits user choice of the types of measurements. For example, in HTTP, a measurement of a page download done with and without pipelining and persistent connections, and with different caching settings at the client, would yield very different results. One cannot rely on the prowess of a single company to timely detect all the trends in HTTP (or other Internet applications), and provide the entire menu of various modes of client operation. Given the scale of the Internet and the unpredictability of the needs for particular measurements, these limitations can only be overcome by harnessing the capacity of the Internet at large itself. The principal investigators (PIs) propose an open Internet-wide system, named DipZoom (for "Deep Internet Performance Zoom"), which is based on peer-to-peer principles and which would enable focused measurements and numerous measuring choices. There are two key ideas behind DipZoom. First, rather than trying to build a global-scale measuring platform, the PIs propose a matchmaking service that merely provides "plumbing" to connect measurement providers and requesters. The measurements themselves are left to outside providers. Second, they will use a market approach as an effective regulator of system behavior without rigid built-in control mechanisms. Together, these two ideas would create a marketplace for Internet measurements: an open ecosystem where anyone can offer measurements from their computers and other computing devices, and anyone can request measurements. The hope is that the combination of an open system with market forces will encourage great and unpredictable innovation and diversity in the offered measurements and measuring devices. Broader Impact: Such a system would significantly enhance our ability to gain insight into Internet characteristics, enable companies to optimize and monitor their Internet sites for focused client populations, and would make "gaming the system" infeasible due to the number of potential measuring hosts.As the first step in realizing this vision, the PIs will concentrate on building the case for DipZoom during the current award period. This involves obtaining experimental data that would demonstrate DipZoom's benefits in gaining insight into the Internet performance, and detailed conceptual design for the system that would lay the groundwork for a future DipZoom implementation.

互联网测量推动了互联网基础设施的改进，为互联网性能研究提供了基础。因此，衡量标准的可获得性和质量对这些领域的持续进展至关重要。已经有许多研究项目，如IDMaps、NIMI、King和Internet Weather Service，它们收集一般的互联网测量，然后通过从收集的一般数据估计请求的值来回答特定的测量请求。同时，通常需要对某一特性进行集中的、按需测量。作为一个典型的例子，选择内容递送网络来加速其网站的公司可能需要比较几个内容递送网络相对于特定客户群的性能。虽然一些平台(最著名的是部署在PlanetLab上的Scriproute服务以及商业上的Keynote Systems)提供测量主机来满足这一需求，但它们只能提供有限数量的测量主机，因此对互联网性能的视角有限。显然，由一家公司提供整个互联网的代表性样本是不可行的。更糟糕的是，有限数量的知名测量主机允许被测量系统通过专门针对这些主机进行优化来“玩弄系统”。最后，封闭的互联网测量专有系统限制了用户对测量类型的选择。例如，在HTTP中，使用和不使用流水线和持久连接以及在客户端使用不同的缓存设置来测量页面下载会产生非常不同的结果。人们不能依靠一家公司的能力来及时检测HTTP(或其他互联网应用程序)的所有趋势，并提供各种客户端操作模式的完整菜单。鉴于互联网的规模和对特定测量需求的不可预测性，这些限制只能通过利用整个互联网本身的能力来克服。首席调查员提出了一个开放的互联网范围的系统，名为DipZoom(“深度互联网性能缩放”的意思)，该系统基于点对点原则，将使有重点的测量和众多的测量选择成为可能。DipZoom背后有两个关键理念。首先，PI并没有试图建立一个全球范围的测量平台，而是提出了一种配对服务，只提供连接测量提供者和请求者的“管道”。衡量标准本身留给了外部供应商。其次，他们将使用市场方法作为系统行为的有效监管者，而不是僵化的内置控制机制。这两个想法结合在一起，将创造一个互联网测量市场：一个开放的生态系统，任何人都可以从自己的计算机和其他计算设备提供测量数据，任何人都可以请求测量数据。人们希望，开放系统与市场力量的结合将鼓励所提供的测量和测量设备的巨大和不可预测的创新和多样性。更广泛的影响：这样的系统将显著增强我们洞察互联网特征的能力，使公司能够针对重点客户群优化和监控他们的互联网网站，并将由于潜在测量主机的数量而使“游戏系统”变得不可行。作为实现这一愿景的第一步，PI将专注于在当前获奖期间为DipZoom建立案例。这包括获得实验数据，证明DipZoom在洞察互联网性能方面的好处，以及该系统的详细概念设计，这将为未来DipZoom的实施奠定基础。