NeTS: Medium: Collaborative Research: Optimizing Network Support for Cloud Services: From Short-Term Measurements to Long-Term Planning

在线服务提供商(OSP)在世界各地数据中心的服务器上托管各种应用服务，包括电子邮件、网络搜索、视频流和多人游戏。每个服务都有特定的性能要求。例如，网络搜索和多人游戏需要低延迟，而视频流和批量文件传输需要高吞吐量。客户通过性能迥异的接入网络从不同的地理位置访问这些服务。以合理的成本为这些不同的客户端提供良好的性能是任何OSP的命脉。OSP通过控制内容路由(选择哪个数据中心应为客户端请求提供服务)和网络路由(选择通向客户端的域间路径或OSP自身主干内的路径)，以及通过对未来数据中心和与上游互联网服务提供商的关系进行更长期的规划来影响客户端性能。不幸的是，OSP对端到端性能的可见性相对较差，不能同时调整内容和网络路由以最大化性能；此外，OSP运营商缺乏良好的模型来决定将下一台服务器或数据中心放置在哪里，或者选择哪些ISP作为邻居。为了满足在线服务的广域网络需求，该项目正在设计、实施、部署和评估实用技术，使OSP能够基于有关端到端性能和传输成本的及时和准确信息来执行内容和网络路由(并做出更长期的放置决策)。该项目正在开发技术，以帮助OSP操作员测量、控制和规划分布式服务与其客户端之间以及服务器本身之间的广域连接。该项目的任务包括：(1)设计性能测量技术，并对OSP流量管理进行测量驱动的研究；(2)为OSP主干内的内容和网络路由以及流量管理的联合优化设计、建模和原型协议；为了共同评估我们的算法，并在野外对我们的算法进行评估，该项目将使用网络监控(Bismark、M-Lab，以及在可用的情况下，ISP骨干网络中的测量服务器)、内容和网络路由(Donar和运输门户网站)、云计算(VICCI)和可编程网络(OpenFlow)的实验平台。更广泛的影响：PI正在与业界合作，在运营网络上评估和部署解决方案。他们还将继续在研究生网络课程开发方面进行密切合作，将研究主题和实验平台纳入本项目。作为项目外展的一部分，PI正在组织夏令营？(借鉴他们早先在维尼和俾斯麦项目夏令营的经验)，将代表人数不足的学生带到他们的机构进行暑期实习。私人投资机构还将与代表性不足的地区和机构合作，部署其基础设施，并利用这些平台让教职员工和学生参与研究项目。

Online Service Providers (OSPs) host a wide range of application services, including email, Web search, video streaming, and multiplayer games, on servers in data centers all over the world. Each service has specific performance requirements. For example, Web search and multiplayer games need low latency, whereas video streaming and bulk file transfers need high throughput. Clients access these services from a wide variety of geographic locations over access networks with wildly different performance. Offering good performance to these diverse clients at a reasonable cost is the life blood of any OSP.OSPs affect client performance by controlling content routing (selecting which data center should serve a client request) and network routing (selecting interdomain paths to clients, or paths within the OSP's own backbone), and by longer-term planning of future data centers and relationships with upstream ISPs. Unfortunately, OSPs have relatively poor visibility into end-to-end performance and do not adapt both content and network routing to maximize performance; in addition, OSP operators lack good models for deciding where to place the next server or data center, or which ISPs to select as neighbors.To address the wide-area networking needs of online services, this project is designing, implementing, deploying, and evaluating practical techniques that allow OSPs to perform content and network routing (and make longer-term placement decisions), based on timely and accurate information about end-to-end performance and transit costs. The project is developing techniques to help OSP operators measure, control, and plan the wide-area connectivity between distributed services and their clients, and between the servers themselves. The project tasks include: (1) designing performance-measurement techniques and conduct measurement-driven studies of OSP traffic management; (2) designing, modeling, and prototyping protocols for joint optimization of content and network routing, and traffic management within an OSP backbone; and (3) driving long-term planning of server placement and ISP peer selection based on models of transit costs.To evaluate our algorithms together, and ?in the wild?, the project will use experimental platforms for network monitoring (BISmark, M-Lab, and, where available, measurement servers in ISP backbone networks), content and network routing (DONAR and Transit Portal), cloud computing (VICCI), and programmable networking (OpenFlow). Broader Impact:The PIs are working with industry to evaluate and deploy the solutions on operational networks. They will also continue their close collaboration on graduate networking curriculum development to include the research topics and experimental platforms in this project. As part of the project outreach, the PIs are organizing ?summer camps? (drawing on their earlier experiences with summer camps for the VINI and BISmark projects) to bring under-represented students to their institutions for summer internships. The PIs will also work with under-represented regions and institutions to deploy their infrastructure and engage faculty and students in research projects using the platforms.