SGER: Context-Aware Multi-Resource Management for High Service Availability on Internet Servers

背景Internet服务具有突发业务的特点。为了应对突发性和保护有价值的客户免受流量激增的影响，压力弹性服务器必须能够协调控制不同类别请求的质量，以保证在压力条件下公平和优雅的性能下降，这种质量保证技术还可以通过降低可疑意图请求的服务质量来保护服务器免受分布式拒绝服务攻击。该项目的目标是开发一个应用级的多资源管理机制和协调的空间/时间请求调度策略，以提高流媒体服务器的压力弹性和高服务可用性。首先是谐波网络I/O带宽分配方案。该方案不仅最大限度地提高了整体带宽利用率，但也提供了自我管理和性能隔离功能，以保证质量间隔在不同的请求类之间的流比特率和提高服务的可用性。第二种是一种新的请求调度算法与自调整反馈控制，确保公平和优雅的性能下降的请求，就其启动延迟。自调整反馈控制处理互联网流量突发的影响，并提供一致的质量保证，在长期和短期的时间尺度。该项目的第三个新奇在于协调的多资源管理策略，该策略决定何时以及如何调度流请求，以满足流比特率和启动延迟方面的质量要求，同时最大限度地提高流服务的可用性。更广泛的影响当今的互联网服务往往容易受到流量激增的影响。这项研究将促进发现和理解的质量保证问题的压力条件。通过将提出的压力弹性技术融合到流媒体服务中，这项研究将最终提高服务的可用性和压力和DDoS攻击的生存能力。此外，该项目还有一个整体教育部分。有关互联网服务的研究为基础的材料将灌输到本科生和研究生分布式计算课程。代表性不足的学生也将被创新，参与这一综合研究和教育项目。

BackgroundInternet services have a characteristic of bursty traffic. To deal with the burstiness and protect valuablecustomers from traffic surge, a stress-resilient server must be able to control the quality of different classes of requests in a coordinated way so as to guarantee a fair and graceful performance degradation in stress conditions.Such quality assurance technologies can also protect the server from distributed denial-of-serviceattacks by downgrading the service quality of the requests with suspicious intentions. The goal of this projectis to develop an application-level multi-resource management mechanism and a coordinated space/time request scheduling strategy for stress-resilience and high service availability on streaming servers.Intellectual MeritThe proposed resource management system features three key innovations. First is a harmonic network-I/O bandwidth allocation scheme. The proposed scheme not only maximizes the overall bandwidth utilization, but also provides self-management and performance isolation features to guarantee quality spacings in terms of stream bitrate between different request classes and to enhance the service availability. Second is a novel request scheduling algorithm with self-tuning feedback control that ensures fair and graceful performance degradation of requests with respect to their startup latency. Self-tuning feedback control deals with the impact of Internet traffic burstiness and provides consistent quality assurance in both long and short timescales. The third novelty of this project lies in a coordinated multi-resource management strategy that determines when and how to schedule stream requests so as to meet the quality requirements in terms of both stream bitrate and startup latency and meanwhile maximizing the streaming service availability.Broader ImpactTodays Internet services are often vulnerable to traffic surge. This research will advance discovery and understanding of the quality assurance problem in stress conditions. By fusing the proposed stress-resilient technology into streaming services, this research will ultimately enhance the service availability and survivability to stress and DDoS attacks. In addition, this project has an integral education component. Research-based materials about Internet services will be instilled into the undergraduate and graduate distributed computing curriculum. Under-represented students will also be innovated to participatein this integrated research and education project.