Resource management in cloud data-centers

点击翻译按钮获取中文摘要

Today’s data center applications include web search, financial services, recommendation systems and social networking which require request completion within a fraction of a second and they are usually called "online data intensive applications" (OLDI). Those requirements are also known as soft real-time requirements and have significant impact on service providers. For example Amazon reported that every 100ms increase of latency reduces business revenue by 1%. The aim of this proposal is to develop algorithms for decreasing response time of applications/jobs running in data centers. In order to achieve that, deep understanding of multi-layer protocol interactions in data centers is needed. We will design cross layer protocol stack for data centers where application information is passed to transport protocol, recorded in switches using SDN and used to schedule the flows in order to meet soft-real time application bounds. Our research activities will include designing priority scheduling of flows based on data skew coming from MapReduce partition/aggregate workflow and designing application admission control with placement of virtual machines. We will also evaluate time needed to set entries in switch forwarding table, and develop schemes for their improvement. We will  deploy SCTP (stream control transmission protocol) as transport protocol in data center network and develop schemes for security isolation among applications in data center.