Cloud load balancing for low latency applications

点击翻译按钮获取中文摘要

Two Hat Security aims to develop next generation moderation tools to identify offensive images/videos,especially those containing child sexual abuse material (CSAM). If Two Hat is able to detect those contents assoon as they are uploaded to the cloud, it can help to stop the spread of CSAM online. However, this presents adifficult engineering challenge: After Two Hat develops a highly accurate tool to detect CSAM, how can itsupport low latency detection with ever increasing CSAM contents? The proposed project is to achievesub-second detection time in a cloud environment with a large number of servers. We will make use of a recentbreakthrough in cloud load balancing---the so-called Join-the-Idle-Queue (JIQ) strategy. First, we will conducta complete theoretical analysis for JIQ and in doing so obtain important engineering insights. Second, we willdevelop various JIQ algorithms based on our insights. Finally, we will work together with software engineers atTwo Hat to implement our JIQ algorithms on a cloud platform, such as Amazon EC2, Google Cloud, orMicrosoft Azure.