From Serverless to Seamless: Building the Next-Generation of Cloud Systems by Eliminating Service Integration and Resource Heterogeneity Limitations

云计算在当今IT驱动的社会的许多方面发挥着不可或缺的作用。云计算的持续增长归功于增强了其简单性和可扩展性的技术进步。这一趋势的最新趋势是无服务器计算，它提供了最大的简单性和可扩展性。这是一个快速增长的模式，旨在将基础设施管理与应用程序开发脱钩。在无服务器领域之外，尚未解决的主要限制是无缝：云系统在没有用户干预的情况下处理不同使用场景的能力。我的长期研究目标是设计和构建下一个范式--无缝云服务。该计划通过两个方面的无缝对接来追求这一愿景。开发人员在云中使用各种服务类型，包括不同的虚拟机、微服务和无服务器产品。今天的云系统缺乏对不同服务类型集成的本地支持，导致临时和“科学怪人”混合应用程序。我的目标是通过无缝集成服务类型(Obj.1)，使用两种方法。首先是构建新的云资源管理系统，以改善数据局部性并增强混合应用的生命周期管理。第二种方法涉及建立新的数据共享系统，重点是透明部署和多功能性。无缝程度有限的第二个领域是硬件加速器。构建典型的以CPU为中心的应用程序与为GPU等编写代码有很大不同。未来的云系统应该无缝地利用异类计算基础设施，而无需用户干预，以最大限度地提高性能、效率和利润。因此，我的第二个目标是无缝利用异类资源(Obj.2)，我计划使用三种方法来实现。首先，我将扩展当前的无服务器模型，以无缝支持不同的加速器。接下来，我将启用无缝、无限扩展的加速器。最后，我将开发分布式加速器市场的概念，开发人员可以在其中将不同云提供商的加速器绑定到他们的应用程序。成功完成这些目标将减少云服务的应用开发时间和成本。这将对加拿大企业产生直接影响，并使加拿大在其贸易关系中受益。2019年，美国和加拿大在云和数据存储服务方面的贸易额为9.42亿美元，高于2018年的6.25亿美元和2017年的5.25亿美元。降低加拿大用户的云服务成本可以减缓这一模式。该计划将在计算机系统和云计算领域培训六名HQP，并将为他们在云行业的大量职业机会、相关的软件开发角色和软件系统的学术职位做好准备。该培训计划旨在招聘不同的HQP，并在包容的氛围中提供指导和培训。

Cloud computing plays an integral role in many aspects of today's IT-driven society. The sustained growth of cloud computing is indebted to technical advances that enhanced its simplicity and scalability. The latest in this trend is serverless computing, offering maximum simplicity and scalability. It is a fast-growing paradigm that aims to decouple infrastructure management from app development. The major unsolved limitation beyond the serverless horizon is seamlessness: the ability of cloud systems to handle different usage scenarios without user intervention. My long-term research objective is to design and build this next paradigm -- seamless cloud services. This program pursues this vision by targeting two aspects of seamlessness. Developers use various service types in the cloud, including different virtual machines, microservices, and serverless offerings. Today's cloud systems lack native support for integration of diverse service types, resulting in ad hoc and "Frankenstein" hybrid applications. I aim to resolve this through seamless integration of service types (Obj. 1), using two approaches. The first is to build new cloud resource management systems that improve data locality and enhance lifetime management for hybrid applications. The second approach involves building novel data sharing systems with a focus on transparent deployment and versatility. The second area with limited seamlessness is hardware accelerators. Building a typical CPU-centric application varies greatly from coding for GPUs, etc. Future cloud systems should seamlessly leverage heterogeneous compute infrastructure without user intervention to maximize performance, efficiency, and profit. The goal for my second objective thus is seamless utilization of heterogeneous resources (Obj. 2), which I plan to achieve using three approaches. First, I will extend the current serverless model to seamlessly support different accelerators. Next, I will enable seamless, infinite scaling of accelerators. Finally, I will develop the concept of a distributed accelerator marketplace where developers can bind accelerators of different cloud providers to their applications. Successful completion of these objectives will reduce the app development time and cost of cloud services. This will have a direct impact on Canadian businesses and benefit Canada in its trade relationships. Trades between the U.S. and Canada for cloud and data storage services were valued at USD $942M in favor of the U.S. in 2019, up from USD $625M in 2018 and USD $525M in 2017. Reducing the cost of cloud services for Canadian users can decelerate this pattern. This program will train six HQP in computer systems and cloud computing areas and will prepare them for ample career opportunities in the cloud industry, related software development roles, and academic positions in software systems. The training plan is designed to recruit diverse HQP, and to provide mentorship and training in an inclusive atmosphere.