Collaborative Communication and Computation for Hierarchical Learning at the Mobile Edge

在这个研究项目中，我们研究了一个新兴系统的工程理论和设计，在这个系统中，物联网（IoT）和其他移动设备与附近的计算服务器（称为移动/多访问边缘计算（MEC）主机）协作，以支持机器学习（ML）服务和应用。下面是将这种系统应用于增强现实应用程序时的一个激励示例。我们可能会有多个摄像头，旨在共同识别他们共同视野中的物体，并向附近的移动用户发送上下文增强标签，这些标签可以覆盖他们对实际风景的看法。摄像机本身没有足够的计算能力来识别物体，同时由于数据量大，远程通信有限，将视频发送到远程云服务器进行处理也效率低下。相比之下，MEC主机具有高带宽通信和低延迟计算的独特功能，使其能够及时为摄像机提供帮助。他们可以结合摄像头的信息，执行必要的机器学习计算工作，然后将增强标签发送给移动用户。我们将这种系统命名为基于MEC的协作无线分层ML。

In this research program, we study engineering theories and designs in an emerging system where Internet-of-Things (IoT) and other mobile devices collaborate with nearby computing servers, called Mobile/Multiaccess Edge Computing (MEC) hosts, to support machine learning (ML) services and applications. The following is a motivating example for such a system when it is applied to the augmented reality application. We may have multiple cameras aiming to jointly recognize the objects in their collective field of vision and send contextual augmentation labels to nearby mobile users, which can be displayed overlaying their view of the actual scenery. The cameras by themselves do not have sufficient computational power to recognize the objects, while it is also inefficient to send their videos to a remote cloud server for processing, due to the large data size and the limited communication over a long distance. In contrast, MEC hosts have unique features of high-bandwidth communication and low-latency computation, which enable them to provide timely assistance to the cameras. They can combine the cameras' information, perform the necessary ML computing jobs, and then send the augmentation labels to the mobile users. We name such a system collaborative wireless hierarchical ML over MEC. A crucial component in this emerging multi-level ML hierarchy is the communication pathway linking the large number of computing engines in the IoT devices, MEC hosts, and cloud servers. Furthermore, there is a high level of correlation between the communication and computation requirements, since the amount of transmitted data can vary dramatically depending on the portion of an ML job that is offloaded to the MEC hosts or cloud servers. Effective collaboration among IoT devices and MEC hosts in both communication and computation is crucial to overall system performance. Therefore, in the proposed research, we promote a holistic design of previously separate ML, wireless communication, and distributed computation algorithms. We aim to seamlessly integrate collaborative IoT devices, MEC hosts, and cloud servers, in a joint communication-computation paradigm, to support hierarchical ML services and applications. We will focus on three shorter-term objectives: (1) dynamic ML job division and task placement strategies to achieve optimal trade-off between data efficiency and computation efficiency, (2) integrated communication-computation resource management methods for multi-agent cooperation in hierarchical ML, and (3) algorithms and analytical tools for online ML and scheduling in MEC. The outcomes of the proposed research are expected to contribute substantially to motivate novel system designs in a wide range of services and applications, such as automated manufacturing, remote e-health, environment monitoring, and intelligent transportation. They are expected to have sustained market impact in strategic sectors of the Canadian economy.