EAGER:Real Time Federated Learning using Kernel Methods

我们越来越多地看到来自各种不同应用的动态数据量，从电网到交通系统，从医疗保健网络到社交网络数据。这些数据来自各种来源，包括传感器网络和物联网应用。 一个共同的特点是，这些数据中的大部分是分布式的（在边缘），需要建立方法来处理，学习和从这些数据中做出决策。 一种方法是将所有数据收集在一个中央处理器（在云中），并在计算资源更大的地方处理、学习和做出决策。 然而，边缘设备通常受到通信成本的限制，这导致相当大的功耗，特别是如果边缘设备需要通过无线网络发送信息。 已经提出了联合学习，其中边缘设备不向中央处理器发送数据，而是向边缘设备发送模型的模型参数（权重）。 每个边缘设备基于其接收的数据修改权重，然后将修改后的权重发送回中央处理器。 该建议开发简单的实时学习算法在边缘处理器的无约束优化方法的基础上，使用联邦学习的原则和研究电力系统的应用。 研究成果将被纳入机器学习和信号处理的研究生和本科课程。通过夏威夷土著科学和工程导师计划（NHSEMP）和女工程师协会（SWE），将特别关注招聘和保留代表性不足的学生。该项目利用联邦学习，自适应信号处理，图形信号处理，优化和内核方法的原理，在实时分布式学习和决策领域取得了进展。 该研究是融合信号处理，数学，统计学和计算机科学领域在一起。 贡献是在三个领域：算法的开发，分析和applicationsto电力网。 重点是设计简单的在线内核算法，适用于监督学习（回归，预测，分类）和无监督学习（主成分分析，概率密度估计）。 该算法专注于边缘计算，使用来自在线最小二乘核方法的优化方法，使用随机梯度的变体以及表示为图形的节点之间的时间和空间关系。 权衡考虑优化目标函数，收敛性，计算复杂性和通信成本之间。 在线分布式内核算法，然后应用于检测电网上的坏数据，并提供分布式学习能力的需求响应（DR）programmes.This奖项反映了NSF的法定使命，并已被认为是值得的支持，通过评估使用基金会的智力价值和更广泛的影响审查标准。

We are increasingly seeing increasing amounts of dynamic data coming from a variety of different applications ranging from the electric power grid to transportation systems to healthcare networks to social network data. This data comes from a variety of sources including sensor networks and IoT applications. A common feature is that much of this data is that it is distributed (at the edge) and methodologies need to be established to process, learn, and make decisions from this data. One approach is to gather all the data together at a central processor (in the cloud) and to process, learn, and make decisions here where computing resources are greater. The edge devices however are often constrained by communication costs which results in considerable power consumption especially if edge devices need to send information over wireless networks. Federated learning has been proposed where edge devices do not send data to the central processor, but send model parameters (weights) of model to edge devices. Each edge device modifies the weights based on data it receives and then send the modified weights back to the central processor. This proposal develops simple real-time learning algorithms at the edge processor based on unconstrained optimization methods using principles of federated learning and studies applications for power systems. The research results will be incorporated to both graduate and undergraduate courses in machine learning and signal processing. Special attention will be given to recruitment and retention of underrepresented students through the Native Hawaiian Science and Engineering Mentorship Program (NHSEMP) and the Society of Woman Engineers (SWE).The project makes advances in the field of real-time distributed learning and decision making using principles of federated learning, adaptive signal processing, graph signal processing, optimization, and kernel methods. The research is convergent bringing in the fields of signal processing, mathematics, statistics, and computer science together. The contributions are in three areas: algorithm development, analysis, and applicationsto the electric power grid. A focus is to design simple online kernel algorithms that are applicable for both supervised learning (regression, prediction, classification) and unsupervised learning (principal component analysis, probability density estimation). The algorithms focus on edge computing using optimization methods from online least squares kernel methods using variants of stochastic gradient and the temporal and spatial relationships between nodes represented as graphs. Tradeoffs are considered between optimizing objective functions, convergence, computational complexity, and communication costs. The online distributed kernel algorithms are then applied to detect bad data on the power grid and providing distributed learning capabilities for demand response (DR) programs.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.