RII Track-4:NSF: HEAL: Heterogeneity-aware Efficient and Adaptive Learning at Clusters and Edges

随着物联网（IoT）的普及和深度学习技术的进步，各种应用领域越来越多地采用人工智能（AI），如增强现实、自动驾驶和智能医疗保健。由于数据法规和隐私问题，有效地从物联网设备产生的不断扩大的数据池中学习是一项独特的挑战。联邦学习有望成为一种在边缘设备上协作训练模型而不暴露敏感数据的方法。然而，由于系统和数据的异质性以及多个工作的共存，在现实世界的物联网网络中部署联邦学习仍然具有挑战性。该项目旨在通过系统解决方案HEAL来应对这些挑战，该解决方案旨在为共享物联网网络中的多个工作提供异构感知高效和自适应学习。该奖学金将支持PI及其研究生在伊利诺伊大学厄巴纳-香槟分校的协调科学实验室进行必要的实验研究，利用先进的网络基础设施、尖端技术、多样化的数据集和丰富的领域专业知识在这个跨学科的研究机构。项目成果将促进对边缘云连续体中协作学习的认识和理解，并为共享物联网基础设施上的人工智能驱动应用提供指导。这个研究基础设施改进轨道4 EPSCoR研究研究员（RII轨道4）项目将为路易斯安那大学拉斐特分校的一名助理教授提供奖学金，并为一名研究生提供培训。这项工作将与伊利诺伊大学厄巴纳-香槟分校的研究人员合作进行。该项目旨在解决在现实世界的物联网网络中实施实际联合学习时遇到的独特挑战，以满足日益多样化的机器学习应用。将为共享物联网网络中多个作业的异构感知高效自适应学习（HEAL）设计一个系统解决方案，协同两个主要目标：自适应卸载设备上的训练计算到边缘服务器，以及为并发学习作业明智地选择和调度参与设备。它将系统地和实验性地研究共享异构物联网基础设施中多任务联合学习中的一些棘手问题。具有新颖性的主要组成部分有：(1)从异构边缘设备中自适应卸载训练计算，可以在计算、通信和隐私泄露风险之间取得平衡；(2)在多个并行学习作业的分布式训练过程中，边缘设备的合理协调，以提高系统效率和模型质量为目标。提出的解决方案将在主机站点的实际物联网网络中通过各种学习应用进行部署和测试，不仅提供算法层面的解决方案，而且还产生实际影响和见解。预期的项目成果将丰富教育材料，加强机器学习系统、分布式系统和网络、云和边缘计算以及资源调度等领域的课程开发。该项目将使PI能够与全国知名机构建立长期合作关系，并提高其所在机构的研究能力。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

With the proliferation of the Internet of Things (IoT) and technological advances in deep learning, various application domains have witnessed the growing adoption of Artificial Intelligence (AI), such as augmented reality, autonomous driving, and smart healthcare. Effectively learning from the ever-expanding pool of data generated by IoT devices poses a unique challenge due to data regulations and privacy concerns. Federated learning shows promise as a method for collaboratively training models on edge devices without exposing sensitive data. However, deploying federated learning in real-world IoT networks remains challenging due to the heterogeneity of systems and data, as well as the coexistence of multiple jobs. This project aims to address such challenges with a systematic solution, HEAL, for Heterogeneity-aware Efficient and Adaptive Learning for multiple jobs in a shared IoT network. The fellowship will provide support for the PI and her graduate student to conduct essential experimental investigations at the Coordinated Science Laboratory at the University of Illinois Urbana-Champaign, leveraging advanced cyberinfrastructure, cutting-edge technologies, diverse datasets, and abundant domain expertise at this interdisciplinary research institute. The project outcome will advance the knowledge and understanding of collaborative learning in the edge-cloud continuum and provide guidance for AI-driven applications on shared IoT infrastructure.This Research Infrastructure Improvement Track-4 EPSCoR Research Fellows (RII Track-4) project would provide a fellowship to an Assistant professor and training for a graduate student at the University of Louisiana at Lafayette. This work would be conducted in collaboration with researchers at the University of Illinois Urbana-Champaign. This project aims to address the unique challenges encountered when implementing practical federated learning in real-world IoT networks, catering to the growing diversity of machine learning applications. A systematic solution will be designed for Heterogeneity-aware Efficient and Adaptive Learning (HEAL) for multiple jobs in a shared IoT network, synergizing two major thrusts: adaptive offloading of on-device training computation to the edge server and judicious selection and scheduling of participant devices for concurrent learning jobs. It will systematically and experimentally investigate a number of knotty issues in multi-job federated learning in a shared heterogeneous IoT infrastructure. The major components with novelty are: (1) The adaptive offloading of training computation from heterogeneous edge devices that can strike a balance between computation, communication, and privacy leakage risk; and (2) The judicious coordination of edge devices in the distributed training procedures of multiple concurrent learning jobs, aiming for system efficiency and model quality. The proposed solution will be deployed and tested in real-world IoT networks at the host site over diverse learning applications, not only providing solutions at the algorithmic level but also producing practical implications and insights. The anticipated project outcomes will enrich educational materials and strengthen curriculum development in the areas of machine learning systems, distributed systems and networking, cloud and edge computing, and resource scheduling. This project will enable the PI to establish a long-term collaboration with national prominence and enhance the research capacity of her home institution.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.