RII Track-4:NSF: HEAL: Heterogeneity-aware Efficient and Adaptive Learning at Clusters and Edges

随着物联网(IoT)的激增和深度学习技术的进步，各种应用领域都越来越多地采用人工智能(AI)，如增强现实、自动驾驶和智能医疗。由于数据法规和隐私问题，有效地从物联网设备生成的不断扩大的数据池中学习是一个独特的挑战。联合学习显示出作为一种在不暴露敏感数据的情况下在边缘设备上协作训练模型的方法的前景。然而，由于系统和数据的异构性以及多个作业的共存，在现实世界的物联网网络中部署联合学习仍然具有挑战性。该项目旨在通过系统解决方案Hear来应对这些挑战，该解决方案针对共享物联网网络中多个作业的异质性感知高效和自适应学习。该奖学金将支持PI和她的研究生在伊利诺伊大学厄巴纳-香槟分校的协调科学实验室进行必要的实验调查，利用这个跨学科研究所的先进网络基础设施、尖端技术、多样化的数据集和丰富的领域专业知识。项目成果将促进边缘云连续体中协作学习的知识和理解，并为共享物联网基础设施上人工智能驱动的应用程序提供指导。研究基础设施改进Track-4 EPSCoR研究人员(RII Track-4)项目将为路易斯安那大学拉斐特分校的一名助理教授提供奖学金，并为一名研究生提供培训。这项工作将与伊利诺伊大学厄巴纳-香槟分校的研究人员合作进行。该项目旨在解决在现实世界物联网网络中实施实用的联合学习时遇到的独特挑战，以迎合日益多样化的机器学习应用。将为共享物联网网络中多个作业的异构性感知高效和自适应学习(Heteratiy-Aware Efficiency and Adaptive Learning，简称HREE)设计系统解决方案，协同两个主要推力：自适应地将设备上的培训计算卸载到边缘服务器，以及明智地选择和调度并发学习作业的参与设备。它将系统和实验地研究共享异构物联网基础设施中多作业联合学习中的一些棘手问题。具有新颖性的主要组成部分是：(1)自适应地卸载来自不同边缘设备的训练计算，能够在计算、通信和隐私泄露风险之间取得平衡；(2)在多个并发学习任务的分布式训练过程中，明智地协调边缘设备，以达到系统效率和模型质量的目的。建议的解决方案将通过不同的学习应用程序在主机站点的真实物联网网络中进行部署和测试，不仅提供算法层面的解决方案，还将产生实际影响和见解。预期的项目成果将丰富教育材料，并加强机器学习系统、分布式系统和联网、云计算和边缘计算以及资源调度等领域的课程开发。该项目将使PI能够与国家知名机构建立长期的合作关系，并增强她所在研究所的研究能力。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

With the proliferation of the Internet of Things (IoT) and technological advances in deep learning, various application domains have witnessed the growing adoption of Artificial Intelligence (AI), such as augmented reality, autonomous driving, and smart healthcare. Effectively learning from the ever-expanding pool of data generated by IoT devices poses a unique challenge due to data regulations and privacy concerns. Federated learning shows promise as a method for collaboratively training models on edge devices without exposing sensitive data. However, deploying federated learning in real-world IoT networks remains challenging due to the heterogeneity of systems and data, as well as the coexistence of multiple jobs. This project aims to address such challenges with a systematic solution, HEAL, for Heterogeneity-aware Efficient and Adaptive Learning for multiple jobs in a shared IoT network. The fellowship will provide support for the PI and her graduate student to conduct essential experimental investigations at the Coordinated Science Laboratory at the University of Illinois Urbana-Champaign, leveraging advanced cyberinfrastructure, cutting-edge technologies, diverse datasets, and abundant domain expertise at this interdisciplinary research institute. The project outcome will advance the knowledge and understanding of collaborative learning in the edge-cloud continuum and provide guidance for AI-driven applications on shared IoT infrastructure.This Research Infrastructure Improvement Track-4 EPSCoR Research Fellows (RII Track-4) project would provide a fellowship to an Assistant professor and training for a graduate student at the University of Louisiana at Lafayette. This work would be conducted in collaboration with researchers at the University of Illinois Urbana-Champaign. This project aims to address the unique challenges encountered when implementing practical federated learning in real-world IoT networks, catering to the growing diversity of machine learning applications. A systematic solution will be designed for Heterogeneity-aware Efficient and Adaptive Learning (HEAL) for multiple jobs in a shared IoT network, synergizing two major thrusts: adaptive offloading of on-device training computation to the edge server and judicious selection and scheduling of participant devices for concurrent learning jobs. It will systematically and experimentally investigate a number of knotty issues in multi-job federated learning in a shared heterogeneous IoT infrastructure. The major components with novelty are: (1) The adaptive offloading of training computation from heterogeneous edge devices that can strike a balance between computation, communication, and privacy leakage risk; and (2) The judicious coordination of edge devices in the distributed training procedures of multiple concurrent learning jobs, aiming for system efficiency and model quality. The proposed solution will be deployed and tested in real-world IoT networks at the host site over diverse learning applications, not only providing solutions at the algorithmic level but also producing practical implications and insights. The anticipated project outcomes will enrich educational materials and strengthen curriculum development in the areas of machine learning systems, distributed systems and networking, cloud and edge computing, and resource scheduling. This project will enable the PI to establish a long-term collaboration with national prominence and enhance the research capacity of her home institution.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.