CCSS: Collaborative Research: Towards a Resource Rationing Framework for Wireless Federated Learning

联邦学习（FL）是一种新兴的分布式机器学习范式，具有许多吸引人的特性。尽管早期的研究已经证明了联合优化通信和计算的潜力，现有的设计是不适合FL的独特特性。该项目旨在开发一种新的和严格的无线FL的资源分配框架，我们长期的资源配给，强调随着时间的推移平衡资源，使最终的学习成果的长期影响被明确捕获。资源配给建立在严格的理论基础上，并指导解决物理和媒体访问控制（MAC）层中特定资源分配问题的算法开发。联邦学习是无线通信的一个新兴应用，该项目有可能推动这一新用例的技术开发。同时，理论基础、算法和验证将广泛推进机器学习、通信理论和无线网络的最新发展。开发这种实用和有影响力的技术也将有助于保持美国在无线技术方面的领导地位，并保持供应高质量，训练有素和创新的工程师的管道。该项目追求协同活动，以成功设计和实施无线FL的资源配给。在每个学习回合中，对FL进行不同资源的新收敛分析，这就确立了一般的“后来者更好”原则。在理论基础的指导下，该项目进一步构建了一个全面的算法框架，用于特定的资源配给设计，从物理层比特加载和自适应编码和调制到MAC层客户端选择，带宽分配，该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查进行评估，被认为值得支持的搜索.

Federated learning (FL) is an emerging distributed machine learning paradigm that has many attractive properties. Despite the early studies that have demonstrated the potential of jointly optimizing communication and computation, existing designs are not tailored to the unique characteristics of FL. This project aims at developing a novel and rigorous resource allocation framework for wireless FL, which we term resource rationing to emphasize balancing resources over time so that the long-term impact to the final learning outcome is explicitly captured. Resource rationing is built on a rigorous theoretical foundation and guides the algorithmic development that solves specific resource allocation problems in both physical and Media Access Control (MAC) layers. Federated learning is an emerging new application for wireless communications, and this project has potential to advance the technology development of this new use case. Meanwhile, the theoretical foundation, algorithms, and validation will broadly advance the state of the art in machine learning, communication theory, and wireless networking. Developing such practical and impactful technology would also help maintain the leadership of the United States in wireless technologies as well as keep the pipeline to supply high-quality, well-trained, and innovative engineers.The project pursues synergistic activities for the successful design and implementation of resource rationing for wireless FL. Novel convergence analysis of FL with varying resource in each learning round is carried out, which establishes the general later-is-better principle. Guided by the theoretical foundation, the project further builds a comprehensive algorithmic framework for specific resource rationing designs, ranging from physical layer bit loading and adaptive coding and modulation to the MAC layer client selection, bandwidth allocation, and power control.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.