Collaborative Research: NeTS: Medium: EdgeRIC: Empowering Real-time Intelligent Control and Optimization for NextG Cellular Radio Access Networks

下一代蜂窝网络必须支持各种各样的新兴应用，如增强现实、自动驾驶汽车和远程医疗，这些应用需要具有迄今无法获得的延迟、吞吐量和可靠性保证的无线电接入。与此同时，无线环境在不同的频段、用户移动性和不同的流量模式上变得越来越动态。复杂的跨层交互意味着无法获得可处理的模型，而机器学习方法以优化资源利用至关重要。该项目首先开发了一个开放、简单且功能强大的平台，名为EdgeRIC，支持整个蜂窝网络堆栈中多个时间尺度的细粒度决策；其次，在该平台上开发了一种基于结构化机器学习的方法，以优化利用所有系统资源，以最大限度地提高不同的应用程序性能。该项目通过侧重于机器学习和无线联网的教育计划得到加强，并协调为研究界和行业专业人员举办的讲习班和远程研讨会，以传播他们的想法。同时，以夏令营和为高中生举办的以机器学习为重点的研讨会形式的外联活动加强了这一项目在STEM领域的影响。该项目旨在实现实时(1ms)蜂窝网络中的智能决策和控制，同时支持近实时(10ms-1s)和非实时(1s)的培训和适应。它结合了数学方法来开发和分析强化学习(RL)算法，并将系统开发集成到细胞堆栈中。该项目通过三个主要主题解决了这样做的主要挑战。第一个重点是实时RL算法，它根据应用程序的相对优先级来调度资源，使用最优策略的结构来促进快速和可扩展的学习。第二个主题侧重于这些策略的稳健和快速调整，这些策略必须在动态环境和应用程序需求下运行。第三个主题涉及可扩展学习，以确定跨网络层和站点运行的分层策略。所有这些主题都集中在一个名为EdgeRIC的平台上，该平台使用标准化的OpenAIGym工具包实现多模式学习算法。该项目的直接影响是为下一代蜂窝网络创造多时间尺度的学习和控制。该项目还提出了元和联邦RL的基本理论。该项目支持用于推广的研讨会和夏令营，开发侧重于无线通信的机器学习的新课程，并为研究界和行业专业人员协调研讨会和远程研讨会以传播研究想法。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

NextG cellular networks must support a wide variety of emerging applications, such as augmented reality, autonomous vehicles and remote healthcare, which require radio access with latency, throughput and reliability guarantees hitherto unavailable. Simultaneously, the wireless environment is becoming increasingly dynamic over diverse spectrum bands, user mobility and variable traffic patterns. Complex cross layer interactions imply tractable models are unavailable, and a machine learning approach to optimal resource utilization is critical. This project first develops an open, simple and capable platform, entitled EdgeRIC that supports fine-grain decision making at multiple timescales across the cellular network stack, and second, develops a structured machine learning based approach over this platform that optimally utilizes all system resources to maximize diverse application performance. The project is enhanced by an education plan focusing on machine learning and wireless networking and coordinating workshops and tele-seminars for the research community and industry professionals to disseminate their ideas. Simultaneously, outreach in the form of summer camps and seminars for high school students focusing on machine learning enhances the impact of this project in STEM fields.The project aims at enabling intelligent decision making and control in cellular networks at realtime ( 1ms), while supporting training and adaptation at near-realtime (10ms - 1s) and non-realtime ( 1s). It brings together mathematical methods to develop and analyze reinforcement learning (RL) algorithms and systems development to integrate them into the cellular stack. The project addresses the key challenges of doing so via three main themes. The first focuses on realtime RL algorithms that schedule resources based on the relative priorities of applications, using the structure of the optimal policy to promote fast and scalable learning. The second theme focuses on robust and fast adaptation of these policies, which must operate over dynamic environments and application needs. The third theme addresses scalable learning to determine hierarchical policies operating across the network layers and sites. The themes all come together on a platform, entitled EdgeRIC for implementing multi-modal learning algorithms using the standardized OpenAIGym toolkit. The immediate impact of this project is in creating multi-timescale learning and control for the next generation of cellular networks. This project also advances the fundamental theory of meta and federated RL. The project supports seminars and summer camps for outreach, development of new courses focusing on machine learning for wireless communication, and coordination of workshops and tele-seminars for the research community and industry professionals to disseminate research ideas.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.