DRL-Based Energy-Efficient Resource Allocation Frameworks for Uplink NOMA Systems
DRL-Based Energy-Efficient Resource Allocation Frameworks for Uplink NOMA Systems
复制标题
基于 DRL 的上行 NOMA 系统节能资源分配框架
DOI：
10.1109/jiot.2020.2982699
复制
发表时间：
2020-08-01
影响因子：
10.6
通讯作者：
Zheng, Fu-Chun
中科院分区：
文献类型：
--
作者：
Wang, Xiaoming;Zhang, Yuhan;Zheng, Fu-Chun
Nonorthogonal multiple access (NOMA) is one of the promising technologies to meet the huge access demand and high data-rate requirements of the next-generation networks. In this article, we investigate the joint subchannel assignment and power allocation problem in an uplink multiuser NOMA system to maximize the energy efficiency (EE). Different from conventional model-based resource allocation methods, we propose three deep-reinforcement-learning (DRL)-based frameworks to solve this nonconvex optimization problem, referred to as the discrete DRL-based resource allocation (DDRA) framework, continuous DRL-based resource allocation (CDRA) framework, and joint DRL and optimization resource allocation (DORA) framework. Specifically, for the DDRA framework, a multi-DQN-based network is designed to dynamically allocate resources discretely, which can reduce the output dimension and improve the learning efficiency. To overcome the loss of power discretization in DDRA, a joint DQN and deep deterministic policy-gradient (DDPG)-based network (CDRA framework) is designed to generate the resource allocation policy. The DORA framework is then proposed as a performance boundary. Finally, an event-triggered learning method is combined with all three frameworks to further reduce the computational consumption. The numerical results show that the proposed frameworks can improve the EE performance of the uplink NOMA system and reduce the computation time.
