Three-dimensional aerial base station location for sudden traffic with deep reinforcement learning in 5G mmWave networks
Three-dimensional aerial base station location for sudden traffic with deep reinforcement learning in 5G mmWave networks
复制标题
DOI：
10.1177/1550147720926374
复制
发表时间：
2020-05
影响因子：
2.3
通讯作者：
Peng Yu;Jianli Guo;Yonghua Huo;Xiujuan Shi;Jiahui Wu;Yahui Ding
中科院分区：
文献类型：
--
作者：
Peng Yu;Jianli Guo;Yonghua Huo;Xiujuan Shi;Jiahui Wu;Yahui Ding
沿着蜂窝网络的发展，用户设备的大量增加，数据量需求急剧增加。5G网络中的宏小区可能会遇到由于体育或庆祝活动引起的密集用户造成的突发流量。为解决这类临时热点问题，增加网络接入点成为新的解决方案，而无人机搭载基站则是提高覆盖和容量的有效解决方案。如何根据用户的业务需求和服务场景规划出空中基站的最佳三维位置是需要解决的关键问题。本文首先以频谱效率最大化为目标，考虑5G毫米波网络视距和非视距路径损耗的影响，提出了空中基站选址规划的数学优化模型。针对该模型，构建了深度Q学习的模型定义和训练过程，并通过大规模的预学习体验不同用户布局在训练过程中获得经验，最终提高训练过程的时效性。仿真结果表明，该优化模型在保证服务质量的前提下，可以达到理论最大频谱效率的90%以上。
Data volume demand has increased dramatically due to huge user device increasement along with the development of cellular networks. And macrocell in 5G networks may encounter sudden traffic due to dense users caused by sports or celebration activities. To resolve such temporal hotspot, additional network access point has become a new solution for it, and unmanned aerial vehicle equipped with base stations is taken as an effective solution for coverage and capacity improvement. How to plan the best three-dimensional location of the aerial base station according to the users’ business needs and service scenarios is a key issue to be solved. In this article, first, aiming at maximizing the spectral efficiency and considering the effects of line-of-sight and non-line-of-sight path loss for 5G mmWave networks, a mathematical optimization model for the location planning of the aerial base station is proposed. For this model, the model definition and training process of deep Q-learning are constructed, and through the large-scale pre-learning experience of different user layouts in the training process to gain experience, finally improve the timeliness of the training process. Through the simulation results, it points out that the optimization model can achieve more than 90% of the theoretical maximum spectral efficiency with acceptable service quality.