Dynamic Heterogeneous Learning Games for Opportunistic Access in LTE-Based Macro/Femtocell Deployments
Dynamic Heterogeneous Learning Games for Opportunistic Access in LTE-Based Macro/Femtocell Deployments
复制标题
DOI：
10.1109/twc.2014.2384510
复制
发表时间：
2015-04-01
影响因子：
10.4
通讯作者：
Moessner, Klaus
中科院分区：
文献类型：
--
作者：
Alnwaimi, Ghassan;Vahid, Seiamak;Moessner, Klaus
当试图在异构网络（HN）的部署中实现高频谱效率时，干扰是最限制因素之一。在本文中，HN被建模为覆盖在LTE无线电接入网络上的封闭接入LTE毫微微小区（FC）的层。在动态学习游戏的背景下，这项工作提出了一种新的异构多目标完全分布式策略的基础上强化学习（RL）模型（CODIPAS-HRL）FC自我配置/优化。自组织能力使得FC能够使用不同的学习策略自主地和机会主义地感测无线电环境，并相应地调整它们的参数，以便在避免对两个网络层的干扰的限制下操作，并满足某些服务质量要求。所提出的模型降低了与每种学习策略相关的学习成本。我们还研究了不同学习率下的收敛行为，并推导出一个新的精度度量，以提供不同学习策略之间的比较。仿真结果表明，在HN环境的不确定性下，学习模型收敛到基于满意均衡的解决方案的概念。我们表明，层内/层间干扰可以显着减少，从而导致更高的小区吞吐量。
Interference is one of the most limiting factors when trying to achieve high spectral efficiency in the deployment of heterogeneous networks (HNs). In this paper, the HN is modeled as a layer of closed-access LTE femtocells (FCs) overlaid upon an LTE radio access network. Within the context of dynamic learning games, this work proposes a novel heterogeneous multiobjective fully distributed strategy based on a reinforcement learning (RL) model (CODIPAS-HRL) for FC self-configuration/optimization. The self-organization capability enables the FCs to autonomously and opportunistically sense the radio environment using different learning strategies and tune their parameters accordingly, in order to operate under restrictions of avoiding interference to both network tiers and satisfy certain quality-of-service requirements. The proposedmodel reduces the learning cost associated with each learning strategy. We also study the convergence behavior under different learning rates and derive a new accuracy metric in order to provide comparisons between the different learning strategies. The simulation results show the convergence of the learning model to a solution concept based on satisfaction equilibrium, under the uncertainty of the HN environment. We show that intra/inter-tier interference can be significantly reduced, thus resulting in higher cell throughputs.