Q-Learning for Policy Based SON Management in wireless Access Networks
Q-Learning for Policy Based SON Management in wireless Access Networks
复制标题
无线接入网络中基于策略的 SON 管理的 Q-Learning
DOI：
10.23919/inm.2017.7987442
复制
发表时间：
2017
期刊：
影响因子：
--
通讯作者：
L. Decreusefond
中科院分区：
文献类型：
--
作者：
Tony Daher;S. B. Jemaa;L. Decreusefond
自组织网络是自主网络管理概念的最早具体实现之一。目前，无线接入网络（RAN）供应商开发了多种自组织网络（SON）功能，并已部署在世界各地的许多网络中。这些功能是独立设计的，以替代不同的操作任务。使这些功能以一致的方式协同工作的问题后来得到了研究，特别是在 SEMAFOUR 项目中，其中提出了基于策略的 SON 管理 (PBSM) 框架来整体管理 SON 启用的网络，即具有多个单独 SON 功能的网络。利用认知功能丰富 PBSM 框架是实现 SON 概念最初承诺的下一步：一个独特的自我管理网络，可以自主、高效地响应运营商的高水平要求和目标。本文提出了一种认知 PBSM 系统，该系统通过使用 Q 学习方法学习过去的经验来增强 SON 管理决策。我们的方法通过在支持 SON 的具有多种 SON 功能的长期演进高级 (LTE-A) 网络上进行仿真来进行评估。该论文表明，决策在学习过程中得到了增强，并讨论了该解决方案的实施选项。
Self organized networks has been one of the first concrete implementations of autonomic network management concept. Currently, several Self-Organizing-Network (SON) functions are developed by Radio Access Network (RAN) vendors and already deployed in many networks all around the world. These functions have been designed independently to replace different operational tasks. The concern of making these functions work together in a coherent manner has been studied later in particular in SEMAFOUR project where a Policy Based SON Management (PBSM) framework has been proposed to holistically manage a SON enabled network, namely a network with several individual SON functions. Enriching this PBSM framework with cognition capability is the next step towards the realization of the initial promise of SON concept: a unique self-managed network that responds autonomously and efficiently to the operator high level requirements and objectives. This paper proposes a cognitive PBSM system that enhances the SON management decisions by learning from past experience using Q-learning approach. Our approach is evaluated by simulation on a SON enabled Long-Term Evolution Advanced (LTE-A) network with several SON functions. The paper shows that the decisions are enhanced during the learning process and discusses the implementation options of this solution.