Femtocell Scheduling as a Restless Multiarmed Bandit Problem Using Partial Channel State Observation
Femtocell Scheduling as a Restless Multiarmed Bandit Problem Using Partial Channel State Observation
复制标题
DOI：
10.1109/icc.2018.8422619
复制
发表时间：
2018-05
期刊：
影响因子：
--
通讯作者：
Hesham M. Elmaghraby;Keqin Liu;Z. Ding
中科院分区：
文献类型：
--
作者：
Hesham M. Elmaghraby;Keqin Liu;Z. Ding
在本文中，我们探讨了共享常规宏蜂窝频谱的毫微微蜂窝的信道分配问题。毫微微基站（FBS）调度问题是以不安多臂老虎机（RMAB）框架的形式来表述的。我们的目标是选择能在无限时域内使总期望折扣奖励最大化，同时使由于与宏蜂窝共享信道而产生的干扰最小化的臂/信道。在无法直接观测真实信道状态的情况下，我们使用被称为信道质量指示符（CQI）的可用宏蜂窝用户反馈。一般来说，RMAB问题是PSPACE难的。我们提出一种被称为近似惠特尔指数的启发式低复杂度索引策略，以便为FBS对可用信道进行排序。尽管找到一个封闭形式的信道排序解决方案通常涉及动态规划，但我们表明，基于CQI内的部分信道信息，存在信道指数的封闭形式。此外，我们展示了所提出的索引策略相对于短视策略的性能优势。
In this paper, we address the problem of channel allocation for femtocells that share the use of regular macrocell spectrum. The femto basestation (FBS) scheduling problem is formulated in the form of restless multiarmed bandit (RMAB) framework. Our goal is to choose the arms/channels that maximize the total expected discounted reward over infinite horizon while minimizing the induced interference due to channel sharing with macrocell. Without direct observation of true channel state, we use the available macrocell user feedback known as channel quality indicator (CQI). In general, the RMAB problem is P-SPACE hard. We propose a heuristic low complexity indexing policy referred as approximated Whittle index to rank available channels for FBS. Although finding a closed form channel ranking solution typically involve dynamic programming, we show that based on the partial channel information within CQI, there exists a closed form for the channel index. Moreover, we demonstrate the performance advantage of the proposed indexing policy over a myopic policy.