Sleeping Contextual/Non-Contextual Thompson Sampling MAB for mmWave D2D Two-Hop Relay Probing
Sleeping Contextual/Non-Contextual Thompson Sampling MAB for mmWave D2D Two-Hop Relay Probing
复制标题
DOI：
10.1109/tvt.2021.3116223
复制
发表时间：
2021-11
影响因子：
6.8
通讯作者：
E. M. Mohamed;S. Hashima;Kohei Hatano;M. Fouda;Z. Fadlullah
中科院分区：
文献类型：
--
作者：
E. M. Mohamed;S. Hashima;Kohei Hatano;M. Fouda;Z. Fadlullah
毫米波(毫米波)频段，即30到300 GHz，具有短距离传输的特点，易受路径阻塞的影响，因此需要使用中继。探测更多的中继会找出具有最高频谱效率的最佳中继站，但代价是由于过度的波束成形训练(BT)导致总体吞吐量下降而增加探测开销。在本文中，毫米波两跳中继将被描述为一个单人多臂强盗(MAB)问题，允许一个中继器探测，同时最大化可实现的频谱效率。此外，由于阻塞，中继站不能建立毫米波链路，例如，将被识别为休眠中继站，并从MAB游戏的其余部分中被淘汰。为此，本文提出了睡眠非上下文MAB(S-MAB)算法，即睡眠汤普森采样算法(S-TS)来解决这一问题。此外，通过利用包含2.4/5 GHz WiFi和60 GHz毫米波频段的标准化WiGig设备的多频段能力，WiFi信息将被用作MAB游戏的上下文。因此，本文还提出了睡眠上下文MAB(S-CMAB)算法，即S-CTS算法。数值和遗憾分析确保了S-CMAB算法的性能优于S-MAB算法和现有的毫米波接力探测方案，并伴随着较高的收敛速度。
Millimeter wave (mmWave) band, i.e., 30 to 300 GHz, is characterized by short range transmissions and vulnerability to path blockage necessitating the use of relaying. Probing more relays finds out the best relay having the highest spectral efficiency but at the expense of increasing the probing overhead due to excessive beamforming training (BT) causing a decrease in the overall throughput. In this paper, mmWave two-hop relaying will be formulated as a single player multi-armed bandit (MAB) problem enabling one relay probing while maximizing the achievable spectral efficiency. Moreover, the relays could not establish the mmWave link due to blockage for instance will be identified as sleeping relays and eliminated from the rest of the MAB game. Thus, sleeping non contextual MAB (S-MAB) algorithm, namely sleeping Thompson sampling (S-TS) will be proposed to handle the problem. Furthermore, by utilizing the multiband capability of standardized WiGig devices containing both 2.4/5 GHz WiFi and 60 GHz mmWave bands, WiFi information will be used as contexts of the MAB game. Therefore, sleeping contextual MAB (S-CMAB) algorithm, namely S-CTS, will be proposed as well. Numerical and regret analysis ensure the superior performance of the S-CMAB algorithm over the S-MAB counterpart and the existing mmWave relay probing solutions accompanied with high convergence rates.