Optimal cooperative cognitive relaying and spectrum access for an energy harvesting cognitive radio: Reinforcement learning approach
Optimal cooperative cognitive relaying and spectrum access for an energy harvesting cognitive radio: Reinforcement learning approach
复制标题
DOI：
10.1109/iccnc.2015.7069344
复制
发表时间：
2014-03
期刊：
影响因子：
--
通讯作者：
Ahmed El Shane;T. Khattab;H. Saad;Amr M. Mohamed
中科院分区：
文献类型：
--
作者：
Ahmed El Shane;T. Khattab;H. Saad;Amr M. Mohamed
在本文中，我们考虑协作通信背景下的认知设置，其中认知无线电（CR）用户被假设为网络的自组织中继。 CR 用户和主用户（PU）被假设为能量收集者。 CR用户协作中继PU的一些未传送的分组。具体来说，CR 用户将未传送的主数据包的一部分存储在中继队列（缓冲区）中。它在时隙上使用适当的操作来管理未传递的主数据包流向其中继队列。此外，它还可以决定在空闲时隙（PU队列为空的时隙）选择所使用的队列进行信道访问。假设一个数据包传输消耗一个能量包。最优策略根据主要用户和 CR 用户到达数据和能量队列的速率以及通道连接性而变化。 CR用户通过承担中继未传送的主数据包的责任为PU节省能量。随着时间的推移，它会以最佳方式组织自己的能量包，以最大化其回报。
In this paper, we consider a cognitive setting under the context of cooperative communications, where the cognitive radio (CR) user is assumed to be a self-organized relay for the network. The CR user and the primary user (PU) are assumed to be energy harvesters. The CR user cooperatively relays some of the undelivered packets of the PU. Specifically, the CR user stores a fraction of the undelivered primary packets in a relaying queue (buffer). It manages the flow of the undelivered primary packets to its relaying queue using the appropriate actions over time slots. Moreover, it has the decision of choosing the used queue for channel accessing at idle time slots (slots where the PU's queue is empty). It is assumed that one data packet transmission dissipates one energy packet. The optimal policy changes according to the primary and CR users arrival rates to the data and energy queues as well as the channels connectivity. The CR user saves energy for the PU by taking the responsibility of relaying the undelivered primary packets. It optimally organizes its own energy packets to maximize its payoff as time progresses.