.png){kind=icon}
返回
Multi-Agent Reinforcement Learning-Based Distributed Dynamic Spectrum Access
.png){kind=icon}
PRE
AI
DOI：10.1109/TCCN.2021.3120996.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Dynamic spectrum access (DSA) is an effective solution for efficiently utilizing the radio spectrum by sharing it among various networks. Two primary tasks of a DSA controller are: 1) maximizing the quality of service of users in the licensee's network and 2) avoiding interference in communications towards the incumbent network. These two tasks become quite challenging in a distributed DSA network due to the lack of a centralized controller to regulate the sharing of the radio spectrum between incumbents and licensees. Hence, optimization-driven techniques to design power allocation schemes in such a network often become intractable. Accordingly, in this paper, we present a distributed DSA based communication framework based on multi-agent reinforcement learning (RL), where the multiple cells in the multi-user multiple-input multiple-output (MU-MIMO) licensee network act as agents, and the average signal-to-noise ratio value is the reward. In particular, by considering the physical layer parameters of the DSA network, we analyze various RL algorithms, namely Q-learning, deep Q-network (DQN), deep deterministic policy gradient (DDPG), and twin delayed deep deterministic (TD3), whereby the licensee network learns to obtain the optimal power allocation policies for accessing the spectrum in a distributed fashion without the need for a central DSA controller to manage the interference towards the incumbent. Trade-offs are identified for the considered algorithms with respect to performance, time complexity and scalability of the DSA network.
Keyword:
Dynamic spectrum access
spectrum-sharing
multi-agent
reinforcement learning
multi-user multiple-input multiple-output
期刊
I
IF:
7
论文数:
1.6K
被引数:
5.5K
机构
引用论文
Dynamic Spectrum Access for Internet of Things Service in Cognitive Radio-Enabled LPWANs.png)
SENSORS
OAAI
SENSORSIF3.5
OAAI分享收藏
A Novel Multichannel Internet of Things Based on Dynamic Spectrum Sharing in 5G Communication5g通信中基于动态频谱共享的新型多信道物联网
PREAI
分享收藏
查看更多内容