.png){kind=icon}
返回
A Deep Reinforcement Learning Framework for Contention-Based Spectrum Sharing
.png){kind=icon}
OA
AI
DOI：10.1109/JSAC.2021.3087254.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The increasing number of wireless devices operating in unlicensed spectrum motivates the development of intelligent adaptive approaches to spectrum access. We consider decentralized contention-based medium access for base stations (BSs) operating on unlicensed shared spectrum, where each BS autonomously decides whether or not to transmit on a given resource. The contention decision attempts to maximize not its own downlink throughput, but rather a network-wide objective. We formulate this problem as a decentralized partially observable Markov decision process with a novel reward structure that provides long term proportional fairness in terms of throughput. We then introduce a two-stage Markov decision process in each time slot that uses information from spectrum sensing and reception quality to make a medium access decision. Finally, we incorporate these features into a distributed reinforcement learning framework for contention-based spectrum access. Our formulation provides decentralized inference, online adaptability and also caters to partial observability of the environment through recurrent Q-learning. Empirically, we find its maximization of the proportional fairness metric to be competitive with a genie-aided adaptive energy detection threshold, while being robust to channel fading and small contention windows.
Keyword:
Throughput
Interference
Reinforcement learning
Radio transmitters
Sensors
Signal to noise ratio
Markov processes
Spectrum sharing
distributed reinforcement learning
contention
medium access
proportional fairness
decentralized partially observable Markov decision process
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
17.2
论文数:
6.4K
被引数:
3.1W
机构
引用论文
Resource Management in Wireless Networks via Multi-Agent Deep Reinforcement Learning基于多Agent深度强化学习的无线网络资源管理OAAI
OAAI分享收藏Study of bi-directional buck-boost converter topologies for application in electrical vehicle motor drives应用于电动汽车电机驱动的双向buck-boost变换器拓扑研究
PREAI
分享收藏NR-U and IEEE 802.11 Technologies Coexistence in Unlicensed mmWave Spectrum: Models and Evaluation非授权毫米波频谱中的nr-u和IEEE 802.11技术共存: 模型和评估.png)
IEEE ACCESSOAAI
IEEE ACCESSIF3.6
OAAI分享收藏CCDC34 is up-regulated in bladder cancer and regulates bladder cancer cell proliferation, apoptosis and migrationOncotarget
OAAI
OncotargetIF0
OAAI分享收藏
查看更多内容