arrow
返回

A Deep Actor-Critic Reinforcement Learning Framework for Dynamic Multichannel Access

delete2019-12-01
delete70
delete
OA
AI
C
Chen Zhong
Z
Ziyang Lu
M
M. Cenk Gursoy *
S
Senem Velipasalar
DOI:10.1109/TCCN.2019.2952909delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
To make efficient use of limited spectral resources, we in this work propose a deep actor-critic reinforcement learning based framework for dynamic multichannel access. We consider both a single-user case and a scenario in which multiple users attempt to access channels simultaneously. We employ the proposed framework as a single agent in the single-user case, and extend it to a decentralized multi-agent framework in the multi-user scenario. In both cases, we develop algorithms for the actor-critic deep reinforcement learning and evaluate the proposed learning policies via experiments and numerical results. In the single-user model, in order to evaluate the performance of the proposed channel access policy and the framework's tolerance against uncertainty, we explore different channel switching patterns and different switching probabilities. In the case of multiple users, we analyze the probabilities of each user accessing channels with favorable channel conditions and the probability of collision. We also address a time-varying environment to identify the adaptive ability of the proposed framework. Additionally, we provide comparisons (in terms of both the average reward and time efficiency) between the proposed actor-critic deep reinforcement learning framework, Deep-Q network (DQN) based approach, random access, and the optimal policy when the channel dynamics are known.
Keyword:
Actor-critic algorithms
channel switching patterns
deep Q-networks
deep reinforcement learning
dynamic channel access
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
IEEE Transactions on Cognitive Communications and Networking
IF:
7
论文数:
1.6K
被引数:
5.5K

机构

S
Syracuse University
学者数:
5.4K
论文数: 5.2K
被引数: 8.3K
引用论文

引用论文

High incidence of mutations in BRCA1 and BRCA2 genes in ovarian cancer
err2007-07-01
err0
PREAI
errT. Yu. Smirnova; N. I. Pospekhova; L. N. Lyubchenko; S. A. Tjulandin; R. F. Gar’kavtseva; E. K. Ginter; A. V. Karpukhin
err分享
err收藏
Natural Actor-Critic
err2008-03-01
err643
PREAI
errPeters, Jan; Schaal, Stefan
err分享
err收藏
Reinforcement Learning-Based NOMA Power Allocation in the Presence of Smart Jamming
err2018-04-01
err181
PREAI
errXiao, Liang; Li, Yanda; Dai, Canhuang; Dai, Huaiyu; Poor, H. Vincent
err分享
err收藏
Alcoholic and Non-Alcoholic Marchiafava-Bignami Disease: A Comparative Study
err2016-01-01
err0
errOAAI
errXiaodong Chen; Yuanwei Wang; Ying Wang; Daoming Tong; Baolin Zhu
err分享
err收藏
Latent Curve Analysis
err2025-01-01
err0
PREAI
errWilliam Meredith; John Tisak
err分享
err收藏
err分享
err收藏
Deep Reinforcement Learning for Dynamic Multichannel Access in Wireless Networks
err2018-06-01
err347
errOAAI
errWang, Shangxing; Liu, Hanpeng; Gomes, Pedro Henrique; Krishnamachari, Bhaskar
err分享
err收藏
学者 查看更多内容