arrow
返回

Multi-Agent Deep Reinforcement Learning Based Spectrum Allocation for D2D Underlay Communications

delete2020-02-01
delete115
delete
OA
AI
Z
Zheng Li
C
Caili Guo *
DOI:10.1109/TVT.2019.2961405delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Device-to-device (D2D) communication underlay cellular networks is a promising technique to improve spectrum efficiency. In this situation, D2D transmission may cause severe interference to both the cellular and other D2D links, which imposes a great technical challenge to spectrum allocation. Existing centralized schemes require global information, which causes a large signaling overhead. While existing distributed schemes requires frequent information exchange among D2D users and cannot achieve global optimization. In this paper, a distributed spectrum allocation framework based on multi-agent deep reinforcement learning is proposed, named multi-agent actor critic (MAAC). MAAC shares global historical states, actions and policies during centralized training, requires no signal interaction during execution and utilizes cooperation among users to further optimize system performance. Moreover, in order to decrease the computing complexity of the training, we further propose the neighbor-agent actor critic (NAAC) based on the neighbor users' historical information for centralized training. The simulation results show that the proposed MAAC and NAAC can effectively reduce the outage probability of cellular links, greatly improve the sum rate of D2D links and converge quickly.
Keyword:
Device-to-device (D2D) communications
multi-agent deep reinforcement learning
spectrum allocation
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Vehicular Technology 封面图
IEEE Transactions on Vehicular Technology
IF:
7.1
论文数:
1.8W
被引数:
6.6W

机构

B
beijing university of posts & telecommunications
学者数:
1.4W
论文数: 1.2W
被引数: 9
引用论文

引用论文

β-Catenin and ZO-1: Shuttle Molecules Involved in Tumor Invasion-Associated Epithelial-Mesenchymal Transition Processes
err2007-06-25
err0
PREAI
errMyriam Polette; Mélanie Mestdagt; Sandrine Bindels; Béatrice Nawrocki-Raby; Walter Hunziker; Jean-Michel Foidart; Philippe Birembaut; Christine Gilles
err分享
err收藏
学者 查看更多内容