arrow
返回

3D-Trajectory and Phase-Shift Design for RIS-Assisted UAV Systems Using Deep Reinforcement Learning

delete2022-03-01
delete88
PRE
AI
H
Haibo Mei
K
Kun Yang
Q
Qiang Liu *
K
Kezhi Wang
DOI:10.1109/TVT.2022.3143839delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Unmanned aerial vehicle (UAV) can effectively work as temporary base station or access point in the air to transfer/receive data to/from ground terminals (GTs). However, UAV-GT links might be blocked by ground obstacles, like buildings in urban area, leading to a poor performance on data transferring rate. To address this problem, reconfigurable intelligent surface (RIS), as a promising technique, can intelligently reflect the received signals between UAV and GT to significantly enhance the communication quality. Under this deployment of RIS-assisted UAV, we intend to jointly optimize the 3D-space of the UAV and the phase-shift of the RIS to maximize the data transferring rate of the UAV, while minimizing the UAV propulsion energy. The joint problem is non-convex in its original form and difficult to be timely solved by using traditional method, like successive convex approximation (SCA). Therefore, to facilitate the online decision making to this joint problem, we leverage deep reinforcement learning (DRL) to learn the near-optimal solution, and the well known Double Deep Q-Network (DDQN) and Deep Deterministic Policy Gradient (DDPG) algorithms are ultilized. Numerical results show that DRL can effectively improve the energy-efficiency performance of the RIS-Assisted UAV system, compared with benchmark solutions.
Keyword:
Autonomous aerial vehicles
Propulsion
Wireless networks
Base stations
Rotors
Resource management
Array signal processing
Reconfigurable intelligent surface (RIS)
intelligent reflecting surface (IRS)
deep reinforcement learning (DRL)
3D-trajectory
unmanned aerial vehicle (UAV)

期刊

IEEE Transactions on Vehicular Technology 封面图
IEEE Transactions on Vehicular Technology
IF:
7.1
论文数:
1.8W
被引数:
6.6W

机构

N
Northumbria University
学者数:
5.6K
论文数: 6.8K
被引数: 9.5K
引用论文

引用论文

Deep Reinforcement Learning for Minimizing Age-of-Information in UAV-assisted Networks
err2019-12-01
err85
errOAAI
errAbd-Elmagid, Mohamed A.; Ferdowsi, Aidin; Dhillon, Harpreet S.; Saad, Walid
err分享
err收藏
Latency Minimization for Intelligent Reflecting Surface Aided Mobile Edge Computing
err2020-11-01
err354
errOAAI
errBai, Tong; Pan, Cunhua; Deng, Yansha; Elkashlan, Maged; Nallanathan, Arumugam; Hanzo, Lajos
err分享
err收藏
Investigation of a carbon-supported quaternary PtRuSnW catalyst for direct methanol fuel cells
err1995-06-01
err0
PREAI
errA.S. Aricò; Z. Poltarzewski; H. Kim; A. Morana; N. Giordano; V. Antonucci
err分享
err收藏
Reconfigurable Intelligent Surfaces for Energy Efficiency in Wireless Communication无线通信能效的可重构智能表面
err2019-08-01
err2.4K
errOAAI
errHuang, Chongwen; Zappone, Alessio; Alexandropoulos, George C.; Debbah, Merouane; Yuen, Chau
err分享
err收藏
学者 查看更多内容