arrow
Return

Learning-Based UAV Trajectory Optimization With Collision Avoidance and Connectivity Constraints

delete2022-06-01
delete6
delete
OA
AI
X
Xueyuan Wang
M
M. Cenk Gursoy *
DOI:10.1109/TWC.2021.3129226delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
Unmanned aerial vehicles (UAVs) are expected to be an integral part of wireless networks, and determining collision-free trajectories for multiple UAVs while satisfying requirements of connectivity with ground base stations (GBSs) is a challenging task. In this paper, we consider non-cooperative multi-UAV scenarios, in which multiple UAVs need to fly from initial locations to destinations, while satisfying collision avoidance, wireless connectivity, and kinematic constraints. We aim to find trajectories for the UAVs with the goal to minimize their mission completion time. We first formulate the multi-UAV trajectory optimization problem as a sequential decision making problem. We, then, propose a decentralized deep reinforcement learning approach to solve the problem. More specifically, a value network is developed to obtain values given the agent's joint state (including the agent's information, the nearby agents' observable information, and the locations of the nearby GBSs). A signal-to-interference-plus-noise ratio (SINR)-prediction neural network is also designed, using accumulated SINR measurements obtained when interacting with the cellular network, to map the GBSs' locations into the SINR levels in order to predict the UAV's SINR. Numerical results show that with the value network and SINR-prediction network, real-time navigation for multi-UAVs can be efficiently performed in various environments with high success rate.
Keywords:
Reinforcement learning
Collision avoidance
Wireless communication
Autonomous aerial vehicles
Trajectory optimization
Cellular networks
Antennas
Collision avoidance
decentralized algorithms
deep reinforcement learning
multi-UAV trajectory design
wireless connectivity

Journal

IEEE Transactions on Wireless Communications cover
IEEE Transactions on Wireless Communications
IF:
10.7
Papers:
1.3W
Citations:
5.3W

Organization

S
Syracuse University
Scholars:
142
Papers: 66
Citations: 0
Cited Papers

Cited Papers

Preliminary results from a phase I/II study of IMM0306, a CD47 and CD20 bispecific monoclonal antibody-trap, in patients with relapsed or refractory CD20-positive B-cell non-Hodgkin's lymphoma.
err2023-06-01
err0
PREAI
errJianliang Yang; Yongping Song; Zhiming Li; Mingzhi Zhang; Keshu Zhou; Zhen Wang; Hongmei Jing; Li Yu; Huizi Ma; Xiwen Zhao; Wei Li; Wei Meng; Wenzhi Tian; Yuankai Shi
errShare
errSave
Mo(Co)6Induced Cleavage of Oximes
err2006-08-22
err0
PREAI
errFlorence Geneste; Nadia Racelma; Alec Moradpour
errShare
errSave
The Hybrid Reciprocal Velocity Obstacle
err2011-08-01
err306
errOAAI
errSnape, Jamie; van den Berg, Jur; Guy, Stephen J.; Manocha, Dinesh
errShare
errSave
Lipid-Binding Activity of Intrinsically Unstructured Cytoplasmic Domains of Multichain Immune Recognition Receptor Signaling Subunits
err2006-12-19
err0
errOAAI
errAlexander B. Sigalov; Dikran A. Aivazian; Vladimir N. Uversky; Lawrence J. Stern
errShare
errSave
researcher View more