arrow
Return

Trace Pheromone-Based Energy-Efficient UAV Dynamic Coverage Using Deep Reinforcement Learning

delete2024-06-01
delete4
PRE
AI
X
Xu Cheng
R
Rong Jiang
H
Hongrui Sang
G
Gang Li
B
Bin He *
DOI:10.1109/TCCN.2024.3350590delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Unmanned aerial vehicles (UAVs) are widely used in disaster or remote areas to provide ubiquitous service. Due to the limited energy and communication range of UAVs, and the operation of UAVs is subject to high uncertainty, current coverage path planning algorithms are not sufficient. Therefore, autonomous dynamic and energy-efficient path planning is still an important research direction for improving coverage efficiency, especially involving multiagent. To address this problem, we introduce a novel trace pheromone into multi-agent reinforcement learning framework for energy-efficient UAV dynamic coverage control, which is termed trace pheromone-based UAV energy-efficient dynamic coverage (TP-EDC). First, we combine multi-agent deep deterministic policy gradient (MADDPG) with a trace pheromone model to serve as a strong tool for building our TP-EDC framework. Meanwhile, the trace pheromones model is integrated into stigmergy mechanism to simulate natural pheromones, which enhances the inner indirect communications among distributed UAVs and avoids network delay. Finally, the intensive simulation results demonstrate that the proposed method can maximize the coverage efficiency by comprehensively considering the coverage rate and energy consumption. Our method also shows significant dynamic coverage performance compared to two well-known baselines methods.
Keywords:
Autonomous aerial vehicles
Heuristic algorithms
Vehicle dynamics
Energy consumption
Task analysis
Energy efficiency
Robustness
Unmanned aerial vehicles
energy-efficient path planning
dynamic coverage control
trace pheromone-based

Journal

I
IEEE Transactions on Cognitive Communications and Networking
IF:
7
Papers:
1.5K
Citations:
5.5K

Organization

T
tongji university
Scholars:
7.7W
Papers: 5.9W
Citations: 98