arrow
Return

Model-Free UAV Navigation in Unknown Complex Environments Using Vision-Based Reinforcement Learning

delete2025-08-13
delete0
delete
OA
AI
H
Hao Wu
W
Wei Wang
T
Tong Wang
S
Satoshi Suzuki *
DOI:10.3390/drones9080566delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Autonomous UAV navigation in unknown and complex environments remains a core challenge, especially under limited sensing and computing resources. While most methods rely on modular pipelines involving mapping, planning, and control, they often suffer from poor real-time performance, limited adaptability, and high dependency on accurate environment models. Moreover, many deep-learning-based solutions either use RGB images prone to visual noise or optimize only a single objective. In contrast, this paper proposes a unified, model-free vision-based DRL framework that directly maps onboard depth images and UAV state information to continuous navigation commands through a single convolutional policy network. This end-to-end architecture eliminates the need for explicit mapping and modular coordination, significantly improving responsiveness and robustness. A novel multi-objective reward function is designed to jointly optimize path efficiency, safety, and energy consumption, enabling adaptive flight behavior in unknown complex environments. The trained policy demonstrates generalization in diverse simulated scenarios and transfers effectively to real-world UAV flights. Experiments show that our approach achieves stable navigation and low latency.
Keywords:
UAV navigation
deep reinforcement learning
model-free control
multi-objective optimization
end-to-end vision-based policy
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

D
Drones
IF:
4.8
Papers:
3.8K
Citations:
8.3K

Organization

F
Fukushima Institute for Research
Scholars:
3
Papers: 7
Citations: 0
C
Chiba University
Scholars:
1.5W
Papers: 1.1W
Citations: 1.0W