arrow
Return

IPGDR-SAC: a lidar-driven mapless navigation algorithm using reinforcement learning

delete2026-07-13
delete0
PRE
AI
H
Huiyan Han *
J
Jiaqi Wang
W
Wanning Li
L
Liqun Kuang
X
Xie Han
DOI:10.1007/s10586-026-06315-2delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Enhancing the service capabilities of robots relies heavily on their autonomous navigation performance and effective obstacle avoidance during motion. This study addresses key limitations of current deep reinforcement learning-based path planning methods, such as low training efficiency, suboptimal trajectory generation, and poor performance in complex trap scenarios. To address these challenges, we propose GDR-SAC (Genetic and Dynamic Reward-based Soft Actor-Critic), a novel approach that integrates a dedicated Lidar data feature extraction module for enhanced environmental perception, a customized SAC network architecture, a dynamic reward function tailored for continuous action spaces, and an innovative sampling strategy enhanced by genetic algorithms. Furthermore, we introduce IPGDR-SAC, an extension of GDR-SAC that incorporates a Point of Interest (PoI) exploration module to effectively navigate complex trap scenarios. Comprehensive training and evaluation across diverse environments, including both Gazebo simulation platforms and real-world settings demonstrate the effectiveness of the proposed approach. Experimental results show that the GDR-SAC algorithm significantly improves training efficiency and convergence speed, while generating smoother, shorter, and more efficient collision-free trajectories. Moreover, IPGDR-SAC exhibits superior autonomous navigation performance in intricate environments by leveraging Lidar data to successfully escape from entrapment situations and handle challenging navigation tasks.
Keywords:
Path planning
Deep reinforcement learning
SAC
Reward function
Interest point

Journal

C
Cluster Computing-The Journal of Networks Software Tools and Applications
IF:
4.1
Papers:
5.1K
Citations:
7.5K

Organization

S
school of system science and technology
Scholars:
2
Papers: 1
Citations: 0
S
School of Computer Science and Technology
Scholars:
1.5K
Papers: 566
Citations: 0
Cited Papers

Cited Papers

Robot Search Path Planning Method Based on Prioritized Deep Reinforcement Learning
err2022-07-12
err0
PREAI
errYanglong Liu; Zuguo Chen; Yonggang Li; Ming Lu; Chaoyang Chen; Xuzhuo Zhang
errShare
errSave
errShare
errSave
Dynamic window based approaches for avoiding obstacles in moving
err2019-08-01
err0
PREAI
errEduardo J. Molinos; Ángel Llamazares; Manuel Ocaña
errShare
errSave
A review of motion planning algorithms for intelligent robots
err2021-11-25
err100
errOAAI
errZhou, Chengmin; Huang, Bingding; Franti, Pasi
errShare
errSave
errShare
errSave
Path Planning for Multi-Arm Manipulators Using Deep Reinforcement Learning: Soft Actor-Critic with Hindsight Experience Replay
errSENSORS
IF3.5
err2020-10-19
err66
errOAAI
errPrianto, Evan; Kim, MyeongSeop; Park, Jae-Han; Bae, Ji-Hun; Kim, Jung-Su
errShare
errSave
Deep reinforcement learning for optimal rescue path planning in uncertain and complex urban pluvial flood scenarios
err2023-09-01
err10
PREAI
errLi, Xiaoyan; Liang, Xuedong; Wang, Xia; Wang, Rong; Shu, Lingli; Xu, Wentao
errShare
errSave
researcher View more