返回
A Q-learning based path planning method with hyper-heuristic scheduling and escaping based algorithms
DOI:10.1016/j.eswa.2026.132128.png)
摘要
En 中文
为代理在复杂陷阱环境中规划稳定可靠的路径是自主导航中的一个关键挑战。大多数路径规划算法存在收敛速度慢、易陷入局部最优以及产生次优路径等问题。为解决这些挑战,本文提出了一种改进的Q学习路径规划算法(DHH-QL),旨在应对此类环境中的困难。本研究提出的DHH-QL算法集成了基于评估函数的超启发式调度算法(QHDF)。在QHDF中,评估函数用于合理调度各种启发式算子,生成最优的虚拟全局路径和逃生路径,以帮助代理快速逃离陷阱环境。此外,我们设计了一种剪枝策略,通过生成逃生点进行剪枝,以解决陷阱环境中冗余路径生成的问题。进一步地,DHH-QL引入了一种创新的间歇学习策略,该策略根据代理对陷阱环境的适应情况动态调整学习率,实现自适应学习。研究在随机环境以及静态和动态陷阱环境中进行,结果表明,DHH-QL在运行时间、路径长度、平滑度和收敛速度方面优于ACO、GA、传统QL、O-QL和TRE-QL算法。实验结果证实,DHH-QL通过整合超启发式调度、剪枝策略和间歇学习,为随机和复杂陷阱环境中的路径规划提供了有效解决方案。
Keyword:
Q-learning
path planning
hyper-heuristic scheduling
trap environment
intermittent learning
期刊
IF:
7.5
论文数:
3.0W
被引数:
10.2W
机构
引用论文
Exploring the application of ant colony optimization in path planning for Unmanned Surface Vehicles探索蚁群优化在无人水面车辆路径规划中的应用
Scalable path planning algorithm for multi-Unmanned Surface Vehicles based on Multi-Agent Deep Deterministic Policy Gradient基于多智能体深度确定性策略梯度(MADDPG)的多无人水面艇可扩展路径规划算法
OCEAN ENGINEERING
IF5.5
A Q-learning based multi-strategy integrated artificial bee colony algorithm with application in unmanned vehicle path planning基于Q学习的多策略集成人工蜂群算法及其在无人车路径规划中的应用
Intelligent Warehouse Robot Path Planning Based on Improved Ant Colony Algorithm基于改进蚁群算法的智能仓储机器人路径规划
IEEE ACCESS
IF3.6
A Robot Path Planning Method Based on Improved Genetic Algorithm and Improved Dynamic Window Approach
SUSTAINABILITY
IF3.3
An overview of reinforcement learning-based approaches for smart home energy management systems with energy storages基于强化学习的带能量存储的智能家居能源管理系统方法综述
Improved ACO algorithm fused with improved Q-Learning algorithm for Bessel curve global path planning of search and rescue robots改进的蚁群算法与改进的Q学习算法融合用于贝塞尔曲线全局路径规划的搜救机器人
Dynamic path planning of a three-dimensional underwater AUV based on an adaptive genetic algorithm基于自适应遗传算法的三维水下AUV动态路径规划

