arrow
返回

Q-Learning-Based Multi-Strategy Topology Particle Swarm Optimization Algorithm

delete2025-10-22
delete0
PRE
AI
X
Xiaoxi Hao
S
Shenwei Wang
X
Xiaotong Liu
T
Tianlei Wang *
Q
Qiu, Guangfan
Z
Zhiqiang Zeng
DOI:10.3390/a18110672delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In response to the issues of premature convergence and insufficient parameter control in Particle Swarm Optimization (PSO) for high-dimensional complex optimization problems, this paper proposes a Multi-Strategy Topological Particle Swarm Optimization algorithm (MSTPSO). The method builds upon a reinforcement learning-driven topological switching framework, where Q-learning dynamically selects among fully informed topology, small-world topology, and exemplar-set topology to achieve an adaptive balance between global exploration and local exploitation. Furthermore, the algorithm integrates differential evolution perturbations and a global optimal restart strategy based on stagnation detection, together with a dual-layer experience replay mechanism to enhance population diversity at multiple levels and strengthen the ability to escape local optima. Experimental results on 29 CEC2017 benchmark functions, compared against various PSO variants and other advanced evolutionary algorithms, show that MSTPSO achieves superior fitness performance and exhibits stronger stability on high-dimensional and complex functions. Ablation studies further validate the critical contribution of the Q-learning-based multi-topology control and stagnation detection mechanisms to performance improvement. Overall, MSTPSO demonstrates significant advantages in convergence accuracy and global search capability.
Keyword:
particle swarm optimization
multi-topology structure
reinforcement learning
experience replay strategy
stagnation detection

期刊

Algorithms 封面图
Algorithms
IF:
2.1
论文数:
631
被引数:
5.4K

机构

W
wuyi university
学者数:
1.3K
论文数: 344
被引数: 0
D
dongguan university of technology
学者数:
1.0K
论文数: 393
被引数: 0
引用论文

引用论文

A Dynamic Neighborhood-Based Switching Particle Swarm Optimization Algorithm
err2022-09-01
err177
errOAAI
errZeng, Nianyin; Wang, Zidong; Liu, Weibo; Zhang, Hong; Hone, Kate; Liu, Xiaohui
err分享
err收藏
Incorporating Surprisingly Popular Algorithm and Euclidean distance-based adaptive topology into PSO
err2023-02-01
err27
errOAAI
errWu, Xuan; Han, Jizong; Wang, Di; Gao, Pengyue; Cui, Quanlong; Chen, Liang; Liang, Yanchun; Huang, Han; Lee, Heow Pueh; Miao, Chunyan; Zhou, You; Wu, Chunguo
err分享
err收藏
Q-learning embedded sine cosine algorithm (QLESCA)Q学习嵌入式正弦余弦算法 (qleca)
err2022-05-01
err21
PREAI
errHamad, Qusay Shihab; Samma, Hussein; Suandi, Shahrel Azmin; Mohamad-Saleh, Junita
err分享
err收藏
Multi Actors-Critic based particle swarm optimization algorithm基于多行动者-批评家的粒子群优化算法
err2025-04-01
err0
PREAI
errChen, Hui; Shen, Li-Yong; Wang, Chunmei; Tian, Lei; Zhang, Sanguo
err分享
err收藏
学者 查看更多内容