arrow
Return

A Supervised Learning and Control Method to Improve Particle Swarm Optimization Algorithms

delete2017-07-01
delete152
PRE
AI
W
Wenyong Dong
M
MengChu Zhou *
DOI:10.1109/TSMC.2016.2560128delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper presents an adaptive particle swarm optimization with supervised learning and control (APSO-SLC) for the parameter settings and diversity maintenance of particle swarm optimization (PSO) to adaptively choose parameters, while improving its exploration competence. Although PSO is a powerful optimization method, it faces such issues as difficult parameter setting and premature convergence. Inspired by supervised learning and predictive control strategies from machine learning and control fields, we propose APSO-SLC that employs several strategies to address these issues. First, we treat PSO with its optimization problem as a system to be controlled and model it as a dynamic quadratic programming model with box constraints. Its parameters are estimated by the recursive least squares with a dynamic forgetting factor to enhance better parameter setting and weaken worse ones. Its optimal parameters are calculated by this model to feed back to PSO. Second, a progress vector is proposed to monitor the progress rate for judging whether premature convergence happens. By studying the reason of premature convergence, this work proposes the strategies of back diffusion and new attractor learning to extend swam diversity, and speed up the convergence. Experiments are performed on many benchmark functions to compare APSO-SLC with the state-of-the-art PSOs. The results show that it is simple to program and understand, and can provide excellent and consistent performance.
Keywords:
Dynamic quadratic programming (DQP)
intelligent optimization
particle swarm optimization (PSO)
supervised learning and control (SLC)
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Cybernetics cover
IEEE Transactions on Cybernetics
IF:
10.5
Papers:
1.1W
Citations:
5.0W

Organization

W
wuhan university
Scholars:
8.1W
Papers: 5.8W
Citations: 70
Cited Papers

Cited Papers

Optimal Scheduling of Complex Multi-Cluster Tools Based on Timed Resource-Oriented Petri Nets
err2016-01-01
err38
errOAAI
errZhu, Qinghua; Wu, Naiqi; Qiao, Yan; Zhou, Mengchu
errShare
errSave
An adaptive particle swarm optimization method based on clustering
err2014-04-17
err111
PREAI
errLiang, Xiaolei; Li, Wenfeng; Zhang, Yu; Zhou, MengChu
errShare
errSave
Comprehensive learning particle swarm optimizer for global optimization of multimodal functions
err2006-06-01
err3.2K
PREAI
errLiang, J. J.; Qin, A. K.; Suganthan, Ponnuthurai Nagaratnam; Baskar, S.
errShare
errSave
GENERALIZATION OF THE MATRIX-INVERSION LEMMA
err1986-01-01
err130
PREAI
errTYLAVSKY, DJ; SOHIE, GRL
errShare
errSave
Composite Particle Swarm Optimizer With Historical Memory for Function Optimization
err2015-10-01
err144
PREAI
errLi, Jie; Zhang, Junqi; Jiang, ChangJun; Zhou, MengChu
errShare
errSave
Last-Position Elimination-Based Learning Automata
err2014-12-01
err55
PREAI
errZhang, Junqi; Wang, Cheng; Zhou, MengChu
errShare
errSave
researcher View more