Particle Search Control Network for Dynamic Optimization

doi:10.1109/TSMC.2024.3448453

2024-11-01

PRE

杨圣祥 (Shengxiang Yang)

DOI：10.1109/TSMC.2024.3448453

原文链接

原文求助

摘要

En 中文

In dynamic optimization problems (DOPs), environmental changes can be characterized as various dynamics. Faced with different dynamics, existing dynamic optimization algorithms (DOAs) are difficult to tackle, because they are incapable of learning in each environment to control the search. Besides, diversity loss is a critical issue in solving DOPs. Maintaining a high-diversity over dynamic environments is reasonable as it can address such an issue automatically. In this article, we propose a particle search control network (PSCN) to maintain a high-diversity over time and control two key search actions of each input individual, i.e., locating the local learning target and adjusting the local acceleration coefficient. Specifically, PSCN adequately considers the diversity to generate subpopulations located by hidden node centers, where each center is assessed by significance-based criteria and distance-based criteria. The former enable a small intrasubpopulation distance and a big search scope (subpopulation width) for each subpopulation, while the latter make each center distant from other existing centers. In each subpopulation, the best-found position is selected as the local learning target. In the output layer, PSCN determines the action of adjusting the local acceleration coefficient of each individual. Reinforcement learning is introduced to obtain the desired output of PSCN, enabling the network to control the search by learning in different iterations of each environment. The experimental results especially performance comparisons with eight state-of-the-art DOAs demonstrate that PSCN brings significant improvements in performance of solving DOPs.

Keyword:

Optimization

Vehicle dynamics

Heuristic algorithms

Search problems

Monitoring

Detectors

Benchmark testing

Decision making

dynamic optimization

dynamics

neural network