arrow
返回

Controlling Sequential Hybrid Evolutionary Algorithm by Q-Learning

delete2023-02-01
delete6
delete
OA
AI
H
Haotian Zhang
J
Jianyong Sun *
T
Thomas Bäck
Qingfu Zhang 封面图
Qingfu Zhang (Qingfu Zhang)
Z
Zongben Xu
DOI:10.1109/MCI.2022.3222057delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Many state-of-the-art evolutionary algoritahms (EAs) can be categorized as sequential hybrid EAs, in which various EAs are sequentially executed. The timing to switch from one EA to another is critical to the performance of the hybrid EA because the switching time determines the allocation of computational resources and thereby it helps balance exploration and exploitation. In this article, a framework for adaptive parameter control for hybrid EAs is proposed, in which the switching time is controlled by a learned agent rather than a manually designed scheme. First the framework is applied to an adaptive differential evolution algorithm, LSHADE, to control when to use the scheme to reduce the population. Then the framework is applied to the algorithm that won the CEC 2018 competition, i.e., the hybrid sampling evolution strategy (HSES), to control when to switch from the univariate sampling phase to the Covariance Matrix Adaptation Evolution Straategy phase. The agents for parameter control in LSHADE and HSES are trained by using Q-learning and deep Q-learning to obtain the learned algorithms Q-LSHADE and DQ-HSES. The results of experiments on the CEC 2014 and 2018 test suites show that the learned algorithms significantly outperform their counterparts and some state-of-the-art EAs.
Keyword:
Q-learning
Sociology
Switches
Evolutionary computation
Control systems
Timing
Resource management

期刊

IEEE Computational Intelligence Magazine 封面图
IEEE Computational Intelligence Magazine
IF:
11.2
论文数:
613
被引数:
3.1K

机构

X
xi'an jiaotong university
学者数:
9.3W
论文数: 6.7W
被引数: 75
L
leiden university - excl lumc
学者数:
3.5W
论文数: 2.9W
被引数: 46
L
Leiden University
学者数:
4.0W
论文数: 3.3W
被引数: 3.8W
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Towards a wireless and fully-implantable ECoG system
err2013-06-01
err0
PREAI
errE. Tolstosheeva; J. Hoeffmann; J. Pistor; D. Rotermund; T. Schellenberg; D. Boll; T. Hertzberg; V. Gordillo-Gonzalez; S. Mandon; D. Peters-Drolshagen; M. Schneider; K. Pawelzik; A. Kreiter; S. Paul; W. Lang
err分享
err收藏
err分享
err收藏
Lead-free KNN-based thin films obtained by pulsed laser deposition通过脉冲激光沉积获得的无铅KNN基薄膜
err2022-06-27
err0
errOAAI
errBrenda Carreno-Jimenez; Jose Luis Benitez-Benitez; Rosalba Castaneda-Guzman; M. Acuautla; Rigoberto Lopez-Juarez
err分享
err收藏
err分享
err收藏
err2016-09-01
err0
PREAI
err
err分享
err收藏
学者 查看更多内容