arrow
Return

Learning Adaptive Differential Evolution Algorithm From Optimization Experiences by Policy Gradient

delete2021-08-01
delete74
delete
OA
AI
J
Jianyong Sun
X
Xin Liu *
T
Thomas Bäck
Z
Zongben Xu
DOI:10.1109/TEVC.2021.3060811delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Differential evolution is one of the most prestigious population-based stochastic optimization algorithm for black-box problems. The performance of a differential evolution algorithm depends highly on its mutation and crossover strategy and associated control parameters. However, the determination process for the most suitable parameter setting is troublesome and time consuming. Adaptive control parameter methods that can adapt to problem landscape and optimization environment are more preferable than fixed parameter settings. This article proposes a novel adaptive parameter control approach based on learning from the optimization experiences over a set of problems. In the approach, the parameter control is modeled as a finite-horizon Markov decision process. A reinforcement learning algorithm, named policy gradient, is applied to learn an agent (i.e., parameter controller) that can provide the control parameters of a proposed differential evolution adaptively during the search procedure. The differential evolution algorithm based on the learned agent is compared against nine well-known evolutionary algorithms on the CEC'13 and CEC'17 test suites. Experimental results show that the proposed algorithm performs competitively against these compared algorithms on the test suites.
Keywords:
Statistics
Sociology
Optimization
Process control
Deep learning
Reinforcement learning
Convergence
Adaptive differential evolution
deep learning
global optimization
policy gradient (PG)
reinforcement learning (RL)
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Evolutionary Computation cover
IEEE Transactions on Evolutionary Computation
IF:
12
Papers:
1.9K
Citations:
2.4W

Organization

X
xi'an jiaotong university
Scholars:
9.3W
Papers: 6.7W
Citations: 75
L
Leiden University
Scholars:
4.0W
Papers: 3.3W
Citations: 3.8W
Cited Papers

Cited Papers

errShare
errSave
Immersive Virtual Operating Room Simulation for Surgical Resident Education During COVID-19
err2020-08-13
err0
errOAAI
errFernando Pérez-Escamirosa; David Medina-Alvarez; Eduardo Alfredo Ruíz-Vereo; Ricardo Manuel Ordorica-Flores; Arturo Minor-Martínez; Jesús Tapia-Jurado
errShare
errSave
researcher View more