arrow
Return

Deep Reinforcement Learning Based Adaptive Operator Selection for Evolutionary Multi-Objective Optimization

delete2023-08-01
delete78
PRE
AI
Y
Ye Tian
X
Xiaopeng Li
H
Haiping Ma
X
Xingyi Zhang *
K
Kay Chen Tan
Y
Yaochu Jin
DOI:10.1109/TETCI.2022.3146882delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Evolutionary algorithms (EAs) have become one of the most effective techniques for multi-objective optimization, where a number of variation operators have been developed to handle the problems with various difficulties. While most EAs use a fixed operator all the time, it is a labor-intensive process to determine the best EA for a new problem. Hence, some recent studies have been dedicated to the adaptive selection of the best operators during the search process. To address the exploration versus exploitation dilemma in operator selection, this paper proposes a novel operator selection method based on reinforcement learning. In the proposed method, the decision variables are regarded as states and the candidate operators are regarded as actions. By using deep neural networks to learn a policy that estimates the $Q$ value of each action given a state, the proposed method can determine the best operator for each parent that maximizes its cumulative improvement. An EA is developed based on the proposed method, which is verified to be more effective than the state-of-the-art ones on challenging multi-objective optimization problems.
Keywords:
Reinforcement learning
Optimization
Convergence
Statistics
Sociology
Neural networks
Particle swarm optimization
Evolutionary algorithm
multi-objective optimization
operator selection
reinforcement learning

Journal

I
IEEE Transactions on Emerging Topics in Computational Intelligence
IF:
6.5
Papers:
1.4K
Citations:
4.5K

Organization

H
hefei university
Scholars:
2.3K
Papers: 1.3K
Citations: 20
H
hefei institutes of physical science, cas
Scholars:
4.5K
Papers: 3.5K
Citations: 4
A
anhui university
Scholars:
1.9W
Papers: 1.2W
Citations: 24
researcher View more organizations
Cited Papers

Cited Papers

Physical Activity in Community‐Dwelling Stroke Survivors and a Healthy Population Is Not Explained by Motor Function Only
err2013-08-23
err0
PREAI
errAnna Danielsson; Cristiane Meirelles; Carin Willen; Katharina Stibrant Sunnerhagen
errShare
errSave
errShare
errSave
Performance assessment of multiobjective optimizers: An analysis and review
err2003-04-01
err3.1K
errOAAI
errZitzler, E; Thiele, L; Laumanns, M; Fonseca, CM; da Fonseca, VG
errShare
errSave
Multiobjective evolutionary algorithms: A survey of the state of the art
err2011-03-01
err1.8K
PREAI
errZhou, Aimin; Qu, Bo-Yang; Li, Hui; Zhao, Shi-Zheng; Suganthan, Ponnuthurai Nagaratnam; Zhang, Qingfu
errShare
errSave
errShare
errSave
A 2-Year Prospective Follow-Up Study of the Course of Obsessive-Compulsive Disorder
err2010-08-15
err0
errOAAI
errJane L. Eisen; Anthony Pinto; Maria C. Mancebo; Ingrid R. Dyck; Maria E. Orlando; Steven A. Rasmussen
errShare
errSave
researcher View more