arrow
Return

Constrained Multi-Objective Optimization With Deep Reinforcement Learning Assisted Operator Selection

delete2024-04-01
delete4
delete
OA
AI
F
Fei Ming
龚文引 (Wenyin Gong) *
王玲 cover
王玲 (Ling Wang)
Y
Yaochu Jin
DOI:10.1109/JAS.2023.123687delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Solving constrained multi-objective optimization problems with evolutionary algorithms has attracted considerable attention. Various constrained multi-objective optimization evolutionary algorithms (CMOEAs) have been developed with the use of different algorithmic strategies, evolutionary operators, and constraint-handling techniques. The performance of CMOEAs may be heavily dependent on the operators used, however, it is usually difficult to select suitable operators for the problem at hand. Hence, improving operator selection is promising and necessary for CMOEAs. This work proposes an online operator selection framework assisted by Deep Reinforcement Learning. The dynamics of the population, including convergence, diversity, and feasibility, are regarded as the state; the candidate operators are considered as actions; and the improvement of the population state is treated as the reward. By using a Q-network to learn a policy to estimate the Q-values of all actions, the proposed approach can adaptively select an operator that maximizes the improvement of the population according to the current state and thereby improve the algorithmic performance. The framework is embedded into four popular CMOEAs and assessed on 42 benchmark problems. The experimental results reveal that the proposed Deep Reinforcement Learning-assisted operator selection significantly improves the performance of these CMOEAs and the resulting algorithm obtains better versatility compared to nine state-of-the-art CMOEAs.
Keywords:
Constrained multi-objective optimization
deep Q-learning
deep reinforcement learning (DRL)
evolutionary algorithms
evolutionary operator selection

Journal

I
IEEE-CAA Journal of Automatica Sinica
IF:
19.2
Papers:
1.4K
Citations:
1.1W

Organization

T
tsinghua university
Scholars:
11.9W
Papers: 10.0W
Citations: 137
C
China University of Geosciences
Scholars:
3.7W
Papers: 2.8W
Citations: 4.3W
U
University of Bielefeld
Scholars:
6.4K
Papers: 6.0K
Citations: 5
researcher View more organizations
Cited Papers

Cited Papers

A Dynamic Neighborhood-Based Switching Particle Swarm Optimization Algorithm
err2022-09-01
err177
errOAAI
errZeng, Nianyin; Wang, Zidong; Liu, Weibo; Zhang, Hong; Hone, Kate; Liu, Xiaohui
errShare
errSave
Isolation of tumorigenic circulating melanoma cells
err2010-11-01
err0
errOAAI
errJie Ma; Jennifer Y. Lin; Allireza Alloo; Brian J. Wilson; Tobias Schatton; Qian Zhan; George F. Murphy; Ana-Maria Waaga-Gasser; Martin Gasser; F. Stephen Hodi; Natasha Y. Frank; Markus H. Frank
errShare
errSave
errShare
errSave
Push and pull search for solving constrained multi-objective optimization problems
err2019-02-01
err342
errOAAI
errFan, Zhun; Li, Wenji; Cai, Xinye; Li, Hui; Wei, Caimin; Zhang, Qingfu; Deb, Kalyanmoy; Goodman, Erik
errShare
errSave
errShare
errSave
Distributed Services Attestation in IoT
err2018-11-30
err0
PREAI
errMauro Conti; Edlira Dushku; Luigi V. Mancini
errShare
errSave
researcher View more