1
Return

Differential evolution based on reinforcement learning with fitness ranking for solving multimodal multiobjective problems

delete2019-09-01
delete91
PRE
AI
李志慧 (Zhihui Li)
L
Li Shi
岳彩通 cover
岳彩通 (Caitong Yue)
尚志刚 (Zhigang Shang) *
B
Boyang Qu
DOI:10.1016/j.swevo.2019.06.010delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In multimodal multiobjective optimization problems (MMOOPs), there is more than one Pareto-optimal Set (PS) in the decision space corresponding to the same Pareto Front(PF). How to dynamically adjust the evolution direction of the population adaptively is a key problem, to ensure approaching the PF in the global sense with good convergence while finding out more PSs. In this paper, a novel Differential Evolution algorithm based on Reinforcement Learning with Fitness Ranking (DE-RLFR) is proposed. The DE-RLFR is based on the Q-learning framework, and each individual in the population is considered an agent. The fitness ranking values of each agent are used to encode hierarchical state variables. Three typical DE mutation operations are employed as optional actions for the agent. Based on the analysis of the distribution characteristics of the population in objective space, decision space and fitness-ranking space, we design a reward function of the > state, action < pairs to guide the population to move to the PF asymptotically. According to its reinforcement learning experience represented by the corresponding Q table value, each agent could adaptively select a mutation strategy to generate offspring individuals. The evaluation results on eleven MMOOP test functions show that DE-RLFR could quickly and effectively find multiple PSs in the decision space, and approach PF in the global sense.
Keywords:
Multimodal multiobjective optimization problem
Differential evolution
Reinforcement learning
Fitness ranking
Q-learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Swarm and Evolutionary Computation cover
Swarm and Evolutionary Computation
IF:
8.5
Papers:
2.1K
Citations:
1.0W

Organization

Z
Zhongyuan University of Technology
Scholars:
3.1K
Papers: 1.7K
Citations: 2.0K
T
tsinghua university
Scholars:
11.5W
Papers: 9.9W
Citations: 137
Z
Zhengzhou University
Scholars:
6.8W
Papers: 4.4W
Citations: 8.5W
Cited Papers

Cited Papers

Citing Papers

Citing Papers