arrow
Return

Multitask Evolution Strategy With Knowledge-Guided External Sampling

delete2024-12-01
delete3
PRE
AI
Y
Yanchi Li
龚文引 (Wenyin Gong) *
S
Shuijia Li
DOI:10.1109/TEVC.2023.3330265delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Evolutionary multitask optimization employs similarities among tasks via evolutionary algorithms (EAs) with knowledge transfer techniques to address multiple optimization tasks simultaneously. Although existing knowledge transfer techniques achieved success on population-based EAs, they are inappropriate for evolution strategies (ESs) that employ probability distribution sampling. These techniques will face two difficulties when applied to ESs: 1) distribution adaptation errors and 2) convergence difficulties. This article proposes a knowledge-guided external sampling (KGxS) method to provide effective knowledge transfer in multitask ESs (MTESs) for solving multitask optimization problems (MTOPs). KGxS guides the distribution evolution in the target task by transferring solutions from source tasks as external samples. Since these external samples are close to the target distribution, they can handle the difficulty of distribution adaptation errors. In addition, the convergence difficulty caused by negative knowledge transfer is also handled through a mitigation strategy, which adaptively controls the number of external samples. Besides, the external samples carry two kinds of knowledge: 1) domain knowledge which employs the similarity of the optimal domains among tasks and 2) shape knowledge that utilizes the function shapes similarity among tasks. Furthermore, a general boundary constraint handling technique is proposed for ESs to adapt to unconstrained and constrained optimization environments. Empirical results show that KGxS can significantly enhance the positive transfer effect on different types of ES on MTOPs. Moreover, the proposed method obtained superior performance over 20 state-of-the-art algorithms on 38 benchmark problems and three types of real-world applications, including multitask, many-task, and constrained multitask optimization.
Keywords:
Knowledge transfer
Task analysis
Optimization
Convergence
Statistics
Sociology
Shape
Evolution strategy (ES)
evolutionary multitasking
external sampling
knowledge transfer
multitask optimization

Journal

IEEE Transactions on Evolutionary Computation cover
IEEE Transactions on Evolutionary Computation
IF:
12
Papers:
1.8K
Citations:
2.4W

Organization

C
China University of Geosciences
Scholars:
3.7W
Papers: 2.8W
Citations: 4.3W