arrow
Return

Learning to Transfer for Evolutionary Multitasking

delete2025-07-01
delete0
delete
OA
AI
S
Sheng-Hao Wu
Y
Yuxiao Huang
X
Xingyu Wu
L
Liang Feng
詹志辉 (Zhi‐Hui Zhan)
K
Kay Chen Tan
DOI:10.1109/TCYB.2025.3561518delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Evolutionary multitasking (EMT) is an emerging approach for solving multitask optimization problems (MTOPs) and has garnered considerable research interest. The implicit EMT is a significant research branch that utilizes evolution operators to enable knowledge transfer (KT) between tasks. However, current approaches in implicit EMT face challenges in adaptability, due to the limited use of different evolution operators with different parameter settings and insufficient utilization of evolutionary states for performing KT. This results in suboptimal exploitation of implicit KT’s potential to tackle a variety of MTOPs. To overcome these limitations, we propose a novel learning-to-transfer (L2T) framework to automatically discover efficient KT policies for the MTOPs at hand. Our framework conceptualizes the KT process as a learning agent’s sequence of strategic decisions within the EMT process. We propose an action formulation for deciding when and how to transfer, a state representation with informative features of evolution states, a reward formulation concerning convergence and transfer efficiency gain, and the environment for the agent to interact with MTOPs. We employ an actor-critic network structure for the agent and learn the policy via proximal policy optimization. This learned agent can be integrated with various evolutionary algorithms, enhancing their ability to address unseen MTOPs. Comprehensive empirical studies on both synthetic and real-world MTOPs, encompassing diverse intertask relationships, function classes, and task distributions are conducted to validate the proposed L2T framework. The results show a marked improvement in the adaptability and performance of implicit EMT when solving a wide spectrum of unseen MTOPs.
Keywords:
Evolutionary multitasking (EMT)
learning to optimize
reinforcement learning (RL)

Journal

IEEE Transactions on Cybernetics cover
IEEE Transactions on Cybernetics
IF:
10.5
Papers:
1.1W
Citations:
5.0W

Organization

C
Chongqing University
Scholars:
5.1W
Papers: 4.1W
Citations: 6.0W
T
The Hong Kong Polytechnic University
Scholars:
5.1K
Papers: 3.0K
Citations: 17
N
nankai university
Scholars:
4.7W
Papers: 3.2W
Citations: 74
researcher View more organizations