arrow
Return

Meta-Learning Inspired Single-Step Generative Model for Expensive Multitask Optimization Problems

delete2025-10-02
delete0
PRE
AI
R
Ruilin Wang
X
Xiang Feng
余
余慧群 (Huiqun Yu)
Y
Yang Tan
E
Edmund Lai
DOI:10.1109/tevc.2025.3617343delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In expensive multitask optimization problems (ExMTOPs), multiple complex tasks must be optimized simultaneously under limited computational budgets. Existing approaches, often based on surrogate models, aim to approximate objective functions but struggle to generalize across heterogeneous tasks, depend on task-specific sampling, and require frequent retraining. To address these challenges, we propose the multifactorial evolutionary algorithm (MFEA)–Single Step Generative Model (MFEA-SSG), a meta-learning-inspired framework that learns to generate high-quality solutions across tasks. Inspired by meta-learning, we treat each random shuffle of the decision variables as a unique pseudo-task, training the model on a distribution of these tasks to learn a task-agnostic prior about the structure of elite solutions. This process disrupts task-specific dependencies, allowing the model to learn transferable structures from recomposed samples. We then adopt a diffusion-based generative model to learn the distribution of optimal solutions, enabling knowledge transfer across tasks without directly approximating objective functions. To reduce inference cost, we introduce a student model distilled from the diffusion process. Unlike conventional diffusion models that denoise iteratively, the student generates solutions in a single forward pass, significantly reducing inference time. Comprehensive experiments on both general multitask benchmarks and a real-world protein mutation prediction scenario demonstrate that MFEA-SSG achieves high-quality solutions with fast convergence and low computational cost under limited evaluation budgets, outperforming state-of-the-art general and ExMTOPs algorithms.
Keywords:
Expensive evolutionary multitasking (EMT)
generative model
knowledge transfer
meta learning
multifactorial evolutionary algorithm (MFEA)

Journal

IEEE Transactions on Evolutionary Computation cover
IEEE Transactions on Evolutionary Computation
IF:
12
Papers:
1.9K
Citations:
2.4W

Organization

S
shanghai jiao tong university
Scholars:
15.7W
Papers: 11.7W
Citations: 159
E
east china university of science and technology
Scholars:
8.6K
Papers: 2.8K
Citations: 3
A
auckland university of technology
Scholars:
719
Papers: 392
Citations: 0
researcher View more organizations
Cited Papers

Cited Papers

A Review of Modern Recommender Systems Using Generative Models (Gen-RecSys)
err2024-08-24
err0
errOAAI
errYashar Deldjoo; Zhankui He; Julian McAuley; Anton Korikov; Scott Sanner; Arnau Ramisa; René Vidal; Maheswaran Sathiamoorthy; Atoosa Kasirzadeh; Silvia Milano
errShare
errSave
Block-Level Knowledge Transfer for Evolutionary Multitask Optimization
err2024-01-01
err21
errOAAI
errJiang, Yi; Zhan, Zhi-Hui; Tan, Kay Chen; Zhang, Jun
errShare
errSave
err
IF0
err
err0
errOAAI
err
errShare
errSave
errShare
errSave
errShare
errSave
researcher View more