arrow
Return

Multiobjective Evolutionary Diffusion Transformer Acceleration

delete2026-09-25
delete0
PRE
AI
Y
Yao Zhou
Y
Yi Zhang
G
Gary G. Yen
DOI:10.1109/tcyb.2026.3731615delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Diffusion Transformers (DiTs) have demonstrated outstanding performance in the field of image synthesis. However, the prohibitive computational overhead of model inference has been a major hurdle for deployment in low-latency scenarios. Based on the repetitive nature of the denoising process, we propose a multiobjective evolutionary algorithm for DiT acceleration, dubbed MEDA. Particularly, the conflict between the computational cost of the sampling process and the degradation in generation quality is explicitly modeled as a two-objective optimization problem, and similar intermediate features in adjacent sampling steps are stored and reused according to evolutionary-optimized schedules. Besides, a dynamic condition evaluation strategy is designed and incorporated into the evolutionary algorithm to maintain the generation performance of accelerated DiT models across different condition inputs. In addition, a latent objective normalization strategy is introduced to provide a bounded objective space for the evolution process. Experiments across various DiT architectures demonstrate that the proposed MEDA can significantly accelerate the sampling process while maintaining or even further enhancing generation quality relative to the original baseline models.
Keywords:
Diffusion Transformer (DiT)
evolutionary algorithm
inference acceleration
multiobjective optimization

Journal

IEEE Transactions on Cybernetics cover
IEEE Transactions on Cybernetics
IF:
10.5
Papers:
1.1W
Citations:
5.0W

Organization

S
Sichuan University
Scholars:
590
Papers: 155
Citations: 0
Cited Papers

Cited Papers

No cited papers available