arrow
Return

Multiobjective Evolutionary Diffusion Transformer Acceleration

delete2026-09-25
delete0
PRE
AI
Y
Yao Zhou
Y
Yi Zhang
G
Gary G. Yen
DOI:10.1109/tcyb.2026.3731615delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
Diffusion Transformers (DiTs) have demonstrated outstanding performance in the field of image synthesis. However, the prohibitive computational overhead of model inference has been a major hurdle for deployment in low-latency scenarios. Based on the repetitive nature of the denoising process, we propose a multiobjective evolutionary algorithm for DiT acceleration, dubbed MEDA. Particularly, the conflict between the computational cost of the sampling process and the degradation in generation quality is explicitly modeled as a two-objective optimization problem, and similar intermediate features in adjacent sampling steps are stored and reused according to evolutionary-optimized schedules. Besides, a dynamic condition evaluation strategy is designed and incorporated into the evolutionary algorithm to maintain the generation performance of accelerated DiT models across different condition inputs. In addition, a latent objective normalization strategy is introduced to provide a bounded objective space for the evolution process. Experiments across various DiT architectures demonstrate that the proposed MEDA can significantly accelerate the sampling process while maintaining or even further enhancing generation quality relative to the original baseline models.
Keywords:
Diffusion Transformer (DiT)
evolutionary algorithm
inference acceleration
multiobjective optimization

Journal

IEEE Transactions on Cybernetics cover
IEEE Transactions on Cybernetics
IF:
10.5
Papers:
1.1W
Citations:
6.3W

Organization

Sichuan University cover
Sichuan University
Scholars:
8.7K
Papers: 2.0K
Citations: 2.0W
Cited Papers

Cited Papers

U-Net: Convolutional Networks for Biomedical Image Segmentation
err2015-11-18
err0
PREAI
errOlaf Ronneberger; Philipp Fischer; Thomas Brox
errShare
errSave
Rethinking the Inception Architecture for Computer Vision
err2016-06-01
err0
errOAAI
errChristian Szegedy; Vincent Vanhoucke; Sergey Ioffe; Jon Shlens; Zbigniew Wojna
errShare
errSave
High-Resolution Image Synthesis with Latent Diffusion Models
err2022-06-01
err0
errOAAI
errRobin Rombach; Andreas Blattmann; Dominik Lorenz; Patrick Esser; Bjorn Ommer
errShare
errSave
errShare
errSave
On the Scalability of Diffusion-based Text-to-Image Generation
err2024-06-16
err0
PREAI
errLi,Hao; Zou,Yang; Wang,Ying; Majumder,Orchid; Xie,Yusheng; Manmatha,R.; Swaminathan,Ashwin; Tu,Zhuowen; Ermon,Stefano; Soatto,Stefano
errShare
errSave
NADM: Noise-Aware Diffusion Model for Landscape Painting Video Generation
err2025-08-01
err0
PREAI
errDing-Ming Liu; Shao-Wei Li; Ruo-Yan Zhou; Li-Li Liang; Yong-Guan Hong; Yuan-Ze Zeng; Xiang Chang; Li-Jiang Li; Tian-Shuo Xu; Fei Chao; Changjing Shang; Qiang Shen
errShare
errSave
researcher View more