arrow
Return

One Step Diffusion-Based Super-Resolution With Time-Aware Distillation

delete2026-03-16
delete0
PRE
AI
X
X. He
H
Huaao Tang
Z
Zhijun Tu
J
Junchao Zhang
K
Kun Cheng
H
Hanting Chen
Y
Yong Guo
朱明睿 cover
朱明睿 (Mingrui Zhu)
J
Jie Hu
王南南 cover
王南南 (Nannan Wang)
X
Xinbo Gao
DOI:10.1109/TIP.2026.3672376delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Diffusion-based image super-resolution (SR) has shown strong potential in recovering high-fidelity details from low-resolution inputs. However, the need for tens or hundreds of sampling steps leads to substantial inference latency. Recent works attempt to accelerate this process via knowledge distillation, but often rely solely on pixel-level loss or overlook the fact that diffusion models capture different information across time steps. To address this, we propose TAD-SR, a time-aware diffusion distillation framework. Specifically, we introduce a novel score distillation strategy to align the score functions between the outputs of the student and teacher models after minor noise perturbation. This distillation strategy eliminates the inherent bias in score distillation sampling (SDS) and enables the student models to focus more on high-frequency image details by sampling at smaller time steps. We further introduce a time-aware discriminator that exploits the teacher’s knowledge to differentiate real and synthetic samples across different noise scales, using explicit temporal conditioning. Extensive experiments on SR tasks demonstrate that TAD-SR outperforms existing single-step diffusion methods and achieves performance on par with multi-step state-of-the-art models.
Keywords:
Accelerating diffusion model
super-resolution
single-step sampling
face restoration

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

H
huawei
Scholars:
43
Papers: 15
Citations: 0
X
xidian university
Scholars:
6.6K
Papers: 2.2K
Citations: 0
Cited Papers

Cited Papers

NTIRE 2017 Challenge on Single Image Super-Resolution: Methods and Results
err2017-07-01
err0
errOAAI
errRadu Timofte; Eirikur Agustsson; Luc Van Gool; Ming-Hsuan Yang; Lei Zhang; Bee Lim; Sanghyun Son; Heewon Kim; Seungjun Nah; Kyoung Mu Lee; Xintao Wang; Yapeng Tian; Ke Yu; Yulun Zhang; Shixiang Wu; Chao Dong; Liang Lin; Yu Qiao; Chen Change Loy; Woong Bae; Jaejun Yoo; Yoseob Han; Jong Chul Ye; Jae-Seok Choi; Munchurl Kim; Yuchen Fan; Jiahui Yu; Wei Han; Ding Liu; Haichao Yu; Zhangyang Wang; Honghui Shi; Xinchao Wang; Thomas S. Huang; Yunjin Chen; Kai Zhang; Wangmeng Zuo; Zhimin Tang; Linkai Luo; Shaohui Li; Min Fu; Lei Cao; Wen Heng; Giang Bui; Truc Le; Ye Duan; Dacheng Tao; Ruxin Wang; Xu Lin; Jianxin Pang; Jinchang Xu; Yu Zhao; Xiangyu Xu; Jinshan Pan; Deqing Sun; Yujin Zhang; Xibin Song; Yuchao Dai; Xueying Qin; Xuan-Phung Huynh; Tiantong Guo; Hojjat Seyed Mousavi; Tiep Huu Vu; Vishal Monga; Cristovao Cruz; Karen Egiazarian; Vladimir Katkovnik; Rakesh Mehta; Arnav Kumar Jain; Abhinav Agarwalla; Ch V. Sai Praveen; Ruofan Zhou; Hongdiao Wen; Che Zhu; Zhiqiang Xia; Zhengtao Wang; Qi Guo
errShare
errSave
High-Resolution Image Synthesis with Latent Diffusion Models
err2022-06-01
err0
errOAAI
errRobin Rombach; Andreas Blattmann; Dominik Lorenz; Patrick Esser; Bjorn Ommer
errShare
errSave
MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessment
err2022-06-01
err0
errOAAI
errSidi Yang; Tianhe Wu; Shuwei Shi; Shanshan Lao; Yuan Gong; Mingdeng Cao; Jiahao Wang; Yujiu Yang
errShare
errSave
Improved Distribution Matching Distillation for Fast Image Synthesis
err2024-01-01
err0
PREAI
errDurand,Frédo; Freeman,William; Gharbi,Michaël; Park,Taesung; Shechtman,Eli; Yin,Tianwei; Zhang,Richard
errShare
errSave
researcher View more