arrow
Return

One Step Diffusion-Based Super-Resolution With Time-Aware Distillation

delete2026-03-16
delete0
PRE
AI
X
X. He
H
Huaao Tang
Z
Zhijun Tu
J
Junchao Zhang
K
Kun Cheng
H
Hanting Chen
Y
Yong Guo
朱明睿 cover
朱明睿 (Mingrui Zhu)
J
Jie Hu
王南南 cover
王南南 (Nannan Wang)
X
Xinbo Gao
DOI:10.1109/TIP.2026.3672376delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Diffusion-based image super-resolution (SR) has shown strong potential in recovering high-fidelity details from low-resolution inputs. However, the need for tens or hundreds of sampling steps leads to substantial inference latency. Recent works attempt to accelerate this process via knowledge distillation, but often rely solely on pixel-level loss or overlook the fact that diffusion models capture different information across time steps. To address this, we propose TAD-SR, a time-aware diffusion distillation framework. Specifically, we introduce a novel score distillation strategy to align the score functions between the outputs of the student and teacher models after minor noise perturbation. This distillation strategy eliminates the inherent bias in score distillation sampling (SDS) and enables the student models to focus more on high-frequency image details by sampling at smaller time steps. We further introduce a time-aware discriminator that exploits the teacher’s knowledge to differentiate real and synthetic samples across different noise scales, using explicit temporal conditioning. Extensive experiments on SR tasks demonstrate that TAD-SR outperforms existing single-step diffusion methods and achieves performance on par with multi-step state-of-the-art models.
Keywords:
Accelerating diffusion model
super-resolution
single-step sampling
face restoration

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

H
huawei
Scholars:
43
Papers: 15
Citations: 0
X
xidian university
Scholars:
5.9K
Papers: 2.0K
Citations: 0