arrow
Return

SRDiff: Single image super-resolution with diffusion probabilistic models

delete2022-03-01
delete330
delete
OA
AI
H
Haoying Li
Y
Yifan Yang
M
Meng Chang
S
Shiqi Chen
H
Huajun Feng *
Z
Zhihai Xu
Q
Qi Li
Y
Yueting Chen
DOI:10.1016/j.neucom.2022.01.029delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Single image super-resolution (SISR) aims to reconstruct high-resolution (HR) images from given low resolution (LR) images. It is an ill-posed problem because one LR image corresponds to multiple HR images. Recently, learning-based SISR methods have greatly outperformed traditional methods. However, PSNR-oriented, GAN-driven and flow-based methods suffer from over-smoothing, mode collapse and large model footprint issues, respectively. To solve these problems, we propose a novel SISR diffusion probabilistic model (SRDiff), which is the first diffusion-based model for SISR. SRDiff is optimized with a variant of the variational bound on the data likelihood. Through a Markov chain, it can provide diverse and realistic super-resolution (SR) predictions by gradually transforming Gaussian noise into a super-resolution image conditioned on an LR input. In addition, we introduce residual prediction to the whole framework to speed up model convergence. Our extensive experiments on facial and general benchmarks (CelebA and DIV2K datasets) show that (1) SRDiff can generate diverse SR results with rich details and achieve competitive performance against other state-of-the-art methods, when given only one LR input; (2) SRDiff is easy to train with a small footprint(The word footprint in this paper represents model size (number of model parameters).); (3) SRDiff can perform flexible image manipulation operations, including latent space interpolation and content fusion. (c) 2022 Elsevier B.V. All rights reserved.
Keywords:
Single image super-resolution
Diffusion probabilistic model
Diverse results
Deep learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

Z
zhejiang university
Scholars:
17.7W
Papers: 12.1W
Citations: 152
Cited Papers

Cited Papers

Involvement of JAK/STAT (Janus Kinase/Signal Transducer and Activator of Transcription) in the Thyrotropin Signaling Pathway
err2000-05-01
err0
errOAAI
errEun Shin Park; Ho Kim; Jae Mi Suh; Soo Jung Park; Soon Hee You; Hyo Kyun Chung; Kang Wook Lee; O-Yu Kwon; Bo Youn Cho; Young Kun Kim; Heung Kyu Ro; Jongkyeong Chung; Minho Shong
errShare
errSave
Computational characterization of a-Si:H/c-Si interfaces
err2018-08-30
err0
PREAI
errPhilippe Czaja; Simone Giusepponi; Michele Gusso; Massimo Celino; Urs Aeberhard
errShare
errSave
De Novo-Designed Near-Infrared Nanoaggregates for Super-Resolution Monitoring of Lysosomes in Cells, in Whole Organoids, and in Vivo
err2019-12-04
err59
errOAAI
errFang, Hongbao; Yao, Shankun; Chen, Qixin; Liu, Chunyan; Cai, Yuqi; Geng, Shanshan; Bai, Yang; Tian, Zhiqi; Zacharias, Amanda L.; Takebe, Takanori; Chen, Yuncong; Guo, Zijian; He, Weijiang; Diao, Jiajie
errShare
errSave
Single image super-resolution with multi-level feature fusion recursive network
err2019-12-01
err29
PREAI
errJin, Xin; Xiong, Qiming; Xiong, Chengyi; Li, Zhibang; Gao, Zhirong
errShare
errSave
RBPNET: An asymptotic Residual Back-Projection Network for super-resolution of very low-resolution face image
err2020-02-01
err13
PREAI
errChen, Xiaozhen; Wang, Xuebo; Lu, Yao; Li, Weiqi; Wang, Zijian; Huang, Zhuowei
errShare
errSave
Generative collaborative networks for single image super-resolution
err2020-07-01
err3
errOAAI
errSeddik, Mohamed El Amine; Tamaazousti, Mohamed; Lin, John
errShare
errSave
researcher View more