arrow
返回

Single image super-resolution with denoising diffusion GANS

delete2024-02-21
delete12
delete
OA
AI
H
Heng Xiao
X
Xin Wang *
J
Jun Wang *
J
Jingye Cai
J
Jian-Hua Deng
J
Jing-Ke Yan
Y
Yi-Dong Tang
DOI:10.1038/s41598-024-52370-3delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Single image super-resolution (SISR) refers to the reconstruction from the corresponding low-resolution (LR) image input to a high-resolution (HR) image. However, since a single low-resolution image corresponds to multiple high-resolution images, this is an ill-posed problem. In recent years, generative model-based SISR methods have outperformed conventional SISR methods in performance. However, the SISR methods based on GAN, VAE, and Flow have the problems of unstable training, low sampling quality, and expensive computational cost. These models also struggle to achieve the trifecta of diverse, high-quality, and fast sampling. In particular, denoising diffusion probabilistic models have shown impressive variety and high quality of samples, but their expensive sampling cost prevents them from being well applied in the real world. In this paper, we investigate the fundamental reason for the slow sampling speed of the SISR method based on the diffusion model lies in the Gaussian assumption used in the previous diffusion model, which is only applicable for small step sizes. We propose a new Single Image Super-Resolution with Denoising Diffusion GANS (SRDDGAN) to achieve large-step denoising, sample diversity, and training stability. Our approach combines denoising diffusion models with GANs to generate images conditionally, using a multimodal conditional GAN to model each denoising step. SRDDGAN outperforms existing diffusion model-based methods regarding PSNR and perceptual quality metrics, while the added latent variable Z solution explores the diversity of likely HR spatial domain. Notably, the SRDDGAN model infers nearly 11 times faster than diffusion-based SR3, making it a more practical solution for real-world applications.
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Scientific Reports 封面图
Scientific Reports
IF:
3.9
论文数:
27.9W
被引数:
83.5W

机构

G
Guilin University of Electronic Technology
学者数:
7.4K
论文数: 5.2K
被引数: 5.4K
引用论文

引用论文

Germanium
err2013-12-27
err0
PREAI
errFrank Melcher; Peter Buchholz
err分享
err收藏
Super-resolution reconstruction of single image for latent features基于潜在特征的单幅图像超分辨率重建
err2024-05-24
err3
errOAAI
errWang, Xin; Yan, Jing-Ke; Cai, Jing-Ye; Deng, Jian-Hua; Qin, Qin; Cheng, Yao
err分享
err收藏
SRDiff: Single image super-resolution with diffusion probabilistic modelsSRDiff: 具有扩散概率模型的单幅图像超分辨率
err2022-03-01
err330
errOAAI
errLi, Haoying; Yang, Yifan; Chang, Meng; Chen, Shiqi; Feng, Huajun; Xu, Zhihai; Li, Qi; Chen, Yueting
err分享
err收藏
Single-frame super-resolution in remote sensing: a practical overview
err2016-12-08
err97
errOAAI
errFernandez-Beltran, Ruben; Latorre-Carmona, Pedro; Pla, Filiberto
err分享
err收藏
err分享
err收藏
学者 查看更多内容