arrow
Return

A Conditional Diffusion Model With Fast Sampling Strategy for Remote Sensing Image Super-Resolution

delete2024-01-01
delete3
PRE
AI
F
Fanen Meng
Y
Yijun Chen
H
Haoyu Jing
Y
Yiming Yan
Y
Yingchao Ren
吴森森 (Sensen Wu) *
T
Tian Feng
R
Renyi Liu
Z
Zhenhong Du
DOI:10.1109/TGRS.2024.3458009delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Conventional deep learning-based methods for single remote sensing image super-resolution (SRSISR) have made remarkable progress. However, the super-resolution (SR) outputs of these methods are yet to become sufficiently satisfactory in visual quality. Recent diffusion model-based generative deep learning models are capable to enhance the visual quality of output images, but this capability is limited due to their sampling efficiency. In this article, we propose FastDiffSR, an SRSISR method based on a conditional diffusion model. Specifically, we devise a novel sampling strategy to reduce the number of sampling steps required by the diffusion model while ensuring the sampling quality. Meanwhile, the residual image is adopted to reduce computational costs, demonstrating that integrating channel attention and spatial attention begets a further improvement in the visual quality of output images. Compared to the state-of-the-art (SOTA) convolutional neural network (CNN)-based, GAN-based, and Transformer-based SR methods, our FastDiffSR improves the learned perceptual image patch similarity (LPIPS) by 0.1-0.2 and achieves better visual results in some real-world scenes. Compared with existing diffusion-based SR methods, our FastDiffSR achieves significant improvements in pixel-level evaluation metric peak signal-noise ratio (PSNR) while having smaller model parameters and obtaining better SR results on Vaihingen data with faster inference time by 2.8-28 times, showing excellent generalization ability and time efficiency. Our code will be open source at https://github.com/Meng-333/FastDiffSR.
Keywords:
Diffusion models
Transformers
Superresolution
Remote sensing
Visualization
Computational modeling
Training
Conditional diffusion model
deep learning
generative models
remote sensing
super-resolution (SR)

Journal

IEEE Transactions on Geoscience and Remote Sensing cover
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
Papers:
2.1W
Citations:
10.7W

Organization

Z
zhejiang university
Scholars:
17.5W
Papers: 12.0W
Citations: 152
C
chinese academy of sciences
Scholars:
56.2W
Papers: 44.8W
Citations: 704