arrow
返回

TCDM: Effective Large-Factor Image Super-Resolution via Texture Consistency Diffusion

delete2024-01-01
delete7
PRE
AI
Y
Yan Zhang
H
Hanqi Liu
Z
Zhenghao Li
X
Xinbo Gao *
G
Guangyao Shi
J
Jianan Jiang
DOI:10.1109/TGRS.2024.3358913delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recently, remote sensing super -resolution (SR) tasks have been widely studied and achieved remarkable performance. However, due to the complex texture and serious image degeneration, the conventional methods (e.g., convolutional neural network (CNN) -based and GAN-based) cannot reconstruct high -resolution (HR) remote sensing images with a large SR factor (>= x8). In this article, we model the large -factor super -resolution (LFSR) task as a referenced diffusion process and explore how to embed pixelwise constraint into the popular diffusion model (DM). Following this motivation, we propose the first diffusion -based LFSR method named texture consistency diffusion model (TCDM) for remote sensing images. Specifically, we build a novel conditional truncated noise generator (CTNG) in TCDM to simultaneously generate the expectation of posterior probability p(x(t-1)|x(t)) and the truncated noise image. With the predicted truncated noise image, sampling an SR image using CTNG saves nearly 90% processing time compared to the naive DM. Additionally, we design a new denoising process named texture consistency diffusion (TC-diffusion) to explicitly embed pixelwise constraints into the LFSR DM during the training stage. Universal experiments on five commonly used remote sensing datasets demonstrate that the proposed TCDM surpasses the latest SR methods by a large margin and reports new SOTA results on several evaluation metrics. Additionally, the proposed method demonstrates impressive visual quality on reconstructed remote sensing image texture and details.
Keyword:
Remote sensing
Image reconstruction
Task analysis
Superresolution
Transformers
Faces
Image restoration
Diffusion models (DMs)
large-factor image super-resolution (SR)
remote sensing images
texture consistency

期刊

IEEE Transactions on Geoscience and Remote Sensing 封面图
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
论文数:
2.2W
被引数:
10.7W

机构

C
chongqing university of posts & telecommunications
学者数:
6.7K
论文数: 5.3K
被引数: 5
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Palpatory Apraxia
err2008-01-30
err0
PREAI
errAtsushi Yamadori
err分享
err收藏
From Artifact Removal to Super-Resolution
err2022-01-01
err16
PREAI
errWang, Jiaming; Shao, Zhenfeng; Huang, Xiao; Lu, Tao; Zhang, Ruiqian; Li, Yong
err分享
err收藏
SRDiff: Single image super-resolution with diffusion probabilistic modelsSRDiff: 具有扩散概率模型的单幅图像超分辨率
err2022-03-01
err330
errOAAI
errLi, Haoying; Yang, Yifan; Chang, Meng; Chen, Shiqi; Feng, Huajun; Xu, Zhihai; Li, Qi; Chen, Yueting
err分享
err收藏
Edge-Enhanced GAN for Remote Sensing Image Superresolution
err2019-08-01
err414
PREAI
errJiang, Kui; Wang, Zhongyuan; Yi, Peng; Wang, Guangcheng; Lu, Tao; Jiang, Junjun
err分享
err收藏
Exploring diagnostic m6A regulators in endometriosis
err2020-11-24
err0
errOAAI
errLi Jiang; Mengmeng Zhang; Jingni Wu; Sixue Wang; Xiang Yang; Mingyu Yi; Xinyue Zhang; Xiaoling Fang
err分享
err收藏
学者 查看更多内容