.png){kind=icon}
返回
ISPDiff: Interpretable Scale-Propelled Diffusion Model for Hyperspectral Image Super-Resolution
.png){kind=icon}
PRE
AI
DOI：10.1109/TGRS.2024.3407967.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Hyperspectral image (HSI) super-resolution (SR) employing the denoising diffusion probabilistic model (DDPM) holds significant promise with its remarkable performance. However, existing relevant works exhibit two limitations: 1) directly applying DDPM to fusion-based HSI-SR ignores the physical mechanism of HSI-SR and unique characteristics of HSI, resulting in less interpretability and 2) scale-invariant DDPM suffers from a time-consuming inference. To tackle these issues, we propose an interpretable scale-propelled diffusion (ISPDiff) model for HSI-SR, which combines the underlying principles of HSI-SR with DDPM for progressively unrolling reconstruction by learning its distribution at various scales, enhancing the transparency significantly and reducing the inference time prominently. Concretely, we destroy and downsample HSI into Gaussian noise in the forward process of ISPDiff. Then we design a unified scale-flexible model in the backward process to iteratively refine HSI in a coarse-to-fine manner through scale-matched reconstruction and cross-scale upsampling, which can be unfolded with optimization algorithms. These solved equations are one-to-one corresponding unrolled into two deep neural networks, called progressive perceptual model-driven scale-matched restoration network (P2MSRN) and cross-scale model-driven upsampling network (CMUN). Through end-to-end training, the proposed ISPDiff implements HSI-SR with a scale-propelled unrolling diffusion characterized by enhanced interpretability, stronger task orientation, and reduced time consumption. Systematic experiments have been conducted on three public datasets, demonstrating that ISPDiff outperforms state-of-the-art methods. The code is available at https://github.com/Jiahuiqu/ISPDiff.
Keyword:
Image reconstruction
Hyperspectral imaging
Spatial resolution
Task analysis
Mathematical models
Transformers
Superresolution
Deep unrolling network
diffusion model
hyperspectral image (HSI)
super-resolution (SR)
期刊
IF:
8.6
论文数:
2.1W
被引数:
10.7W
机构
引用论文
.png){kind=icon}
Sensorless Control of Z Source Inverter fed BLDC Motor Drive by FOC - DTC Hybrid Control Strategy Using Fuzzy Logic Controller采用模糊逻辑控制器的foc-dtc混合控制策略的Z源逆变器馈电BLDC电机驱动的无传感器控制
PREAI
分享收藏Cross-city matters: A multimodal remote sensing benchmark dataset for cross-city semantic segmentation using high-resolution domain adaptation networks跨城市事务: 使用高分辨率域适应网络进行跨城市语义分割的多模态遥感基准数据集
OAAI
OAAI分享收藏Generative Dual-Adversarial Network With Spectral Fidelity and Spatial Enhancement for Hyperspectral Pansharpening具有光谱保真度和空间增强的生成双对抗网络，用于高光谱Pansharpening
PREAI
分享收藏Formation of nitrosyl complexes in the reaction between platinum (II) nitro complexes and concentrated hydrochloric acid在铂 (II) 硝基配合物与浓盐酸之间的反应中形成亚硝基配合物
PREAI
分享收藏
查看更多内容