.png){kind=icon}
返回
Vector-Quantized Variational AutoEncoder for pansharpening
.png){kind=icon}
PRE
AI
DOI：10.1080/01431161.2023.2265542.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Pansharpening refers to the fusion of a multispectral image (MS) and a panchromatic image (PAN) to obtain a new image with the same spatial resolution as the PAN image and the same spectral resolution as the MS image. This paper describes a new, efficient, and accurate pansharpening architecture. The Vector-Quantized Variational AutoEncoder (VQ-VAE) is the foundation of the proposed method. The VQ-VAE model is trained to learn the non-linear mapping of degraded panchromatic image patches to high-resolution patches. This approach ensures that high-resolution patches can be recovered from low-resolution ones. After training on PAN patches, the VQ-VAE estimates high-resolution multispectral patches for each band of the original multispectral image before reconstructing the high-resolution multispectral image from the patches. The original multispectral image, the panchromatic image, and the estimated high-resolution multispectral image are combined through a modified Component Substitution (CS) process to obtain the pansharpened image. Three large satellite datasets from urban areas with 4-band spectral resolution (blue, green, red, and near-infrared) were used to evaluate the proposed pansharpening method's performance. The effectiveness of the proposed method is demonstrated by the quantitative and visual results obtained compared to several literature approaches.
Keyword:
Pansharpening
multispectral images
panchromatic images
fusion
autoencoder
deep learning
期刊
IF:
2.6
论文数:
1.2W
被引数:
2.7W
机构
引用论文
.png){kind=icon}
Pansharpening for Cloud-Contaminated Very High-Resolution Remote Sensing Images云污染的高分辨率遥感影像的泛锐化
PREAI
分享收藏A survey of pansharpening methods with a new band-decoupled variational model一种新的带解耦变分模型的泛锐化方法综述
OAAI
OAAI分享收藏
Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis基于过采样多分辨率分析的上下文驱动高空间与光谱分辨率影像融合
PREAI
分享收藏
查看更多内容