arrow
Return

W-NetPan: Double-U network for inter-sensor self-supervised pan-sharpening

delete2023-04-01
delete2
delete
OA
AI
R
Rubén Fernández-Beltrán *
R
Rafael Caballero Fernández
R
Rang, Jian
F
Filiberto Pla
DOI:10.1016/j.neucom.2023.02.002delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
The increasing availability of remote sensing data allows dealing with spatial-spectral limitations by means of pan-sharpening methods. However, fusing inter-sensor data poses important challenges, in terms of resolution differences, sensor-dependent deformations and ground-truth data availability, that demand more accurate pan-sharpening solutions. In response, this paper proposes a novel deep learningbased pan-sharpening model which is termed as the double-U network for self-supervised pansharpening (W-NetPan). In more details, the proposed architecture adopts an innovative W-shape that integrates two U-Net segments which sequentially work for spatially matching and fusing inter-sensor multi-modal data. In this way, a synergic effect is produced where the first segment resolves intersensor deviations while stimulating the second one to achieve a more accurate data fusion. Additionally, a joint loss formulation is proposed for effectively training the proposed model without external data supervision. The experimental comparison, conducted over four coupled Sentinel-2 and Sentinel-3 datasets, reveals the advantages of W-NetPan with respect to several of the most important state-of-the-art pan-sharpening methods available in the literature. The codes related to this paper will be available at https://github.com/rufernan/WNetPan. (c) 2023 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
Keywords:
Pan-sharpening
Convolutional neural networks
Inter-sensor
Multi-modal
Remote sensing
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

U
Universitat Jaume I
Scholars:
4.7K
Papers: 4.8K
Citations: 6.1K
U
University of Murcia
Scholars:
9.2K
Papers: 8.1K
Citations: 8
S
soochow university - china
Scholars:
5.2W
Papers: 3.6W
Citations: 82
researcher View more organizations