Deep convolutional transformer network for hyperspectral unmixing

Fazal Hadi

doi:10.1080/22797254.2023.2268820

Deep convolutional transformer network for hyperspectral unmixing

2023-10-30

4

OA

AI

DOI：10.1080/22797254.2023.2268820

Original

Original request for help

Save

Abstract

En 中文

Hyperspectral unmixing (HU) is considered one of the most important ways to improve hyperspectral image analysis. HU aims to break down the mixed pixel into a set of spectral signatures, often commonly referred to as endmembers, and determine the fractional abundance of those endmembers. Deep learning (DL) approaches have recently received great attention regarding HU. In particular, convolutional neural networks (CNNs)-based methods have performed exceptionally well in such tasks. However, the ability of CNNs to learn deep semantic features is limited, and computing cost increase dramatically with the number of layers. The appearance of the transformer addresses these issues by effectively representing high-level semantic features well. In this article, we present a novel approach for HU that utilizes a deep convolutional transformer network. Firstly, the CNN-based autoencoder (AE) is used to extract low-level features from the input image. Secondly, the concept of tokenizer is applied for feature transformation. Thirdly, the transformer module is used to capture the deep semantic features derived from the tokenizer. Finally, a convolutional decoder is utilized to reconstruct the input image. The experimental results on synthetic and real datasets demonstrate the effectiveness and superiority of the proposed method compared with other unmixing methods.

Keywords:

Hyperspectral unmixing

deep learning (DL)

transformer

autoencoder (AE)

tokenizer

remote sensing

Deep convolutional transformer network for hyperspectral unmixing

Abstract

Journal

Organization