A Collaborative Network for Multiple Hyperspectral Images Joint Classification

doi:10.1109/TGRS.2024.3511618

A Collaborative Network for Multiple Hyperspectral Images Joint Classification

2025-01-01

0

PRE

AI

DOI：10.1109/TGRS.2024.3511618

Original

Original request for help

Save

Abstract

En 中文

In recent years, deep learning (DL) has achieved remarkable success in classifying hyperspectral images (HSIs), relying heavily on the quantity and quality of labeled samples. However, obtaining sufficient labels for HSIs poses a challenge. HSIs obtained by the same sensor often exhibit similar spectral information due to their shared physical, chemical properties, or reflective attributes. Joint analysis of several HSIs enables the integration of limited labeled samples and extraction of more robust and discriminative features from different HSIs. Therefore, a multitask collaborative network (MTCN) for the joint classification of multiple HSIs acquired by the same sensor in different areas is proposed. In the MTCN, each HSI has its own feature extraction channel, which facilitates the learning of image-specific representations. In addition, a feature sharing channel (FSC) is created to extract and transfer multihierarchical image-shared representations between multiple HSIs, thereby forming a common knowledge pool to facilitate feature sharing. Furthermore, a cross-channel mutual attention module (CMAM) is designed to collaboratively utilize features from image-specific and image-shared channels, enhancing the efficiency of information communication in HSIs. The experimental results on six HSIs demonstrate that the proposed MTCN can jointly classify multiple HSIs by the same sensor in different areas and achieve good classification performance.

Keywords:

Feature extraction

Hyperspectral imaging

Multitasking

Data mining

Training

Power capacitors

Geoscience and remote sensing

Federated learning

Convolution

Collaboration

Attention mechanism

hyperspectral image (HSI) classification

joint analysis

multitask learning (MTL)

multiple HSIs

A Collaborative Network for Multiple Hyperspectral Images Joint Classification

Abstract

Journal

Organization