arrow
Return

Rotation-Invariant Deep Embedding for Remote Sensing Images

delete2022-01-01
delete12
delete
OA
AI
康健 (Jian Kang)
R
Rubén Fernández-Beltrán
Z
Zhirui Wang
X
Xian Sun
倪锦根 (Jingen Ni) *
A
Antonio Plaza
DOI:10.1109/TGRS.2021.3088398delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Endowing convolutional neural networks (CNNs) with the rotation-invariant capability is important for characterizing the semantic contents of remote sensing (RS) images since they do not have typical orientations. Most of the existing deep methods for learning rotation-invariant CNN models are based on the design of proper convolutional or pooling layers, which aims at predicting the correct category labels of the rotated RS images equivalently. However, a few works have focused on learning rotation-invariant embeddings in the framework of deep metric learning for modeling the fine-grained semantic relationships among RS images in the embedding space. To fill this gap, we first propose a rule that the deep embeddings of rotated images should be closer to each other than those of any other images (including the images belonging to the same class). Then, we propose to maximize the joint probability of the leave-one-out image classification and rotational image identification. With the assumption of independence, such optimization leads to the minimization of a novel loss function composed of two terms: 1) a class-discrimination term and 2) a rotation-invariant term. Furthermore, we introduce a penalty parameter that balances these two terms and further propose a final loss to Rotation-invariant Deep embedding for RS images, termed RiDe. Extensive experiments conducted on two benchmark RS datasets validate the effectiveness of the proposed approach and demonstrate its superior performance when compared to other state-of-the-art methods. The codes of this article will be publicly available at https://github.com/jiankang1991/TGRS_RiDe.
Keywords:
Measurement
Semantics
Feature extraction
Image retrieval
Training
Task analysis
Nickel
Convolutional neural networks (CNNs)
deep learning
deep metric learning
image retrieval
rotation invariant
remote sensing (RS)
scene classification

Journal

IEEE Transactions on Geoscience and Remote Sensing cover
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
Papers:
2.1W
Citations:
10.7W

Organization

U
Universitat Jaume I
Scholars:
4.7K
Papers: 4.8K
Citations: 6.1K
S
soochow university - china
Scholars:
5.2W
Papers: 3.6W
Citations: 82
C
chinese academy of sciences
Scholars:
56.1W
Papers: 44.8W
Citations: 704
researcher View more organizations