arrow
Return

Improving remote sensing scene classification using quality-based data augmentation

delete2023-03-29
delete7
PRE
AI
R
Rowida Mohammed Alharbi
H
Haikel Alhichri
R
Ridha Ouni
Y
Yakoub Bazi *
M
Maazen Alsabaan
DOI:10.1080/01431161.2023.2184213delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This study presents an improved data augmentation technique for the classification of remote sensing (RS) scenes. The method is called Quality-based Sample Selection (QSS) data augmentation technique. It is based on generating a large number of samples using geometric transformations and then selecting the best ones based on a quality criterion. Sample images are generated online, i.e. during training of the convolutional neural network (CNN) model. For each training sample image, a few images are generated randomly using a set of geometric transformations. Then, the generated images are passed to the CNN model being trained, and the predicted probabilities are used to evaluate the quality of the images. The motivation behind this research is that we aim to augment the training set with new images that will benefit the learning of the CNN model. Therefore, an objective method to evaluate the quality of the new images is the CNN model itself. The image with the best criteria score is used to augment the training set. Several quality criteria based on the prediction probabilities of the CNN model are considered including entropy, breaking-ties and our own proposed criteria called True Label Probability (TLP). QSS is tested on five common RS scene classification datasets: UCMerced, Optimal31, RSSCN7, AID and NWPU-RS45. It has outperformed all previous methods except for one case involving NWPU-RS45 dataset. For the 10%-90% train-test split, QSS achieved 94.51, 81.72, 89.89, 94.09 and 93.98, respectively, for the mentioned datasets. While for the 20%-80% train-test split, it achieved 97.09, 88.37, 94.01, 95.71 and 94.71, respectively, for the listed datasets. Thus, this work presents a novel data augmentation method that uses data with higher quality instead of randomly selected. The paper proves experimentally that the proposed method improves the classification accuracy of RS scene classification.
Keywords:
Remote sensing
image classification
scene classification
CNN
Data augmentation
Entropy
True Label Probability

Journal

International Journal of Remote Sensing cover
International Journal of Remote Sensing
IF:
2.6
Papers:
1.2W
Citations:
2.7W

Organization

K
King Saud University
Scholars:
3.4W
Papers: 3.8W
Citations: 815