DECOR: Dynamic Decoupling and Multiobjective Optimization for Long-Tailed Remote Sensing Image Classification

doi:10.1109/TGRS.2024.3369178

2024-01-01

PRE

仉尚航 (Shanghang Zhang)

DOI：10.1109/TGRS.2024.3369178

原文链接

原文求助

摘要

En 中文

In the realm of remote sensing, targets of interest span a range of categories. However, their distribution is not always uniform. Certain categories substantially outnumber others, resulting in what's termed a long-tailed distribution in remote sensing imagery. This imbalanced distribution often biases a classifier's focus toward the more abundant (head) classes, at the detriment of the less-represented (tail) classes. Such biases undermine the classifier's generalization performance, particularly in the context of remote sensing image classification (RSIC). While existing mitigation approaches such as resampling, reweighting, and transfer learning offer some respite, they often miss out on in-depth knowledge refinement, rendering them less effective for severe long-tailed RSIC scenarios. To counter these challenges, we introduce DECOR, a dynamic decoupling (DD) and multiobjective optimization framework (MOOF). Within DECOR, the feature extractor and classifier are dynamically decoupled, promoting superior feature representation and classifier training. Then, a multiobjective optimization approach is proposed to delve deeper, refining feature representation at the knowledge level using learnable feature centroids (LFCs) coupled with masked world knowledge learning (WKL). Moreover, to combat the pronounced effects of sample imbalance on classifier training, we employ a class-balanced resampling technique paired with a parameter-efficient adapter, which sharpens the classifier's decision boundary and bridges the gap between representation and classification. DECOR's efficacy is validated through comprehensive experiments on several datasets, including the NWPU-RESISC45-LT (NWPU-LT), AID-LT, and our self-built BIT-AFGR50-LT. Experimental results demonstrate DECOR's marked enhancement in performance on long-tailed datasets.

Keyword:

Decouple learning

long tail

remote sensing scene classification