Margin-aware rectified augmentation for long-tailed recognition

doi:10.1016/j.patcog.2023.109608

Margin-aware rectified augmentation for long-tailed recognition

2023-09-01

8

PRE

AI

丁贵广 (Guiguang Ding) *

DOI：10.1016/j.patcog.2023.109608

Original

Original request for help

Save

Abstract

En 中文

The long-tailed data distribution is prevalent in real world and it poses great challenge on deep neural network training. In this paper, we propose Margin-aware Rectified Augmentation (MRA) to tackle this problem. Specifically, the MRA consists of two parts. From the data perspective, we analyze that data imbalance will cause the decision boundary be biased, and we propose a novel Margin-aware Rectified mixup (MR-mixup) that adaptively rectifies the biased decision boundary. Furthermore, from the model perspective, we analyze that the imbalance will also lead to consistent 'gradient suppression' on minority class logits. Then we propose Reweighted Mutual Learning (RML) that provides extra 'soft target' as su-pervision signal and augments the 'encouraging gradients' on the minority classes. We conduct extensive experiments on benchmark datasets CIFAR-LT, ImageNet-LT and iNaturalist18. The results demonstrate that the proposed MRA not only achieves state-of-the-art performance, but also yields a better-calibrated prediction.& COPY; 2023 Published by Elsevier Ltd.

Keywords:

Long-tailed recognition

Data augmentation

Mixup

Margin-aware rectified augmentation for long-tailed recognition

Abstract

Journal

Organization