arrow
Return

Class-Difficulty Based Methods for Long-Tailed Visual Recognition

delete2022-08-18
delete14
delete
OA
AI
S
Saptarshi Sinha *
H
Hiroki Ohashi
K
Katsuyuki Nakamura
DOI:10.1007/s11263-022-01643-3delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Long-tailed datasets are very frequently encountered in real-world use cases where few classes or categories (known as majority or head classes) have higher number of data samples compared to the other classes (known as minority or tail classes). Training deep neural networks on such datasets gives results biased towards the head classes. So far, researchers have come up with multiple weighted loss and data re-sampling techniques in efforts to reduce the bias. However, most of such techniques assume that the tail classes are always the most difficult classes to learn and therefore need more weightage or attention. Here, we argue that the assumption might not always hold true. Therefore, we propose a novel approach to dynamically measure the instantaneous difficulty of each class during the training phase of the model. Further, we use the difficulty measures of each class to design a novel weighted loss technique called 'class-wise difficulty based weighted (CDB-W) loss' and a novel data sampling technique called 'class-wise difficulty based sampling (CDB-S)'. To verify the wide-scale usability of our CDB methods, we conducted extensive experiments on multiple tasks such as image classification, object detection, instance segmentation and video-action classification. Results verified that CDB-W loss and CDB-S could achieve state-of-the-art results on many class-imbalanced datasets such as ImageNet-LT, LVIS and EGTEA, that resemble real-world use cases.
Keywords:
Class-imbalance
Weighted-loss
Data re-sampling
Class-wise difficulty
Image classification
Object detection
Instance segmentation
Video-action classification

Journal

International Journal of Computer Vision cover
International Journal of Computer Vision
IF:
9.3
Papers:
3.9K
Citations:
2.8W

Organization

H
hitachi limited
Scholars:
2.2K
Papers: 1.5K
Citations: 0
Cited Papers

Cited Papers

err
IF0
err
err0
PREAI
err
errShare
errSave
Combustor Miniaturization with Liquid-Fuel Filming
err2003-11-11
err0
PREAI
errSimone Stanchi; Derek Dunn-Rankin; William Sirignano
errShare
errSave
errShare
errSave
Driving Current through Single Organic Molecules
err2002-04-10
err0
errOAAI
errJ. Reichert; R. Ochs; D. Beckmann; H. B. Weber; M. Mayor; H. v. Löhneysen
errShare
errSave
Arsenic removal from aqueous solutions by adsorption using novel MIL-53(Fe) as a highly efficient adsorbent
err2015-01-01
err0
PREAI
errTuan. A. Vu; Giang. H. Le; Canh. D. Dao; Lan. Q. Dang; Kien. T. Nguyen; Quang. K. Nguyen; Phuong. T. Dang; Hoa. T. K. Tran; Quang. T. Duong; Tuyen. V. Nguyen; Gun. D. Lee
errShare
errSave
errShare
errSave
researcher View more