arrow
Return

Novel regularization method for the class imbalance problem

delete2022-02-01
delete11
PRE
AI
B
Bosung Kim
Y
Youngjoong Ko *
J
Jungyun Seo
DOI:10.1016/j.eswa.2021.115974delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In neural network models, obtaining a high-quality dataset is critical because they are generally reliant on training data. A common problem that occurs is class imbalance, in which models tend to be biased to the majority class when the training data is not balanced. To overcome this problem, we propose a novel regularization method that provides a penalty to the loss function, using two facets of the distribution of the model's output p((y) over cap vertical bar x): (1) skewed mean and (2) variance divergence between p((y) over cap vertical bar x is an element of D+) and p((y) over cap vertical bar x is an element of D_). The experimental results demonstrate that our methods consistently improve the performance on imbalanced datasets. Moreover, the combination of two regularization methods provides a substantial performance improvement on five sentence classification datasets and also an image classification dataset; notably, state-of-the-art performances are achieved on the WikiQA and SelQA datasets.
Keywords:
Regularization
Class imbalance
Sentence classification
Image classification

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
3.0W
Citations:
10.2W

Organization

S
sungkyunkwan university (skku)
Scholars:
3.7W
Papers: 3.6W
Citations: 49
S
Sogang University
Scholars:
4.6K
Papers: 4.4K
Citations: 4.0K
Cited Papers

Cited Papers

Endothelium-dependent relaxation of human resistance arteries in pregnancy
err1994-11-01
err0
PREAI
errAndrew L. McCarthy; Paul Taylor; John Graves; Shanti K. Raju; Lucilla Poston
errShare
errSave
CNC-Pincer Rare-Earth Metal Amido Complexes with a Diarylamido Linked Biscarbene Ligand: Synthesis, Characterization, and Catalytic Activity
err2014-04-29
err0
PREAI
errXiaoxia Gu; Xiancui Zhu; Yun Wei; Shaowu Wang; Shuangliu Zhou; Guangchao Zhang; Xiaolong Mu
errShare
errSave
Circulating microRNAs as stable blood-based markers for cancer detection
err2008-07-29
err7.4K
errOAAI
errMitchell, Patrick S.; Parkin, Rachael K.; Kroh, Evan M.; Fritz, Brian R.; Wyman, Stacia K.; Pogosova-Agadjanyan, Era L.; Peterson, Amelia; Noteboom, Jennifer; O'Briant, Kathy C.; Allen, April; Lin, Daniel W.; Urban, Nicole; Drescher, Charles W.; Knudsen, Beatrice S.; Stirewalt, Derek L.; Gentleman, Robert; Vessella, Robert L.; Nelson, Peter S.; Martin, Daniel B.; Tewari, Muneesh
errShare
errSave
no more