arrow
返回

Novel regularization method for the class imbalance problem

delete2022-02-01
delete11
PRE
AI
B
Bosung Kim
Y
Youngjoong Ko *
J
Jungyun Seo
DOI:10.1016/j.eswa.2021.115974delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In neural network models, obtaining a high-quality dataset is critical because they are generally reliant on training data. A common problem that occurs is class imbalance, in which models tend to be biased to the majority class when the training data is not balanced. To overcome this problem, we propose a novel regularization method that provides a penalty to the loss function, using two facets of the distribution of the model's output p((y) over cap vertical bar x): (1) skewed mean and (2) variance divergence between p((y) over cap vertical bar x is an element of D+) and p((y) over cap vertical bar x is an element of D_). The experimental results demonstrate that our methods consistently improve the performance on imbalanced datasets. Moreover, the combination of two regularization methods provides a substantial performance improvement on five sentence classification datasets and also an image classification dataset; notably, state-of-the-art performances are achieved on the WikiQA and SelQA datasets.
Keyword:
Regularization
Class imbalance
Sentence classification
Image classification

期刊

Expert Systems with Applications 封面图
Expert Systems with Applications
IF:
7.5
论文数:
3.0W
被引数:
10.2W

机构

S
sungkyunkwan university (skku)
学者数:
3.7W
论文数: 3.6W
被引数: 49
S
Sogang University
学者数:
4.6K
论文数: 4.4K
被引数: 4.0K
引用论文

引用论文

err分享
err收藏
Endothelium-dependent relaxation of human resistance arteries in pregnancy
err1994-11-01
err0
PREAI
errAndrew L. McCarthy; Paul Taylor; John Graves; Shanti K. Raju; Lucilla Poston
err分享
err收藏
Circulating microRNAs as stable blood-based markers for cancer detection循环microrna作为稳定的血液标志物用于癌症检测
err2008-07-29
err7.4K
errOAAI
errMitchell, Patrick S.; Parkin, Rachael K.; Kroh, Evan M.; Fritz, Brian R.; Wyman, Stacia K.; Pogosova-Agadjanyan, Era L.; Peterson, Amelia; Noteboom, Jennifer; O'Briant, Kathy C.; Allen, April; Lin, Daniel W.; Urban, Nicole; Drescher, Charles W.; Knudsen, Beatrice S.; Stirewalt, Derek L.; Gentleman, Robert; Vessella, Robert L.; Nelson, Peter S.; Martin, Daniel B.; Tewari, Muneesh
err分享
err收藏
没有更多内容