arrow
返回

The class imbalance problem in deep learning

delete2022-12-28
delete35
delete
OA
AI
K
Kushankur Ghosh
C
Colin Bellinger
R
Roberto Corizzo
P
Paula Branco *
B
Bartosz Krawczyk
N
Nathalie Japkowicz
DOI:10.1007/s10994-022-06268-8delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep learning has recently unleashed the ability for Machine learning (ML) to make unparalleled strides. It did so by confronting and successfully addressing, at least to a certain extent, the knowledge bottleneck that paralyzed ML and artificial intelligence for decades. The community is currently basking in deep learning's success, but a question that comes to mind is: have all of the issues previously affecting machine learning systems been solved by deep learning or do some issues remain for which deep learning is not a bulletproof solution? This question in the context of the class imbalance becomes a motivation for this paper. Imbalance problem was first recognized almost three decades ago and has remained a critical challenge at least for traditional learning approaches. Our goal is to investigate whether the tight dependency between class imbalances, concept complexities, dataset size and classifier performance, known to exist in traditional learning systems, is alleviated in any way in deep learning approaches and to what extent, if any, network depth and regularization can help. To answer these questions we conduct a survey of the recent literature focused on deep learning and the class imbalance problem as well as a series of controlled experiments on both artificial and real-world domains. This allows us to formulate lessons learned about the impact of class imbalance on deep learning models, as well as pose open challenges that should be tackled by researchers in this field.
Keyword:
Deep learning
Class imbalance
Concept complexity

期刊

Machine Learning 封面图
Machine Learning
IF:
2.9
论文数:
2.7K
被引数:
3.4W

机构

A
American University
学者数:
1.9K
论文数: 2.1K
被引数: 3.1K
U
university of alberta
学者数:
5.1W
论文数: 4.9W
被引数: 65
V
Virginia Commonwealth University
学者数:
2.2W
论文数: 1.8W
被引数: 1.9W
N
National Research Council Canada
学者数:
7.9K
论文数: 7.9K
被引数: 6.8K
U
University of Ottawa
学者数:
3.5W
论文数: 3.1W
被引数: 3.8W
学者 查看更多机构
引用论文

引用论文

Imputação múltipla livre de distribuição em tabelas incompletas de dupla entrada
err2014-09-01
err0
errOAAI
errSergio Arciniegas-Alarcón; Carlos Tadeu dos Santos Dias; Marisol García-Peña
err分享
err收藏
Transcranial ultrasound in neurodegeneration with brain iron accumulation (NBIA)
err2012-03-01
err0
PREAI
errJan Liman; Andreas Wellmer; Kevin Rostasy; Mathias Bähr; Pawel Kermer
err分享
err收藏
Regulation of the development of allodynia by intrathecally administered P2 purinoceptor agonists and antagonists in mice
err2000-09-01
err0
PREAI
errNobuyoshi Fukuhara; Yasuo Imai; Akira Sakakibara; Katsuya Morita; Shigeo Kitayama; Kazuo Tanne; Toshihiro Dohi
err分享
err收藏
Ultrastructure and immunohistochemistry of the lateral prostate in aged rats
err2006-07-20
err0
PREAI
errGerhard Aumüller; Ulrike Enderle‐Schmitt; Jürgen Seitz; Jonas Müntzing; John A. Chandler
err分享
err收藏
学者 查看更多内容