arrow
Return

Gaussian Distribution Based Oversampling for Imbalanced Data Classification

delete2022-02-01
delete0
PRE
AI
Y
Yuxi Xie
M
Min Qiu
H
Haibo Zhang
L
Lizhi Peng *
陈
陈贞翔 (Zhenxiang Chen)
DOI:10.1109/TKDE.2020.2985965delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The imbalanced data classification problem widely exists in many real-world applications. Data resampling is a promising technique to deal with imbalanced data through either oversampling or undersampling. However, the traditional data resampling approaches simply take into account the local neighbor information to generate new instances in linear ways, leading to the generation of incorrect and unnecessary instances. In this study, we propose a new data resampling technique, namely, Gaussian Distribution based Oversampling (GDO), to handle the imbalanced data for classification. In GDO, anchor instances are selected from the minority class instances in a probabilistic way by taking into account the density and distance information carried by the minority instances. Then new minority instances are generated following a Gaussian distribution model. The proposed method is validated in experimental study by comparing with seven imbalanced learning approaches on 40 data sets from the KEEL repository and 10 large data sets from the UCI repository. Experimental results show that our method outperforms the other compared methods in terms of AUC, G-mean and memory usage with an increase in running time. We also apply GDO to deal with two real imbalanced data classification problems: Internet video traffic identification and metastasis detection of esophageal cancer. The experimental results once again validate the effectiveness of our approach.
Keywords:
Gaussian distribution
Data models
Adaptation models
Probabilistic logic
Internet
Cancer
Machine learning
Imbalanced learning
oversampling
probabilistic anchor selection
gaussian resampling

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.8K
Citations:
3.2W

Organization

U
University of Jinan
Scholars:
1.6W
Papers: 1.1W
Citations: 1.4W
U
university of otago
Scholars:
1.8W
Papers: 1.6W
Citations: 15
Cited Papers

Cited Papers

Minority Oversampling in Kernel Adaptive Subspaces for Class Imbalanced Datasets
err2018-05-01
err48
errOAAI
errLin, Chin-Teng; Hsieh, Tsung-Yu; Liu, Yu-Ting; Lin, Yang-Yin; Fang, Chieh-Ning; Wang, Yu-Kai; Yen, Gary; Pal, Nikhil R.; Chuang, Chun-Hsiang
errShare
errSave
CNC-Pincer Rare-Earth Metal Amido Complexes with a Diarylamido Linked Biscarbene Ligand: Synthesis, Characterization, and Catalytic Activity
err2014-04-29
err0
PREAI
errXiaoxia Gu; Xiancui Zhu; Yun Wei; Shaowu Wang; Shuangliu Zhou; Guangchao Zhang; Xiaolong Mu
errShare
errSave
Combustor Miniaturization with Liquid-Fuel Filming
err2003-11-11
err0
PREAI
errSimone Stanchi; Derek Dunn-Rankin; William Sirignano
errShare
errSave
Seed oils fromCitrus sinensis
err1963-12-01
err0
PREAI
errR. Hendrickson; J. W. Kesterson
errShare
errSave
Scanning mass spectrometer for quantitative reaction studies on catalytically active microstructures
err2007-08-29
err0
PREAI
errM. Roos; S. Kielbassa; C. Schirling; T. Häring; J. Bansmann; R. J. Behm
errShare
errSave
Neuronal-binding antibodies from patients with antiphospholipid syndrome induce cognitive deficits following intrathecal passive transfer
err2003-06-01
err0
PREAI
errY Shoenfeld; A Nahum; A D Korczyn; M Dano; R Rabinowitz; O Beilin; C G Pick; L Leider-Trejo; L Kalashnikova; M Blank; J Chapman
errShare
errSave
researcher View more