arrow
Return

Cost-sensitive learning with modified Stein loss function

delete2023-03-01
delete19
PRE
AI
S
Saiji Fu
田
田英杰 (Yingjie Tian) *
J
Jingjing Tang
X
Xiaohui Liu
DOI:10.1016/j.neucom.2023.01.052delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Cost-sensitive learning (CSL), which has gained widespread attention in class imbalance learning (CIL), can be implemented either by tuning penalty parameters or by designing new loss functions. In this paper, we propose a cost-sensitive learning method with a modified Stein loss function (CSMS) and a robust CSMS (RCSMS). Specifically, CSMS is flexible, as it realizes CSL from above two aspects simultane-ously. In contrast, RCSMS merely achieves CSL by tuning penalty parameters, but the adopted loss func-tion makes it insensitive to noise. To our best knowledge, it is the first time for Stein loss function derived from statistics to be applied in machine learning, which not only offers two alternative class imbalance solutions but also provides a novel idea for the design of loss functions in CIL. The mini-batch stochastic sub-gradient descent (MBGD) approach is employed to optimize CSMS and RCSMS. Meanwhile, the Rademacher complexity is used to analyze their generalization error bounds. Extensive experiments pro-foundly confirm the superiority of both models over benchmarks.(c) 2023 Elsevier B.V. All rights reserved.
Keywords:
Class imbalance learning
Cost-sensitive learning
Stein loss function
Penalty parameter
Support vector machine

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

B
beijing university of posts & telecommunications
Scholars:
1.4W
Papers: 1.2W
Citations: 9
B
brunel university
Scholars:
5.8K
Papers: 7.1K
Citations: 9
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
researcher View more organizations
Cited Papers

Cited Papers

Incremental Cost-Sensitive Support Vector Machine With Linear-Exponential Loss
err2020-01-01
err18
errOAAI
errMa, Yue; Zhao, Kun; Wang, Qi; Tian, Yingjie
errShare
errSave
A novel intelligent classification model for breast cancer diagnosis
err2019-05-01
err83
PREAI
errLiu, Na; Qi, Er-Shi; Xu, Man; Gao, Bo; Liu, Gui-Qiu
errShare
errSave
errShare
errSave
An efficient weighted Lagrangian twin support vector machine for imbalanced data classification
err2014-09-01
err47
PREAI
errShao, Yuan-Hai; Chen, Wei-Jie; Zhang, Jing-Jing; Wang, Zhen; Deng, Nai-Yang
errShare
errSave
Arsenic removal from aqueous solutions by adsorption using novel MIL-53(Fe) as a highly efficient adsorbent
err2015-01-01
err0
PREAI
errTuan. A. Vu; Giang. H. Le; Canh. D. Dao; Lan. Q. Dang; Kien. T. Nguyen; Quang. K. Nguyen; Phuong. T. Dang; Hoa. T. K. Tran; Quang. T. Duong; Tuyen. V. Nguyen; Gun. D. Lee
errShare
errSave
Affinity and class probability-based fuzzy support vector machine for imbalanced data sets
err2020-02-01
err50
PREAI
errTao, Xinmin; Li, Qing; Ren, Chao; Guo, Wenjie; He, Qing; Liu, Rui; Zou, Junrong
errShare
errSave
Tumor Lysis Syndrome after Hepatic Artery Embolization in a Patient with Neuroendocrine Tumor of Unknown Primary
err2019-06-25
err0
errOAAI
errOdeth Barrett-Campbell; Joselle Cook; Jordonna Brown; Evelyn Taiwo; Samy I. McFarlane
errShare
errSave
researcher View more