arrow
Return

A robust loss function for classification with imbalanced datasets

delete2019-02-01
delete10
PRE
AI
Y
Yidan Wang
L
Liming Yang *
DOI:10.1016/j.neucom.2018.11.024delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Based on minimizing misclassification cost, a new robust loss function is designed in this paper to deal with the imbalanced classification problem under noise environment. It is nonconvex but maintains Fisher consistency. Applying the proposed loss function into support vector machine (SVM), a robust SVM framework is presented which results in a Bayes optimal classifier. However, nonconvexity makes the model difficult to optimize. We develop an alternative iterative algorithm to solve the proposed model. What's more, we analyze the robustness of the proposed model theoretically from a re-weighted SVM viewpoint and the obtained optimal solution is consistent with Bayesian optimal decision rule. Further-more, numerical experiments are carried out on databases that are drawn from UCI Machine Learning Repository and a practical application. With two different types of noise environments, one with label noise and one with feature noise, experiment results show that on these two databases the proposed method achieves better generalization results compared to other SVM methods. (C) 2018 Elsevier B.V. All rights reserved.
Keywords:
Robustness
Imbalanced classification
Bayes optimal classifier
Fisher consistency
Half quadratic optimization
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

C
china agricultural university
Scholars:
5.1W
Papers: 3.0W
Citations: 43
Cited Papers

Cited Papers

Adaptive activation functions in convolutional neural networks
err2018-01-01
err125
PREAI
errQian, Sheng; Liu, Hua; Liu, Cheng; Wu, Si; Wong, Hau San
errShare
errSave
errShare
errSave
Hypergraph regularized autoencoder for image-based 3D human pose recovery
err2016-07-01
err37
PREAI
errHong, Chaoqun; Chen, Xuhui; Wang, Xiaodong; Tang, Chaohui
errShare
errSave
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
researcher View more