arrow
Return

Fast generalized ramp loss support vector machine for pattern classification

delete2024-02-01
delete11
PRE
AI
王华军 cover
王华军 (Huajun Wang) *
邵
邵元海 (Yuan‐Hai Shao)
DOI:10.1016/j.patcog.2023.109987delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Support vector machine (SVM) is widely recognized as an effective classification tool and has demonstrated superior performance in diverse applications. However, for large-scale pattern classification problems, it may require much memory and incur prohibitive computational costs. Motivated by this, we propose a new SVM model with novel generalized ramp loss (LR-SVM). The first-order optimality conditions for the non-convex and non-smooth LR-SVM are developed by the newly developed P-stationary point, based on which, the LR support vectors and working set of LR-SVM are defined, interestingly, which shows that all of the LR support vectors are on the two support hyperplanes under mild conditions. A fast proximal alternating direction method of multipliers with working set (LR-ADMM) is developed to handle LR-SVM and LR-ADMM has been demonstrated to achieve global convergence while maintaining a significantly low computational complexity. Numerical comparisons with nine leading solvers show that LR-ADMM demonstrates outstanding performance, particularly when applied to large-scale pattern classification problems with fewer support vectors, higher prediction accuracy and shorter computational time.
Keywords:
Generalized ramp loss
LR-SVM
LR proximal operator
Working set
LR support vectors
LR-ADMM

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

No organization information available
Cited Papers

Cited Papers

Local-to-Global Support Vector Machines (LGSVMs)
err2022-12-01
err9
PREAI
errMarchetti, F.; Perracchione, E.
errShare
errSave
Learning Customised Decision Trees for Domain-knowledge Constraints
err2023-10-01
err7
errOAAI
errNanfack, Geraldin; Temple, Paul; Frenay, Benoit
errShare
errSave
Robust distance metric optimization driven GEPSVM classifier for pattern classification
err2022-09-01
err5
PREAI
errYan, He; Fu, Liyong; Zhang, Tian'an; Hu, Jun; Ye, Qiaolin; Qi, Yong; Yu, Dong-Jun
errShare
errSave
Determinants of reperfusion cardiac electrical activity after cold cardioplegic arrest during coronary bypass surgery
err1984-09-01
err0
PREAI
errCarol L. Lake; T.Duncan Sellers; Stanton P. Nolan; Ivan K. Crosby; Harry A. Wellons; Richard S. Crampton
errShare
errSave
Robust twin support vector regression based on rescaled Hinge loss
err2020-09-01
err32
PREAI
errSingla, Manisha; Ghosh, Debdas; Shukla, K. K.; Pedrycz, Witold
errShare
errSave
A recent glance on the valorisation of cheese whey for industrial prerogative: high‐value‐added products development and integrated reutilising strategies
err2022-11-10
err0
PREAI
errUmm‐e‐Tazeem Arshad; Ali Hassan; Talha Ahmad; Maha Naeem; Maryam T. Chaudhary; Syed Qamar Abbas; Muhammad Atif Randhawa; Tatiana C. Pimentel; Adriano Gomes da Cruz; Rana Muhammad Aadil
errShare
errSave
Least squares twin bounded support vector machines based on L1-norm distance metric for classification
err2018-02-01
err91
errOAAI
errYan, He; Ye, Qiaolin; Zhang, Tian'an; Yu, Dong-Jun; Yuan, Xia; Xu, Yiqing; Fu, Liyong
errShare
errSave
researcher View more