arrow
Return

Sparse and robust SVM classifier for large scale classification

delete2023-03-13
delete21
PRE
AI
王华军 cover
王华军 (Huajun Wang) *
邵
邵元海 (Yuan‐Hai Shao)
DOI:10.1007/s10489-023-04511-wdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Support vector machine (SVM) has drawn wide attention in various fields, such as image classification, pattern recognition and disease diagnosis and so on. Nevertheless, it requires much memory and runs very slow in large-scale datasets setting. To reduce computational cost and the required storage, we first design a new sparse and robust SVM model according to our construct truncated smoothly clipped absolute deviation (SCAD) loss and then establish its first-order necessary and sufficient optimality conditions though newly defined proximal stationary point. Following the idea of the proximal stationary point, we define the L-ts support vectors of L-ts-SVM and then show that the L-ts support vectors are a small portion of the whole training set, which is convenient for us to introduce a novel working set in each step. We next present a new alternating direction method of multipliers with working set (L-ts-ADMM) to deal with L-ts-SVM, which proves that the proposed algorithm not only converges to a local minimizer of L-ts-SVM but also possesses a relatively low computational complexity. Finally, the extensive numerical experiments demonstrate that the proposed algorithm enjoys better performance than nine leading state-of-the-art methods with regard to best classification accuracy, smallest number of support vectors and super fast computational speed in large-scale datasets setting.
Keywords:
Truncated SCAD loss
Proximal operator
Support vectors
Working set
Low computational complexity

Journal

Applied Intelligence cover
Applied Intelligence
IF:
3.5
Papers:
7.6K
Citations:
1.7W

Organization

H
Hainan University
Scholars:
2.0W
Papers: 1.2W
Citations: 1.9W
Cited Papers

Cited Papers

Determinants of reperfusion cardiac electrical activity after cold cardioplegic arrest during coronary bypass surgery
err1984-09-01
err0
PREAI
errCarol L. Lake; T.Duncan Sellers; Stanton P. Nolan; Ivan K. Crosby; Harry A. Wellons; Richard S. Crampton
errShare
errSave
A novel self-weighted Lasso and its safe screening rule
err2022-03-08
err2
PREAI
errXiao, Xinshuang; Xu, Yitian; Zhang, Ying; Zhong, Peiwei
errShare
errSave
A recent glance on the valorisation of cheese whey for industrial prerogative: high‐value‐added products development and integrated reutilising strategies
err2022-11-10
err0
PREAI
errUmm‐e‐Tazeem Arshad; Ali Hassan; Talha Ahmad; Maha Naeem; Maryam T. Chaudhary; Syed Qamar Abbas; Muhammad Atif Randhawa; Tatiana C. Pimentel; Adriano Gomes da Cruz; Rana Muhammad Aadil
errShare
errSave
Denoising Aggregation of Graph Neural Networks by Using Principal Component Analysis
err2023-03-01
err58
PREAI
errDong, Wei; Wozniak, Marcin; Wu, Junsheng; Li, Weigang; Bai, Zongwen
errShare
errSave
Crop yield predictions based on properties of soils in Sevilla, Spain
err1981-05-01
err0
PREAI
errD. De La Rosa; F. Cardona; J. Almorza
errShare
errSave
Improving performance and efficiency of Graph Neural Networks by injective aggregation
err2022-10-01
err31
PREAI
errDong, Wei; Wu, Junsheng; Zhang, Xinwan; Bai, Zongwen; Wang, Peng; Wozniak, Marcin
errShare
errSave
researcher View more