arrow
Return

Fast Support Vector Machine With Low-Computational Complexity for Large-Scale Classification

delete2024-07-01
delete1
PRE
AI
王华军 cover
王华军 (Huajun Wang) *
Z
Zhibin Zhu
邵元海 (Yuan‐Hai Shao)
DOI:10.1109/TSMC.2024.3375021delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Support vector machine (SVM) is a popular supervised machine learning classifier and has found extensive applied in many fields, including biological sciences, disease detection, health and clinical sciences, cancer classification, and more. However, the major challenge faced by SVM is its high-computational complexity, which becomes a bottleneck for large-scale SVM. To reduce computational complexity, we design a novel truncated squared loss function to get the novel SVM $(L-tsl-SVM), and is a challenging model due to its nonconvex and nonsmooth characteristics. To solve L-tsl -SVM, we present new concept of proximal stationary point to establish its optimality theory. Using this theory, we then develop a novel and fast alternating direction method of multipliers in terms of low-computational complexity to address L-tsl -SVM and our new proposed algorithm achieve global convergence. Finally, numerical experiments have verified the superior performance of our developed method in terms of classification accuracy, number of support vectors and computational speed when compared to other eight leading solvers. For instance, when solving the real dataset with more than 10(7) samples, our developed method only takes 18.89 s, significantly outperforming other solvers that require at least 589.8 s.
Keywords:
Support vector machines
Fasteners
Training
Vectors
Robustness
Convergence
Computational modeling
Global convergence
low-computational complexity
millions of dimensions
optimality theory
truncated squared loss

Journal

IEEE Transactions on Cybernetics cover
IEEE Transactions on Cybernetics
IF:
10.5
Papers:
1.1W
Citations:
5.0W

Organization

H
Hainan University
Scholars:
2.0W
Papers: 1.2W
Citations: 1.9W
G
Guilin University of Electronic Technology
Scholars:
7.4K
Papers: 5.2K
Citations: 5.4K