返回
Jointly sparse least square support vector machine
DOI:10.1016/j.compeleceng.2022.108078.png)
摘要
En 中文
Least square support vector machine (LS-SVM) is extended from support vector machine (SVM) for binary classification problems. However, it may suffer from the small sample size (SSS) problem when the sample size is much smaller than the number of features. Motivated by the dimensionality reduction and feature selection methods, we introduce L-2,L-1-norm into LS-SVM to design a novel classification algorithm called jointly sparse LS-SVM (JS-LSSVM). JS-LSSVM minimizes the L-2,L-1-norm regularization on the projection matrix with orthogonal constraint, which is used to project the samples into an optimal low-dimensional subspace, where the derived LS-SVM can obtain the best performance. This projection matrix releases the least square problem in primal space and allows us to select features with joint sparsity. Besides, we propose an iterative algorithm to solve the optimization problem, which guarantees the convergence of JS-LSSVM. The experiments also show the superior performance of JS-LSSVM on many datasets. The proposed method has at least 1% improvement to the conventional methods.
Keyword:
Least square support vector machine
Feature extraction
Dimensionality reduction
Subspace learning
L-2,L-1-norm sparsity
期刊
C
IF:
4.9
论文数:
6.7K
被引数:
1.3W
机构
引用论文
Sparsity preserving projections with applications to face recognition稀疏保持投影及其在人脸识别中的应用
PATTERN RECOGNITION
IF7.6

