arrow
Return

Jointly sparse least square support vector machine

delete2022-07-01
delete4
PRE
AI
X
Xi Chen *
赖
赖志慧 (Zhihui Lai)
DOI:10.1016/j.compeleceng.2022.108078delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Least square support vector machine (LS-SVM) is extended from support vector machine (SVM) for binary classification problems. However, it may suffer from the small sample size (SSS) problem when the sample size is much smaller than the number of features. Motivated by the dimensionality reduction and feature selection methods, we introduce L-2,L-1-norm into LS-SVM to design a novel classification algorithm called jointly sparse LS-SVM (JS-LSSVM). JS-LSSVM minimizes the L-2,L-1-norm regularization on the projection matrix with orthogonal constraint, which is used to project the samples into an optimal low-dimensional subspace, where the derived LS-SVM can obtain the best performance. This projection matrix releases the least square problem in primal space and allows us to select features with joint sparsity. Besides, we propose an iterative algorithm to solve the optimization problem, which guarantees the convergence of JS-LSSVM. The experiments also show the superior performance of JS-LSSVM on many datasets. The proposed method has at least 1% improvement to the conventional methods.
Keywords:
Least square support vector machine
Feature extraction
Dimensionality reduction
Subspace learning
L-2,L-1-norm sparsity

Journal

C
Computers and Electrical Engineering
IF:
4.9
Papers:
6.7K
Citations:
1.3W

Organization

S
shenzhen university
Scholars:
4.6W
Papers: 3.4W
Citations: 72
Cited Papers

Cited Papers

errShare
errSave
err1999-01-01
err0
PREAI
errJ.A.K. Suykens; J. Vandewalle
errShare
errSave
Motor Anomaly Detection for Unmanned Aerial Vehicles Using Reinforcement Learning
err2018-08-01
err418
PREAI
errLu, Huimin; Li, Yujie; Mu, Shenglin; Wang, Dong; Kim, Hyoungseop; Serikawa, Seiichi
errShare
errSave
Sparsity preserving projections with applications to face recognition
err2010-01-01
err810
PREAI
errQiao, Lishan; Chen, Songcan; Tan, Xiaoyang
errShare
errSave
Sparse Lq-norm least squares support vector machine with feature selection
err2018-06-01
err46
PREAI
errShao, Yuan-Hai; Li, Chun-Na; Liu, Ming-Zeng; Wang, Zhen; Deng, Nai-Yang
errShare
errSave
researcher View more