返回
Maximal Margin Support Vector Machine for Feature Representation and Classification
DOI:10.1109/TCYB.2022.3232800.png)
摘要
En 中文
High-dimensional small sample size data, which may lead to singularity in computation, are becoming increasingly common in the field of pattern recognition. Moreover, it is still an open problem how to extract the most suitable low-dimensional features for the support vector machine (SVM) and simultaneously avoid singularity so as to enhance the SVM's performance. To address these problems, this article designs a novel framework that integrates the discriminative feature extraction and sparse feature selection into the support vector framework to make full use of the classifiers' characteristics to find the optimal/maximal classification margin. As such, the extracted low-dimensional features from high-dimensional data are more suitable for SVM to obtain good performance. Thus, a novel algorithm, called the maximal margin SVM (MSVM), is proposed to achieve this goal. An alternatively iterative learning strategy is adopted in MSVM to learn the optimal discriminative sparse subspace and the corresponding support vectors. The mechanism and the essence of the designed MSVM are revealed. The computational complexity and convergence are also analyzed and validated. Experimental results on some well-known databases (including breastmnist, pneumoniamnist, colon-cancer, etc.) show the great potential of MSVM against classical discriminant analysis methods and SVM-related methods, and the codes can be available on http://www.scholat.com/laizhihui.
Keyword:
Support vector machines
Feature extraction
Optimization
Iterative methods
Dimensionality reduction
Principal component analysis
Linear programming
discriminative learning
feature extraction
least square support vector machine (LSSVM)
sparse learning
期刊
IF:
10.5
论文数:
1.1W
被引数:
5.0W
机构
引用论文
Synthesis and structure-activity studies of SH2 binding peptides containing hydrolytically stable analogs of O -phosphotyrosine
Peptides
IF0
Industrial Power Load Forecasting Method Based on Reinforcement Learning and PSO-LSSVM基于强化学习和PSO-LSSVM的工业电力负荷预测方法
Economic benefit evaluation method for the micro-grid renewable energy system operation微网可再生能源系统运行经济效益评价方法
Semisupervised Sparse Manifold Discriminative Analysis for Feature Extraction of Hyperspectral Images用于高光谱图像特征提取的半监督稀疏流形判别分析

