arrow
Return

Feature selection with kernelized multi-class support vector machine

delete2021-09-01
delete80
PRE
AI
郭一楠 cover
郭一楠 (Yinan Guo)
Z
Zirui Zhang
F
Fengzhen Tang *
DOI:10.1016/j.patcog.2021.107988delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Feature selection is an important procedure in machine learning because it can reduce the complexity of the final learning model and simplify the interpretation. In this paper, we propose a novel non-linear feature selection method that targets multi-class classification problems in the framework of support vector machines. The proposed method is achieved using a kernelized multi-class support vector machine with a fast version of recursive feature elimination. The proposed method selects features that work well for all classes, as the involved classifier simultaneously constructs multiple decision functions that separates each class from the others. We formulate the classifier as a large optimisation problem, and iteratively solve one decision function at a time, leading to a lower computational time complexity than when solving the large optimisation problem directly. The coefficients of the classifier are then used as a ranking criterion in the accelerated recursive feature elimination by adding batch elimination and a rechecking process. Experimental results on several datasets demonstrate the superior performance of the proposed feature selection method. (c) 2021 Elsevier Ltd. All rights reserved.
Keywords:
Feature selection
Multi-class support vector machine
Kernel machine
Recursive feature elimination
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
Cited Papers

Cited Papers

Extracting the optimal dimensionality for local tensor discriminant analysis
err2009-01-01
err76
PREAI
errNie, Feiping; Xiang, Shiming; Song, Yangqiu; Zhang, Changshui
errShare
errSave
The Effect of Phosphorus Exposure on Diesel Oxidation Catalysts—Part I: Activity Measurements, Elementary and Surface Analyses
err2015-08-25
err0
PREAI
errMarja Kärkkäinen; Tanja Kolli; Mari Honkanen; Olli Heikkinen; Mika Huuhtanen; Kauko Kallinen; Toivo Lepistö; Jouko Lahtinen; Minnamari Vippola; Riitta L. Keiski
errShare
errSave
OFS-Density: A novel online streaming feature selection method
err2019-02-01
err70
errOAAI
errZhou, Peng; Hu, Xuegang; Li, Peipei; Wu, Xindong
errShare
errSave
Markov blanket-embedded genetic algorithm for gene selection
err2007-11-01
err324
PREAI
errZhu, Zexuan; Ong, Yew-Soon; Dash, Manoranjan
errShare
errSave
Stereotyped: Investigating Gender in Introductory Science Courses
err2013-03-01
err0
errOAAI
errShanda Lauer; Jennifer Momsen; Erika Offerdahl; Mila Kryjevskaia; Warren Christensen; Lisa Montplaisir
errShare
errSave
MLL translocations specify a distinct gene expression profile that distinguishes a unique leukemia
err2001-12-03
err1.7K
PREAI
errArmstrong, SA; Staunton, JE; Silverman, LB; Pieters, R; de Boer, ML; Minden, MD; Sallan, SE; Lander, ES; Golub, TR; Korsmeyer, SJ
errShare
errSave
Multiclass cancer diagnosis using tumor gene expression signatures
err2001-12-11
err1.7K
errOAAI
errRamaswamy, S; Tamayo, P; Rifkin, R; Mukherjee, S; Yeang, CH; Angelo, M; Ladd, C; Reich, M; Latulippe, E; Mesirov, JP; Poggio, T; Gerald, W; Loda, M; Lander, ES; Golub, TR
errShare
errSave
Orthogonal least squares regression for feature extraction
err2016-12-01
err43
PREAI
errZhao, Haifeng; Wang, Zheng; Nie, Feiping
errShare
errSave
Gene selection for cancer classification using support vector machines
err2002-01-01
err7.5K
errOAAI
errGuyon, I; Weston, J; Barnhill, S; Vapnik, V
errShare
errSave
researcher View more