arrow
Return

Feature selection with kernelized multi-class support vector machine

delete2021-09-01
delete80
PRE
AI
郭一楠 cover
郭一楠 (Yinan Guo)
Z
Zirui Zhang
F
Fengzhen Tang *
DOI:10.1016/j.patcog.2021.107988delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Feature selection is an important procedure in machine learning because it can reduce the complexity of the final learning model and simplify the interpretation. In this paper, we propose a novel non-linear feature selection method that targets multi-class classification problems in the framework of support vector machines. The proposed method is achieved using a kernelized multi-class support vector machine with a fast version of recursive feature elimination. The proposed method selects features that work well for all classes, as the involved classifier simultaneously constructs multiple decision functions that separates each class from the others. We formulate the classifier as a large optimisation problem, and iteratively solve one decision function at a time, leading to a lower computational time complexity than when solving the large optimisation problem directly. The coefficients of the classifier are then used as a ranking criterion in the accelerated recursive feature elimination by adding batch elimination and a rechecking process. Experimental results on several datasets demonstrate the superior performance of the proposed feature selection method. (c) 2021 Elsevier Ltd. All rights reserved.
Keywords:
Feature selection
Multi-class support vector machine
Kernel machine
Recursive feature elimination
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

C
chinese academy of sciences
Scholars:
56.3W
Papers: 44.8W
Citations: 704