Sparse Trace Ratio LDA for Supervised Feature Selection

doi:10.1109/TCYB.2023.3264907

Sparse Trace Ratio LDA for Supervised Feature Selection

2024-04-01

14

PRE

AI

DOI：10.1109/TCYB.2023.3264907

Original

Original request for help

Save

Abstract

En 中文

Classification is a fundamental task in the field of data mining. Unfortunately, high-dimensional data often degrade the performance of classification. To solve this problem, dimensionality reduction is usually adopted as an essential preprocessing technique, which can be divided into feature extraction and feature selection. Due to the ability to obtain category discrimination, linear discriminant analysis (LDA) is recognized as a classic feature extraction method for classification. Compared with feature extraction, feature selection has plenty of advantages in many applications. If we can integrate the discrimination of LDA and the advantages of feature selection, it is bound to play an important role in the classification of high-dimensional data. Motivated by the idea, we propose a supervised feature selection method for classification. It combines trace ratio LDA with 12,p-norm regularization and imposes the orthogonal constraint on the projection matrix. The learned row-sparse projection matrix can be used to select discriminative features. Then, we present an optimization algorithm to solve the proposed method. Finally, the extensive experiments on both synthetic and real world datasets indicate the effectiveness of the proposed method.

Keywords:

Classification

l(2,p)-norm

linear discriminant analysis (LDA)

sparse learning

supervised feature selection

Sparse Trace Ratio LDA for Supervised Feature Selection

Abstract

Journal

Organization