.png){kind=icon}
.png){kind=icon}
Return
Sparse Linear Discriminant Analysis With Constant Between-Class Distance for Feature Selection
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2024.3514612.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Feature selection is an important preprocessing step in machine learning to remove irrelevant and redundant features. Due to its ability to effectively maintain the discriminability of extracted features, Trace Ratio Linear Discriminant Analysis (TR-LDA) has become the foundation for many feature selection algorithms. As is known, TR-LDA is a challenging problem to solve because of its trace-ratio form, and it also faces the scale invariance problem. These two drawbacks of TR-LDA significantly reduce the performance of feature selection algorithms based on it. To overcome these drawbacks, this paper proposes the sparse LDA with constant between-class distance (SLDA-CBD) model to select relavant features. This model first transforms TR-LDA into a non-trace ratio problem with a constant between-class distance constraint, and then imposes row constraints on the projection matrix to implement feature selection. Since the SLDA-CBD model is rooted in TR-LDA, it ensures the discriminative performance of the selected features. The constant between-class distance constraint successfully avoids the scale invariance problem. Additionally, due to the non-trace ratio form of the SLDA-CBD model, it is easily solvable. The experimental results show that the proposed method has better performance compared to the baseline and six state-of-the-art relative methods, with improvements of over 1% on image datasets and over 2% on video datasets in most cases, while also demonstrating high stability, proving its effectiveness and advantage in practical applications.
Keywords:
Feature extraction
Classification algorithms
Training
Filtering algorithms
Computational modeling
Machine learning algorithms
Sparse matrices
Mathematical models
Vectors
Predictive models
Feature selection
TR-LDA
sparse regression
Journal
IF:
3.6
Papers:
9.8W
Citations:
29.4W
View more organizations