arrow
Return

The Relevance Sample-Feature Machine: A Sparse Bayesian Learning Approach to Joint Feature-Sample Selection

delete2013-12-01
delete51
PRE
AI
Y
Yalda Mohsenzadeh *
H
Hamid Sheikhzadeh
A
Ali M. Reza
N
Najmehsadat Bathaee
M
Mahdi M. Kalayeh
DOI:10.1109/TCYB.2013.2260736delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper introduces a novel sparse Bayesian machine-learning algorithm for embedded feature selection in classification tasks. Our proposed algorithm, called the relevance sample feature machine (RSFM), is able to simultaneously choose the relevance samples and also the relevance features for regression or classification problems. We propose a separable model in feature and sample domains. Adopting a Bayesian approach and using Gaussian priors, the learned model by RSFM is sparse in both sample and feature domains. The proposed algorithm is an extension of the standard RVM algorithm, which only opts for sparsity in the sample domain. Experimental comparisons on synthetic as well as benchmark data sets show that RSFM is successful in both feature selection (eliminating the irrelevant features) and accurate classification. The main advantages of our proposed algorithm are: less system complexity, better generalization and avoiding overfitting, and less computational cost during the testing stage.
Keywords:
Joint feature selection and classifier design
relevance features
relevance sample feature machine (RSFM)
relevance samples
sparse Bayesian learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Cybernetics cover
IEEE Transactions on Cybernetics
IF:
10.5
Papers:
1.1W
Citations:
5.0W

Organization

A
Amirkabir University of Technology
Scholars:
1.1W
Papers: 1.1W
Citations: 1.0W
U
University of Wisconsin Milwaukee
Scholars:
3.9K
Papers: 3.0K
Citations: 6.9K