arrow
Return

Variational Relevant Sample-Feature Machine: A fully Bayesian approach for embedded feature selection

delete2017-06-01
delete22
PRE
AI
A
Ali Mirzaei *
Y
Yalda Mohsenzadeh
H
Hamid Sheikhzadeh
DOI:10.1016/j.neucom.2017.02.057delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper presents a Bayesian learning approach for embedded feature selection. This approach employs a fully Bayesian framework to achieve a model which is sparse in both sample and feature domains. We introduce a novel multi-step algorithm based on Variational Approximation to efficiently compute all model parameters in order to optimize the maximum a posteriori probability (MAP) measure. Experiments on both synthetic and real datasets verify that the proposed method is successful in feature selection while achieving high accuracy in both regression and classification tasks. Compared to the existing methods, especially its non-fully Bayesian counterpart, the proposed algorithm results in much higher accuracies when the size of learning data is small. Moreover, the proposed method is more reliable (evident by less variance in accuracy) than other competing algorithms. (C) 2017 Elsevier B.V. All rights reserved.
Keywords:
Sparse Bayesian learning
Relevance Vector Machine
Feature selection
Classification
Regression
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

A
Amirkabir University of Technology
Scholars:
1.1W
Papers: 1.1W
Citations: 1.0W