arrow
Return

Network-based sparse Bayesian classification

delete2011-04-01
delete13
PRE
AI
J
José Miguel Hernández-Lobato *
D
Daniel Hernández-Lobato
A
Alberto Suárez
DOI:10.1016/j.patcog.2010.10.016delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In some classification problems there is prior information about the joint relevance of groups of features. This knowledge can be encoded in a network whose nodes correspond to features and whose edges connect features that should be either both excluded or both included in the predictive model. In this paper, we introduce a novel network-based sparse Bayesian classifier (NBSBC) that makes use of the information about feature dependencies encoded in such a network to improve its prediction accuracy, especially in problems with a high-dimensional feature space and a limited amount of available training data. Approximate Bayesian inference is efficiently implemented in this model using expectation propagation. The NBSBC method is validated on four real-world classification problems from different domains of application: phonemes, handwritten digits, precipitation records and gene expression measurements. A comparison with state-of-the-art methods (support vector machine, network-based support vector machine and graph lasso) show that NBSBC has excellent predictive performance. It has the best accuracy in three of the four problems analyzed and ranks second in the modeling of the precipitation data. NBSBC also yields accurate and robust rankings of the individual features according to their relevance to the solution of the classification problem considered. The accuracy and stability of these estimates is an important factor in the good overall performance of this method. (C) 2010 Elsevier Ltd. All rights reserved.
Keywords:
Network based classification
Expectation propagation
Spike and slab
Markov random field
Sparsity
Feature selection
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

U
universite catholique louvain
Scholars:
2.0W
Papers: 1.7W
Citations: 21
A
Autonomous University of Madrid
Scholars:
2.1W
Papers: 1.7W
Citations: 29