arrow
Return

Feature selection for Bayesian network classifiers using the MDL-FS score

delete2010-07-01
delete25
delete
OA
AI
M
Mădălina M. Drugan *
M
Marco Wiering
DOI:10.1016/j.ijar.2010.02.001delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
When constructing a Bayesian network classifier from data, the more or less redundant features included in a dataset may bias the classifier and as a consequence may result in a relatively poor classification accuracy. In this paper, we study the problem of selecting appropriate subsets of features for such classifiers. To this end, we propose a new definition of the concept of redundancy in noisy data. For comparing alternative classifiers, we use the Minimum Description Length for Feature Selection (MDL-FS) function that we introduced before. Our function differs from the well-known MDL function in that it captures a classifier's conditional log-likelihood. We show that the MDL-FS function serves to identify redundancy at different levels and is able to eliminate redundant features from different types of classifier. We support our theoretical findings by comparing the feature-selection behaviours of the various functions in a practical setting. Our results indicate that the MDL-FS function is more suited to the task of feature selection than MDL as it often yields classifiers of equal or better performance with significantly fewer attributes. (C) 2010 Elsevier Inc. All rights reserved.
Keywords:
Feature subset selection
Minimum Description Length
Selective Bayesian classifiers
Tree augumented networks
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

International Journal of Approximate Reasoning cover
International Journal of Approximate Reasoning
IF:
3
Papers:
2.9K
Citations:
5.1K

Organization

U
Utrecht University
Scholars:
5.9W
Papers: 5.1W
Citations: 5.8W
U
University of Groningen
Scholars:
4.4W
Papers: 4.3W
Citations: 5.9W