Feature Subset Selection by Bayesian network-based optimization

Iñaki Inza

doi:10.1016/S0004-3702(00)00052-7

Return

Feature Subset Selection by Bayesian network-based optimization

2000-10-01

186

DOI：10.1016/S0004-3702(00)00052-7

Original

Save

View PDF

Abstract

En 中文

A new method for Feature Subset Selection in machine learning, FSS-EBNA (Feature Subset Selection by Estimation of Bayesian Network Algorithm), is presented. FSS-EBNA is an evolutionary, population-based, randomized search algorithm, and it can be executed when domain knowledge is not available. A wrapper approach, over Naive-Bayes and ID3 learning algorithms, is used to evaluate the goodness of each visited solution. FSS-EBNA, based on the EDA (Estimation of Distribution Algorithm) paradigm, avoids the use of crossover and mutation operators to evolve the populations, in contrast to Genetic Algorithms. In absence of these operators, the evolution is guaranteed by the factorization of the probability distribution of the best solutions found in a generation of the search. This factorization is carried out by means of Bayesian networks. Promising results are achieved in a variety of tasks where domain knowledge is not available. The paper explains the main ideas of Feature Subset Selection, Estimation of Distribution Algorithm and Bayesian networks, presenting related work about each concept. A study about the 'overfitting' problem in the Feature Subset Selection process is carried out, obtaining a basis to define the stopping criteria of the new algorithm. (C) 2000 Elsevier Science B.V. All rights reserved.

Keywords:

machine learning

supervised learning

Feature Subset Selection

wrapper

predictive accuracy

Estimation of Distribution Algorithm

Estimation of Bayesian Network Algorithm

Bayesian network

overfitting

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.