arrow
Return

Efficient parameter learning of Bayesian network classifiers

delete2017-01-26
delete26
delete
OA
AI
N
Nayyar A. Zaidi *
G
Geoffrey I. Webb
M
Mark Carman
F
François Petitjean
W
Wray Buntine
M
Mike Hynes
H
Hans De Sterck
DOI:10.1007/s10994-016-5619-zdelete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Recent advances have demonstrated substantial benefits from learning with both generative and discriminative parameters. On the one hand, generative approaches address the estimation of the parameters of the joint distribution-, which for most network types is very computationally efficient (a notable exception to this are Markov networks) and on the other hand, discriminative approaches address the estimation of the parameters of the posterior distribution-and, are more effective for classification, since they fit directly. However, discriminative approaches are less computationally efficient as the normalization factor in the conditional log-likelihood precludes the derivation of closed-form estimation of parameters. This paper introduces a new discriminative parameter learning method for Bayesian network classifiers that combines in an elegant fashion parameters learned using both generative and discriminative methods. The proposed method is discriminative in nature, but uses estimates of generative probabilities to speed-up the optimization process. A second contribution is to propose a simple framework to characterize the parameter learning task for Bayesian network classifiers. We conduct an extensive set of experiments on 72 standard datasets and demonstrate that our proposed discriminative parameterization provides an efficient alternative to other state-of-the-art parameterizations.
Keywords:
PROBABILITY-DISTRIBUTIONS
ALGORITHM
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.6K
Citations:
3.4W

Organization

M
Monash University
Scholars:
5.4W
Papers: 5.4W
Citations: 79
U
University of Waterloo
Scholars:
2.2W
Papers: 2.3W
Citations: 3.3W