arrow
Return

Non-Naive Bayesian Classifiers for Classification Problems With Continuous Attributes

delete2014-01-01
delete83
PRE
AI
王曦照 cover
王曦照 (Xizhao Wang) *
Y
Yulin He
D
Debby D. Wang
DOI:10.1109/TCYB.2013.2245891delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
An important way to improve the performance of naive Bayesian classifiers (NBCs) is to remove or relax the fundamental assumption of independence among the attributes, which usually results in an estimation of joint probability density function (p.d.f.) instead of the estimation of marginal p.d.f. in the NBC design. This paper proposes a non-naive Bayesian classifier (NNBC) in which the independence assumption is removed and the marginal p.d.f. estimation is replaced by the joint p.d.f. estimation. A new technique of estimating the class-conditional p.d.f. based on the optimal bandwidth selection, which is the crucial part of the joint p.d.f. estimation, is applied in our NNBC. Three well-known indexes for measuring the performance of Bayesian classifiers, which are classification accuracy, area under receiver operating characteristic curve, and probability mean square error, are adopted to conduct a comparison among the four Bayesian models, i.e., normal naive Bayesian, flexible naive Bayesian (FNB), the homologous model of FNB (FNBROT), and our proposed NNBC. The comparative results show that NNBC is statistically superior to the other three models regarding the three indexes. And, in the comparison with support vector machine and four boosting-based classification methods, NNBC achieves a relatively favorable classification accuracy while significantly reducing the training time.
Keywords:
Joint probability density estimation
kernel function
naive Bayesian classifier (NBC)
optimal bandwidth
probability mean square error

Journal

IEEE Transactions on Cybernetics cover
IEEE Transactions on Cybernetics
IF:
10.5
Papers:
1.1W
Citations:
5.0W

Organization

H
Hebei University
Scholars:
1.4W
Papers: 7.7K
Citations: 1.0W
C
City University of Hong Kong
Scholars:
2.3W
Papers: 3.0W
Citations: 6.1W