Return
What Are the Differences Between Bayesian Classifiers and Mutual-Information Classifiers?
DOI:10.1109/TNNLS.2013.2274799.png)
Abstract
En 中文
In this paper, both Bayesian and mutual-information classifiers are examined for binary classifications with or without a reject option. The general decision rules are derived for Bayesian classifiers with distinctions on error types and reject types. A formal analysis is conducted to reveal the parameter redundancy of cost terms when abstaining classifications are enforced. The redundancy implies an intrinsic problem of nonconsistency for interpreting cost terms. If no data are given to the cost terms, we demonstrate the weakness of Bayesian classifiers in class-imbalanced classifications. On the contrary, mutual-information classifiers are able to provide an objective solution from the given data, which shows a reasonable balance among error types and reject types. Numerical examples of using two types of classifiers are given for confirming the differences, including the extremely class-imbalanced cases. Finally, we briefly summarize the Bayesian and mutual-information classifiers in terms of their application advantages and disadvantages, respectively.
Keywords:
Abstaining classifier
Bayes
cost-sensitive learning
entropy
error types
mutual information
reject types
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
8.9
Papers:
7.6K
Citations:
7.2W
Organization
No organization information available
Cited Papers
Structural identifiability of generalized constraint neural network models for nonlinear regression
NEUROCOMPUTING
IF6.5

