arrow
Return

What Are the Differences Between Bayesian Classifiers and Mutual-Information Classifiers?

delete2014-02-01
delete27
delete
OA
AI
B
Bao-Gang Hu *
DOI:10.1109/TNNLS.2013.2274799delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
In this paper, both Bayesian and mutual-information classifiers are examined for binary classifications with or without a reject option. The general decision rules are derived for Bayesian classifiers with distinctions on error types and reject types. A formal analysis is conducted to reveal the parameter redundancy of cost terms when abstaining classifications are enforced. The redundancy implies an intrinsic problem of nonconsistency for interpreting cost terms. If no data are given to the cost terms, we demonstrate the weakness of Bayesian classifiers in class-imbalanced classifications. On the contrary, mutual-information classifiers are able to provide an objective solution from the given data, which shows a reasonable balance among error types and reject types. Numerical examples of using two types of classifiers are given for confirming the differences, including the extremely class-imbalanced cases. Finally, we briefly summarize the Bayesian and mutual-information classifiers in terms of their application advantages and disadvantages, respectively.
Keywords:
Abstaining classifier
Bayes
cost-sensitive learning
entropy
error types
mutual information
reject types
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.6K
Citations:
7.2W

Organization

No organization information available
Cited Papers

Cited Papers

On optimal reject rules and ROC curves
err2005-05-01
err38
errOAAI
errSantos-Pereira, CM; Pires, AM
errShare
errSave
TWENTY-FOUR-HOUR CYCLE OF A MELATONIN-LIKE SUBSTANCE IN THE PLASMA OF HUMAN MALES
err1973-08-01
err0
PREAI
errRussell W. Pelham; George M. Vaughan; Kenneth L. Sandock; Mary K. Vaughan
errShare
errSave
Zeolites as catalysts in oil refining
err2014-03-27
err0
PREAI
errAna Primo; Hermenegildo Garcia
errShare
errSave
errShare
errSave
researcher View more