arrow
Return

A novel measure for evaluating classifiers

delete2010-05-01
delete49
PRE
AI
卫金茂 (Jinmao Wei) *
X
Xiaojie Yuan
胡清华 cover
胡清华 (Qinghua Hu)
S
Shuqin Wang
DOI:10.1016/j.eswa.2009.11.040delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Evaluating classifier performances is a crucial problem in pattern recognition and machine learning. In this paper, we propose a new measure, i.e. confusion entropy, for evaluating classifiers. For each class cl(i) of an (N + 1)-class problem, the misclassification information involves both the information of how the samples with true class label cl(i) have been misclassified to the other N classes and the information of how the samples of the other N classes have been misclassified to class cl(i). The proposed measure exploits the class distribution information of such misclassifications of all classes. Both theoretical analysis and statistical experiments show the proposed measure is more precise than accuracy and RCI. Experimental results on some benchmark data sets further confirm the theoretical analysis and statistical results and show that the new measure is feasible for evaluating classifier performances. (C) 2009 Elsevier Ltd. All rights reserved.
Keywords:
Performance evaluation
Entropy
Accuracy
Classification
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
2.9W
Citations:
10.2W

Organization

H
harbin institute of technology
Scholars:
8.0W
Papers: 6.6W
Citations: 66
T
Tianjin Normal University
Scholars:
4.6K
Papers: 3.2K
Citations: 4.2K
N
nankai university
Scholars:
4.7W
Papers: 3.2W
Citations: 74
researcher View more organizations