arrow
Return

Performance measures for classification systems with rejection

delete2017-03-01
delete22
delete
OA
AI
F
Filipe Condessa *
J
José M. Bioucas‐Dias
J
Jelena Kovačević
DOI:10.1016/j.patcog.2016.10.011delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Classifiers with rejection are essential in real-world applications where misclassifications and their effects are critical. However, if no problem specific cost function is defined, there are no established measures to assess the performance of such classifiers. We introduce a set of desired properties for performance measures for classifiers with rejection, based on which we propose a set of three performance measures for the evaluation of the performance of classifiers with rejection. The nonrejected accuracy measures the ability of the classifier to accurately classify nonrejected samples; the classification quality measures the correct decision making of the classifier with rejector; and the rejection quality measures the ability to concentrate all misclassified samples onto the set of rejected samples. We derive the concept of relative optimality that allows us to connect the measures to a family of cost functions that take into account the trade-off between rejection and misclassification. We illustrate the use of the proposed performance measures on classifiers with rejection applied to synthetic and real-world data.
Keywords:
Classification with rejection
Performance measures
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

C
Carnegie Mellon University
Scholars:
1.4W
Papers: 1.4W
Citations: 2.7W
I
instituto de telecomunicacoes
Scholars:
808
Papers: 852
Citations: 0
Cited Papers

Cited Papers

Parasitism by <I>Ixodiphagus</I> Wasps (Hymenoptera: Encyrtidae) in <I>Rhipicephalus sanguineus</I> and <I>Amblyomma</I> Ticks (Acari: Ixodidae) in Three Regions of Brazil
err2012-12-01
err0
errOAAI
errAlberto J. O. Lopes; José R. S. Nascimento-Júnior; Cláudio G. Silva; Ângelo P. Prado; Marcelo B. Labruna; Livio M. Costa-Júnior
errShare
errSave
Multi-label classification with a reject option
err2013-08-01
err45
PREAI
errPillai, Ignazio; Fumera, Giorgio; Roli, Fabio
errShare
errSave
The interaction between classification and reject performance for distance-based reject-option classifiers
err2006-06-01
err59
PREAI
errLandgrebe, Thomas C. W.; Tax, David M. J.; Paclik, Pavel; Duin, Robert P. W.
errShare
errSave
Optimization for Better World University Rank
err2019-05-01
err0
errOAAI
errPattira Jabjaimoh; Klairung Samart; Naratip Jansakul; Natthada Jibenja
errShare
errSave
On optimal reject rules and ROC curves
err2005-05-01
err38
errOAAI
errSantos-Pereira, CM; Pires, AM
errShare
errSave
Cloning of an Inducible Nitric Oxide Synthase from Rat Polymorphonuclear Neutrophils
err2009-07-13
err0
PREAI
errKunihiko Kosuga; Yoshiki Yui; Ryuichi Hattori; Kazuhiro Sase; Hiroshi Eizawa; Takeshi Aoyama; Reiko Inoue; Shigetake Sasayama
errShare
errSave
The initial structure of chondrule dust rims I: Electrically neutral grains
err2019-03-01
err0
errOAAI
errC. Xiang; A. Carballido; R.D. Hanna; L.S. Matthews; T.W. Hyde
errShare
errSave
Classifier design with incomplete knowledge
err1998-04-01
err31
PREAI
errMuzzolini, R; Yang, YH; Pierson, R
errShare
errSave
researcher View more