Multi-class ROC analysis from a multi-objective optimisation perspective

doi:10.1016/j.patrec.2005.10.016

Return

Multi-class ROC analysis from a multi-objective optimisation perspective

2006-06-01

Richard Everson *

Jonathan E. Fieldsend

DOI：10.1016/j.patrec.2005.10.016

Original

Save

View PDF

Abstract

En 中文

The receiver operating characteristic (ROC) has become a standard tool for the analysis and comparison of classifiers when the costs of misclassification are unknown. There has been relatively little work, however, examining ROC for more than two classes. Here we discuss and present an extension to the standard two-class ROC for multi-class problems. We define the ROC surface for the Q-class problem in terms of a multi-objective optimisation problem in which the goal is to simultaneously minimise the Q(Q-1) misclassification rates, when the misclassification costs and parameters governing the classifier's behaviour are unknown. We present an evolutionary algorithm to locate the Pareto front-the optimal trade-off surface between misclassifications of different types. The use of the Pareto optimal surface to compare classifiers is discussed and we present a straightforward multi-class analogue of the Gini coefficient. The performance of the evolutionary algorithm is illustrated on a synthetic three class problem, for both k-nearest neighbour and multi-layer perceptron classifiers. (c) 2005 Elsevier B.V. All rights reserved.

Keywords:

receiver operating characteristic

evolutionary computation

multiple objectives

Pareto optimality

Gini coefficient

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.