arrow
Return

Instance spaces for machine learning classification

delete2017-12-28
delete84
delete
OA
AI
M
Mario Andrés Muñoz
L
Laura Villanova
D
Davaatseren Baatar
K
Kate Smith‐Miles *
DOI:10.1007/s10994-017-5629-5delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
This paper tackles the issue of objective performance evaluation of machine learning classifiers, and the impact of the choice of test instances. Given that statistical properties or features of a dataset affect the difficulty of an instance for particular classification algorithms, we examine the diversity and quality of the UCI repository of test instances used by most machine learning researchers. We show how an instance space can be visualized, with each classification dataset represented as a point in the space. The instance space is constructed to reveal pockets of hard and easy instances, and enables the strengths and weaknesses of individual classifiers to be identified. Finally, we propose a methodology to generate new test instances with the aim of enriching the diversity of the instance space, enabling potentially greater insights than can be afforded by the current UCI repository.
Keywords:
Classification
Meta-learning
Test data
Instance space
Performance evaluation
Algorithm footprints
Test instance generation
Instance difficulty

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.7K
Citations:
3.4W

Organization

M
monash university
Scholars:
2.3K
Papers: 904
Citations: 0
Cited Papers

Cited Papers

Diseases and Molecular Diagnostics: A Step Closer to Precision Medicine
err2017-08-22
err0
errOAAI
errShailendra Dwivedi; Purvi Purohit; Radhieka Misra; Puneet Pareek; Apul Goel; Sanjay Khattri; Kamlesh Kumar Pant; Sanjeev Misra; Praveen Sharma
errShare
errSave
Meta-learning for evolutionary parameter optimization of classifiers
err2012-04-13
err105
errOAAI
errReif, Matthias; Shafait, Faisal; Dengel, Andreas
errShare
errSave
A modulation of glutamate-induced phosphoinositide breakdown by intracellular pH changes
err1996-01-01
err0
PREAI
errMichel Vignes; Emmanuelle Blanc; Janique Guiramand; Elsa Gonzalez; Isabelle Sassetti; Max Récasens
errShare
errSave
MicroRNAs in childhood nephrotic syndrome
err2021-04-05
err0
PREAI
errMohanapriya C. Dhandapani; Vettriselvi Venkatesan; Charmine Pricilla
errShare
errSave
errShare
errSave
researcher View more