arrow
Return

Towards objective measures of algorithm performance across instance space

delete2014-05-01
delete141
delete
OA
AI
K
Kate Smith‐Miles *
D
Davaatseren Baatar
B
Brendan Wreford
R
Rhyd Lewis
DOI:10.1016/j.cor.2013.11.015delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
This paper tackles the difficult but important task of objective algorithm performance assessment for optimization. Rather than reporting average performance of algorithms across a set of chosen instances, which may bias conclusions, we propose a methodology to enable the strengths and weaknesses of different optimization algorithms to be compared across a broader instance space. The results reported in a recent Computers and Operations Research paper comparing the performance of graph coloring heuristics are revisited with this new methodology to demonstrate (i) how pockets of the instance space can be found where algorithm performance varies significantly from the average performance of an algorithm; (ii) how the properties of the instances can be used to predict algorithm performance on previously unseen instances with high accuracy; and (iii) how the relative strengths and weaknesses of each algorithm can be visualized and measured objectively. (C) 2013 Elsevier Ltd. All rights reserved.
Keywords:
Comparative analysis
Heuristics
Graph coloring
Algorithm selection
Performance prediction

Journal

C
Computers and Operations Research
IF:
4.3
Papers:
6.5K
Citations:
1.8W

Organization

C
Cardiff University
Scholars:
772
Papers: 343
Citations: 0
M
monash university
Scholars:
2.2K
Papers: 879
Citations: 0
Cited Papers

Cited Papers

A Six‐Armed Phenhomazine Ligand with a Potential “Turn‐Off” Copper(II) Sensing Capability through Terbium(III) Luminescence Quenching
err2020-09-11
err0
errOAAI
errLeandro Trupp; Andrea C. Bruttomesso; Svetlana V. Eliseeva; Stéphane Petoud; Javier A. Ramírez; Beatriz C. Barja
errShare
errSave
errShare
errSave
Gender ratio in dyslexia
err1998-12-01
err0
PREAI
errT. R. Miles; M. N. Haslum; T. J. Wheeler
errShare
errSave
Effect of the electrical double layer on voltammetry at microelectrodes
err2002-05-01
err0
PREAI
errJohn D. Norton; Henry S. White; Stephen W. Feldberg
errShare
errSave
Exploring the capability of Carbon Sequestration and Biomass generation in diverse Silvipastoral systems across Sindh range of forest division Ganderbal, India
err
IF0
err2024-04-05
err0
errOAAI
errTanveer Ahmad Rather; Amerjeet Singh; Arsheed Ahmad Mir; A. H. Mughal; Oyais Ahmad Wagay; Jauhar Rafeeq
errShare
errSave
researcher View more