arrow
Return

Optimal decision trees for the algorithm selection problem: integer programming based approaches

delete2019-09-23
delete13
delete
OA
AI
V
Vilas Boas, Matheus Guedes *
S
Santos, Haroldo Gambini
L
Luiz Henrique de Campos Merschmann
G
Greet Vanden Berghe
DOI:10.1111/itor.12724delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Even though it is well known that for most relevant computational problems, different algorithms may perform better on different classes of problem instances, most researchers still focus on determining a single best algorithmic configuration based on aggregate results such as the average. In this paper, we propose integer programming-based approaches to build decision trees for the algorithm selection problem. These techniques allow the automation of three crucial decisions: (a) discerning the most important problem features to determine problem classes, (b) grouping the problems into classes, and (c) selecting the best algorithm configuration for each class. To evaluate this new approach, extensive computational experiments were executed using the linear programming algorithms implemented in the COIN-OR branch-and-cut solver across a comprehensive set of instances, including all MIPLIB benchmark instances. The results exceeded our expectations. While selecting the single best parameter setting across all instances decreased the total running time by 22%, our approach decreased the total running time by 40% on average across 10-fold cross-validation experiments. These results indicate that our method generalizes quite well and does not overfit.
Keywords:
algorithm selection problem
feature-based parameter tuning
decision trees
data mining
integer programming
variable neighborhood search
COIN-OR branch and cut
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

International Transactions in Operational Research cover
International Transactions in Operational Research
IF:
2.9
Papers:
1.8K
Citations:
3.7K

Organization

U
Universidade Federal de Ouro Preto
Scholars:
3.2K
Papers: 2.2K
Citations: 1.6K
K
KU Leuven
Scholars:
5.7W
Papers: 5.2W
Citations: 8.1W
Universidade Federal de Lavras cover
Universidade Federal de Lavras
Scholars:
5.6K
Papers: 3.3K
Citations: 3.5K
researcher View more organizations