arrow
Return

Column generation based heuristic for learning classification trees

delete2020-04-01
delete17
PRE
AI
M
Murat Fırat *
G
Guillaume Crognier
A
Adriana F. Gabor
C
C.A.J. Hurkens
Y
Yingqian Zhang
DOI:10.1016/j.cor.2019.104866delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper explores the use of Column Generation (CG) techniques in constructing univariate binary decision trees for classification tasks. We propose a novel Integer Linear Programming (ILP) formulation, based on root-to-leaf paths in decision trees. The model is solved via a Column Generation based heuristic. To speed up the heuristic, we use a restricted instance data by considering a subset of decision splits, sampled from the solutions of the well-known CART algorithm. Extensive numerical experiments show that our approach is competitive with the state-of-the-art ILP-based algorithms. In particular, the proposed approach is capable of handling big data sets with tens of thousands of data rows. Moreover, for large data sets, it finds solutions competitive to CART. (C) 2019 Elsevier Ltd. All rights reserved.
Keywords:
Machine learning
Decision trees
Column generation
Classification
CART
Integer linear programming
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

C
Computers and Operations Research
IF:
4.3
Papers:
6.5K
Citations:
1.8W

Organization

E
Eindhoven University of Technology
Scholars:
1.6W
Papers: 1.5W
Citations: 2.2W