arrow
Return

A regression tree approach using mathematical programming

delete2017-07-01
delete87
delete
OA
AI
L
Lingjian Yang
刘松松 cover
刘松松 (Songsong Liu)
S
Sophia Tsoka
L
Lazaros G. Papageorgiou *
DOI:10.1016/j.eswa.2017.02.013delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Regression analysis is a machine learning approach that aims to accurately predict the value of continuous output variables from certain independent input variables, via automatic estimation of their latent relationship from data. Tree-based regression models are popular in literature due to their flexibility to model higher order non-linearity and great interpretability. Conventionally, regression tree models are trained in a two-stage procedure, i.e. recursive binary partitioning is employed to produce a tree structure, followed by a pruning process of removing insignificant leaves, with the possibility of assigning multivariate functions to terminal leaves to improve generalisation. This work introduces a novel methodology of node partitioning which, in a single optimisation model, simultaneously performs the two tasks of identifying the break-point of a binary split and assignment of multivariate functions to either leaf, thus leading to an efficient regression tree model. Using six real world benchmark problems, we demonstrate that the proposed method consistently outperforms a number of state-of-the-art regression tree models and methods based on other techniques, with an average improvement of 7-60% on the mean absolute errors (MAE) of the predictions. (C) 2017 The Authors. Published by Elsevier Ltd.
Keywords:
Regression analysis
Surrogate model
Regression tree
Mathematical programming
Optimisation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
2.9W
Citations:
10.2W

Organization

S
Swansea University
Scholars:
8.3K
Papers: 8.6K
Citations: 1.3W
U
university of london
Scholars:
21.5W
Papers: 19.7W
Citations: 305
Cited Papers

Cited Papers

The time-course of threat processing in children: a temporal dissociation between selective attention and behavioral interference
err2012-05-01
err0
PREAI
errLidewij H. Wolters; Else de Haan; Leentje Vervoort; Sanne M. Hogendoorn; Frits Boer; Pier J.M. Prins
errShare
errSave
errShare
errSave
errShare
errSave
researcher View more