arrow
Return

Developing machine-learning regression model with Logical Analysis of Data (LAD)

delete2021-01-01
delete14
PRE
AI
R
Ramy M. Khalifa *
S
Soumaya Yacout
S
Samuel Bassetto
DOI:10.1016/j.cie.2020.106947delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper proposes a regression model based on Logical Analysis of Data (LAD). LAD is known as a combinatorial Boolean supervised data mining technique for pattern generation. It is used mainly for classification problems, and has demonstrated high accuracy compared to other classification techniques. In this paper, we extend the use of LAD to deal with supervised data with continuous responses. We derive a LAD regression model (LADR). Three discretization methods that transform the values of the response into a set of thresholds are tested. At each threshold, LAD analyzes the data as a two-class classification problem and extracts the prescriptive patterns for each class. LADR regression uses the generated patterns from the original data by using cbmLAD software to fit a numerical continuous dependent response. Therefore, a normalized regression model with only binary independent variables is obtained. LADR has been applied for six datasets and obtains better results compared with the linear regression (LR), support vector regression (SVR), Decision Tree Regression (DTR), Random Forest (RF), and Polynomial Regression (PolyR). The performance is evaluated by the Mean Square Error (MSE), Coefficient of Determination (R-2), and Mean Absolute Error (MAE) based on a 10-fold cross validation.
Keywords:
Regression techniques
Logical analysis of data (LAD)
LADR regression
Discretization methods
Combinatorial regression (CR)
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Computers and Industrial Engineering cover
Computers and Industrial Engineering
IF:
6.5
Papers:
1.0W
Citations:
3.8W

Organization

U
universite de montreal
Scholars:
4.6W
Papers: 3.8W
Citations: 46