arrow
Return

Robust linear model selection based on least angle regression

delete2007-12-01
delete132
PRE
AI
J
Jafar A Khan *
S
Stefan Van Aelst
R
Ruben H. Zamar
DOI:10.1198/016214507000000950delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this article we consider the problem of building a linear prediction model when the number of candidate predictors is large and the data possibly contain anomalies that are difficult to visualize and clean. We want to predict the nonoutlying cases; therefore, we need a method that is simultaneously robust and scalable. We consider the stepwise least angle regression (LARS) algorithm which is computationally very efficient but sensitive to outliers. We introduce two different approaches to robustify LARS. The plug-in approach replaces the classical correlations in LARS by robust correlation estimates. The cleaning approach first transforms the data set by shrinking the outliers toward the bulk of the data (which we call multivariate Winsorization) and then applies LARS to the transformed data. We show that the plug in approach is time-efficient and scalable and that the bootstrap can be used to stabilize its results. We recommend using bootstrapped robustified LARS to sequence a number of candidate predictors to form a reduced set from which a more refined model can be selected.
Keywords:
bootstrap
computational complexity
robust prediction
stepwise algorithm
Winsorization
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

J
Journal of the American Statistical Association
IF:
3
Papers:
5.2K
Citations:
4.8W

Organization

G
Ghent University
Scholars:
5.2W
Papers: 4.5W
Citations: 5.5W
U
University of Dhaka
Scholars:
4.1K
Papers: 2.7K
Citations: 3.8K
U
University of British Columbia
Scholars:
7.0W
Papers: 6.1W
Citations: 8.6W
researcher View more organizations
Cited Papers

Cited Papers

Random forests
err2001-01-01
err3.1W
errOAAI
errBreiman, L
errShare
errSave