arrow
Return

QUANTILE REGRESSION FOR LARGE-SCALE APPLICATIONS

delete2014-01-01
delete25
delete
OA
AI
J
Jiyan Yang *
X
Xiangrui Meng
M
Michael W. Mahoney
DOI:10.1137/130919258delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Quantile regression is a method to estimate the quantiles of the conditional distribution of a response variable, and as such it permits a much more accurate portrayal of the relationship between the response variable and observed covariates than methods such as least-squares or least absolute deviations regression. It can be expressed as a linear program, and, with appropriate preprocessing, interior-point methods can be used to find a solution for moderately large problems. Dealing with very large problems, e.g., involving data up to and beyond the terabyte regime, remains a challenge. Here, we present a randomized algorithm that runs in nearly linear time in the size of the input and that, with constant probability, computes a (1 + epsilon) approximate solution to an arbitrary quantile regression problem. As a key step, our algorithm computes a low-distortion subspace-preserving embedding with respect to the loss function of quantile regression. Our empirical evaluation illustrates that our algorithm is competitive with the best previous work on small to medium-sized problems, and that in addition it can be implemented in MapReduce-like environments and applied to terabyte-sized problems.
Keywords:
quantile regression
random sampling algorithms
massive data set
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

SIAM Journal on Scientific Computing cover
SIAM Journal on Scientific Computing
IF:
2.6
Papers:
5.1K
Citations:
1.8W

Organization

U
University of California Berkeley
Scholars:
3.5W
Papers: 2.8W
Citations: 11.3W
S
Stanford University
Scholars:
9.6W
Papers: 8.2W
Citations: 17.0W
University of California System cover
University of California System
Scholars:
37.5W
Papers: 33.7W
Citations: 6.6K
researcher View more organizations