arrow
Return

Smoothing quantile regression for a distributed system

delete2021-11-01
delete11
delete
OA
AI
R
Rong Jiang
K
Keming Yu *
DOI:10.1016/j.neucom.2021.08.101delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Quantile regression has become a popular alternative to least squares regression for providing a compre-hensive description of the response distribution, and robustness against heavy-tailed error distributions. However, the nonsmooth quantile loss poses new challenges to distributed estimation in both computa-tion and theoretical development. To address this challenge, we use a convolution-type smoothing approach and its Taylor expression to transform the nondifferentiable quantile loss function into a con-vex quadratic loss function, which admits a fast and scalable algorithm to perform optimization under massive and high-dimensional data. The proposed distributed estimators are both computationally and communication efficient. Moreover, only the gradient information is communicated at each iteration. Theoretically, we show that, after a certain number of iterations, the resulting estimator is statistically as efficient as the global estimator without any restriction on the number of machines. Both simulations and data analysis are conducted to illustrate the finite sample performance of the proposed methods. (c) 2021 Elsevier B.V. All rights reserved.
Keywords:
Quantile regression
Massive data
High-dimensional data
Distributed estimator
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

B
brunel university
Scholars:
5.8K
Papers: 7.1K
Citations: 9
D
Donghua University
Scholars:
2.0W
Papers: 1.4W
Citations: 2.9W