arrow
Return

Distributed quantile regression for massive heterogeneous data

delete2021-08-01
delete23
PRE
AI
A
Aijun Hu
Y
Yuling Jiao
Y
Yanyan Liu
Y
Yueyong Shi *
Y
Yuanshan Wu
DOI:10.1016/j.neucom.2021.03.041delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Massive data sets pose great challenges to data analysis because of their heterogeneous data structure and limited computer memory. Jordan et al. (2019, Journal of American Statistical Association) has proposed a communication-efficient surrogate likelihood (CSL) method to solve distributed learning problems. However, their method cannot be directly applied to quantile regression because the loss function in quantile regression does not meet the smoothness requirement in CSL method. In this paper, we extend CSL method so that it is applicable to quantile regression problems. The key idea is to construct a surrogate loss function which relates to the local data only through subgradients of the loss function. The alternating direction method of multipliers (ADMM) algorithm is used to address computational issues caused by the non-smooth loss function. Our theoretical analysis establishes the consistency and asymptotic normality for the proposed method. Simulation studies and applications to real data show that our method works well. (c) 2021 Elsevier B.V. All rights reserved.
Keywords:
ADMM
Communication-efficient
Distributed computing
Massive data
Quantile regression

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

C
China University of Geosciences
Scholars:
3.7W
Papers: 2.8W
Citations: 4.3W
Z
zhongnan university of economics & law
Scholars:
2.0K
Papers: 2.2K
Citations: 3
W
wuhan university
Scholars:
8.1W
Papers: 5.8W
Citations: 70
researcher View more organizations
Cited Papers

Cited Papers

Stationsäquivalente Behandlung: Ein Überblick zum Status quo
err2022-03-16
err0
PREAI
errLuisa Klocke; Peter Brieger; Susanne Menzel; Eva Ketisch; Johannes Hamann
errShare
errSave
Synergistic Effect of Cobalt/Ferrocene as a Catalyst for the Oxygen Evolution Reaction
err2024-10-15
err0
PREAI
errJose M. Abad; Alba Duprat-Alvaro; Raquel Sainz; María Victoria Martínez-Huerta; Marcos Pita; Antonio L. De Lacey
errShare
errSave
A scalable bootstrap for massive data
err2014-03-17
err286
errOAAI
errKleiner, Ariel; Talwalkar, Ameet; Sarkar, Purnamrita; Jordan, Michael I.
errShare
errSave
errShare
errSave
Modeling wine preferences by data mining from physicochemical properties
err2009-11-01
err836
errOAAI
errCortez, Paulo; Cerdeira, Antonio; Almeida, Fernando; Matos, Telmo; Reis, Jose
errShare
errSave
QUANTILE REGRESSION UNDER MEMORY CONSTRAINT
err2019-12-01
err126
errOAAI
errChen, Xi; Liu, Weidong; Zhang, Yichen
errShare
errSave
errShare
errSave
researcher View more