arrow
返回

Distributed quantile regression for massive heterogeneous data

delete2021-08-01
delete23
PRE
AI
A
Aijun Hu
Y
Yuling Jiao
Y
Yanyan Liu
Y
Yueyong Shi *
Y
Yuanshan Wu
DOI:10.1016/j.neucom.2021.03.041delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Massive data sets pose great challenges to data analysis because of their heterogeneous data structure and limited computer memory. Jordan et al. (2019, Journal of American Statistical Association) has proposed a communication-efficient surrogate likelihood (CSL) method to solve distributed learning problems. However, their method cannot be directly applied to quantile regression because the loss function in quantile regression does not meet the smoothness requirement in CSL method. In this paper, we extend CSL method so that it is applicable to quantile regression problems. The key idea is to construct a surrogate loss function which relates to the local data only through subgradients of the loss function. The alternating direction method of multipliers (ADMM) algorithm is used to address computational issues caused by the non-smooth loss function. Our theoretical analysis establishes the consistency and asymptotic normality for the proposed method. Simulation studies and applications to real data show that our method works well. (c) 2021 Elsevier B.V. All rights reserved.
Keyword:
ADMM
Communication-efficient
Distributed computing
Massive data
Quantile regression

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

C
China University of Geosciences
学者数:
3.7W
论文数: 2.8W
被引数: 4.3W
Z
zhongnan university of economics & law
学者数:
2.0K
论文数: 2.2K
被引数: 3
W
wuhan university
学者数:
8.1W
论文数: 5.8W
被引数: 70
学者 查看更多机构
引用论文

引用论文

Stationsäquivalente Behandlung: Ein Überblick zum Status quo
err2022-03-16
err0
PREAI
errLuisa Klocke; Peter Brieger; Susanne Menzel; Eva Ketisch; Johannes Hamann
err分享
err收藏
Synergistic Effect of Cobalt/Ferrocene as a Catalyst for the Oxygen Evolution Reaction钴/二茂铁作为氧析出反应催化剂的协同效应
err2024-10-15
err0
PREAI
errJose M. Abad; Alba Duprat-Alvaro; Raquel Sainz; María Victoria Martínez-Huerta; Marcos Pita; Antonio L. De Lacey
err分享
err收藏
A scalable bootstrap for massive data
err2014-03-17
err286
errOAAI
errKleiner, Ariel; Talwalkar, Ameet; Sarkar, Purnamrita; Jordan, Michael I.
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容