.png){kind=icon}
返回
Communication-Efficient Accurate Statistical Estimation
.png){kind=icon}
OA
AI
DOI：10.1080/01621459.2021.1969238.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
When the data are stored in a distributed manner, direct applications of traditional statistical inference procedures are often prohibitive due to communication costs and privacy concerns. This article develops and investigates two communication-efficient accurate statistical estimators (CEASE), implemented through iterative algorithms for distributed optimization. In each iteration, node machines carry out computation in parallel and communicate with the central processor, which then broadcasts aggregated information to node machines for new updates. The algorithms adapt to the similarity among loss functions on node machines, and converge rapidly when each node machine has large enough sample size. Moreover, they do not require good initialization and enjoy linear converge guarantees under general conditions. The contraction rate of optimization errors is presented explicitly, with dependence on the local sample size unveiled. In addition, the improved statistical accuracy per iteration is derived. By regarding the proposed method as a multistep statistical estimator, we show that statistical efficiency can be achieved in finite steps in typical statistical applications. In addition, we give the conditions under which the one-step CEASE estimator is statistically efficient. Extensive numerical experiments on both synthetic and real data validate the theoretical results and demonstrate the superior performance of our algorithms.
Keyword:
Communication efficiency
Distributed statistical estimation
Multi-round algorithms
Penalized likelihood
期刊
J
IF:
3
论文数:
5.2K
被引数:
4.8W
机构
引用论文
.png){kind=icon}
分享收藏A computational avenue towards understanding and design of zwitterionic anti-biofouling materials
PREAI
分享收藏
查看更多内容