arrow
返回

Communication-Efficient Distributed Statistical Inference

delete2018-11-13
delete326
delete
OA
AI
M
Michael I. Jordan
J
Jason D. Lee
Y
Yun Yang *
DOI:10.1080/01621459.2018.1429274delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
We present a communication-efficient surrogate likelihood (CSL) framework for solving distributed statistical inference problems. CSL provides a communication-efficient surrogate to the global likelihood that can be used for low-dimensional estimation, high-dimensional regularized estimation, and Bayesian inference. For low-dimensional estimation, CSL provably improves upon naive averaging schemes and facilitates the construction of confidence intervals. For high-dimensional regularized estimation, CSL leads to a minimax-optimal estimator with controlled communication cost. For Bayesian inference, CSL can be used to form a communication-efficient quasi-posterior distribution that converges to the true posterior. This quasi-posterior procedure significantly improves the computational efficiency of Markov chain Monte Carlo (MCMC) algorithms even in a nondistributed setting. We present both theoretical analysis and experiments to explore the properties of the CSL approximation. Supplementary materials for this article are available online.
Keyword:
Communication efficiency
Distributed inference
Likelihood approximation
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

J
Journal of the American Statistical Association
IF:
3
论文数:
5.2K
被引数:
4.8W

机构

U
University of California Berkeley
学者数:
3.5W
论文数: 2.8W
被引数: 11.3W
S
Stanford University
学者数:
9.6W
论文数: 8.2W
被引数: 17.0W
University of California System 封面图
University of California System
学者数:
37.5W
论文数: 33.7W
被引数: 6.6K
学者 查看更多机构
引用论文

引用论文

An MCMC approach to classical estimation
err2003-08-01
err432
errOAAI
errChernozhukov, V; Hong, H
err分享
err收藏
A scalable bootstrap for massive data
err2014-03-17
err286
errOAAI
errKleiner, Ariel; Talwalkar, Ameet; Sarkar, Purnamrita; Jordan, Michael I.
err分享
err收藏
COMMUNICATION-OPTIMAL PARALLEL AND SEQUENTIAL QR AND LU FACTORIZATIONS
err2012-01-01
err237
errOAAI
errDemmel, James; Grigori, Laura; Hoemmen, Mark; Langou, Julien
err分享
err收藏
A point-and-click interface for the real world
err2008-03-12
err0
PREAI
errCharles C. Kemp; Cressel D. Anderson; Hai Nguyen; Alexander J. Trevor; Zhe Xu
err分享
err收藏
err分享
err收藏
ON ASYMPTOTICALLY OPTIMAL CONFIDENCE REGIONS AND TESTS FOR HIGH-DIMENSIONAL MODELS
err2014-06-01
err847
errOAAI
errVan de Geer, Sara; Buehlmann, Peter; Ritov, Ya'acov; Dezeure, Ruben
err分享
err收藏
没有更多内容