arrow
返回

AROCK: AN ALGORITHMIC FRAMEWORK FOR ASYNCHRONOUS PARALLEL COORDINATE UPDATES

delete2016-01-01
delete192
delete
OA
AI
P
Peng, Zhimin *
X
Xu, Yangyang
M
Ming Yan
Y
Yin, Wotao
DOI:10.1137/15M1024950delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Finding a fixed point to a nonexpansive operator, i.e., x* - Tx*, abstracts many problems in numerical linear algebra, optimization, and other areas of data science. To solve fixed-point problems, we propose ARock, an algorithmic framework in which multiple agents (machines, processors, or cores) update x in an asynchronous parallel fashion. Asynchrony is crucial to parallel computing since it reduces synchronization wait, relaxes communication bottleneck, and thus speeds up computing significantly. At each step of ARock, an agent updates a randomly selected coordinate x, based on possibly out-of-date information on x. The agents share x through either global memory or communication. If writing x, is atomic, the agents can read and write x without memory locks. We prove that if the nonexpansive operator T has a fixed point, then with probability one, ARock generates a sequence that converges to a fixed point of T. Our conditions on T and step sizes are weaker than those in comparable work. Linear convergence is obtained under suitable assumptions. We propose special cases of ARock for linear systems, convex optimization, and machine learning, as well as distributed and decentralized consensus problems. Numerical experiments solving sparse logistic regression problems are presented.
Keyword:
asynchronous
parallel
coordinate update
nonexpansive operator
ADMM
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

SIAM Journal on Scientific Computing 封面图
SIAM Journal on Scientific Computing
IF:
2.6
论文数:
5.1K
被引数:
1.8W

机构

University of Alabama System 封面图
University of Alabama System
学者数:
4.2W
论文数: 3.7W
被引数: 68
U
university of california los angeles
学者数:
5.3W
论文数: 4.2W
被引数: 89
University of California System 封面图
University of California System
学者数:
37.5W
论文数: 33.7W
被引数: 6.6K
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Trisomy 7 mosaicism at amniocentesis: Interphase FISH, QF-PCR, and aCGH analyses on uncultured amniocytes for rapid distinguishing of true mosaicism from pseudomosaicism
err2012-03-01
err0
errOAAI
errChih-Ping Chen; Hsu-Kuang Huang; Yi-Ning Su; Schu-Rern Chern; Jun-Wei Su; Chen-Chi Lee; Dai-Dyi Town; Wen-Lin Chen; Yu-Ting Chen; Wayseen Wang
err分享
err收藏
STRESS MEASUREMENTS ON ANCIENT STRUCTURES
err1995-05-01
err0
PREAI
errJ. Barrallo; A. Zulueta; J.E. Caro; L.P. Blanco; S. Sánchez Beitia
err分享
err收藏
err分享
err收藏
学者 查看更多内容