arrow
返回

Distributed networked learning with correlated data

delete2022-03-01
delete0
delete
OA
AI
L
Lingzhou Hong *
A
Alfredo García
C
Ceyhun Eksin
DOI:10.1016/j.automatica.2021.110134delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
We consider a distributed estimation method in a setting with heterogeneous streams of correlated data distributed across nodes in a network. In the considered approach, linear models are estimated locally (i.e., with only local data) subject to a network regularization term that penalizes a local model that differs from neighboring models. We analyze computation dynamics (associated with stochastic gradient updates) and information exchange (associated with exchanging current models with neighboring nodes). We provide a finite-time characterization of convergence of the weighted ensemble average estimate and compare this result to federated learning, an alternative approach to estimation wherein a single model is updated by locally generated gradient updates. This comparison highlights the trade-off between speed vs precision: while model updates take place at a faster rate in federated learning, the proposed networked approach to estimation enables the identification of models with higher precision. We illustrate the method's general applicability in two examples: estimating a Markov random field using wireless sensor networks and modeling prey escape behavior of flocking birds based on a publicly available dataset. (C) 2021 Elsevier Ltd. All rights reserved.
Keyword:
Large scale optimization problems and methods
Network-based computing systems
Learning theory
Statistical analysis
Parameter and state estimation
Multi-agent systems
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Automatica 封面图
Automatica
IF:
5.9
论文数:
1.2W
被引数:
5.2W

机构

T
Texas A&M University System
学者数:
4.4W
论文数: 4.0W
被引数: 4.0K
引用论文

引用论文

Irinotecan-induced central nervous system toxicity. Report on two cases and review of the literature
err2009-07-08
err0
errOAAI
errPaul Hamberg; Floris A. De Jong; Dieta Brandsma; Jaap Verweij; Stefan Sleijfer
err分享
err收藏
Sero-epidemiological evaluation of changes in Plasmodium falciparum and Plasmodium vivax transmission patterns over the rainy season in Cambodia
err2012-03-25
err0
errOAAI
errJackie Cook; Nico Speybroeck; Tho Sochanta; Heng Somony; Mao Sokny; Filip Claes; Kristel Lemmens; Michael Theisen; Irene S Soares; Umberto D'Alessandro; Marc Coosemans; Annette Erhart
err分享
err收藏
A Distributed Algorithm for Least Squares Solutions
err2019-10-01
err59
PREAI
errWang, Xuan; Zhou, Jingqiu; Mou, Shaoshuai; Corless, Martin J.
err分享
err收藏
err分享
err收藏
Least squares model averaging
err2007-07-01
err588
errOAAI
errHansen, Bruce E.
err分享
err收藏
学者 查看更多内容