arrow
返回

Boosting for Distributed Online Convex Optimization

delete2023-08-01
delete1
delete
OA
AI
Y
Yuhan Hu
Y
Yawei Zhao *
L
Lailong Luo
DOI:10.26599/TST.2022.9010041delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Decentralized Online Learning (DOL) extends online learning to the domain of distributed networks. However, limitations of local data in decentralized settings lead to a decrease in the accuracy of decisions or models compared to centralized methods. Considering the increasing requirement to achieve a high-precision model or decision with distributed data resources in a network, applying ensemble methods is attempted to achieve a superior model or decision with only transferring gradients or models. A new boosting method, namely Boosting for Distributed Online Convex Optimization (BD-OCO), is designed to realize the application of boosting in distributed scenarios. BD-OCO achieves the regret upper bound O O(M + N /MN T) , where M measures the size of the distributed network and N is the number of Weak Learners (WLs) in each node. The core idea of BD-OCO is to apply the local model to train a strong global one. BD-OCO is evaluated on the basis of eight different real-world datasets. Numerical results show that BD-OCO achieves excellent performance in accuracy and convergence, and is robust to the size of the distributed network.
Keyword:
distributed Online Convex Optimization (OCO)
online boosting
Online Gradient Boosting (OGB)

期刊

T
Tsinghua Science and Technology
IF:
3.5
论文数:
987
被引数:
2.5K

机构

D
Dongguan University of Technology
学者数:
5.2K
论文数: 4.5K
被引数: 7.8K
N
national university of defense technology - china
学者数:
1.8W
论文数: 1.4W
被引数: 9
引用论文

引用论文

err分享
err收藏
Controlled Anisotropic Growth of Co‐Fe‐P from Co‐Fe‐O NanoparticlesCo-fe-o纳米颗粒控制co-fe-p的各向异性生长
err2015-06-26
err0
errOAAI
errAdriana Mendoza‐Garcia; Huiyuan Zhu; Yongsheng Yu; Qing Li; Lin Zhou; Dong Su; Matthew J. Kramer; Shouheng Sun
err分享
err收藏
Distributed online gradient boosting on data stream over multi-agent networks
err2021-12-01
err5
PREAI
errAn, Xibin; Hu, Chen; Liu, Gang; Lin, Haoshen
err分享
err收藏
Distributed multi-task classification: a decentralized online learning approach分布式多任务分类: 一种分散式在线学习方法
err2017-11-02
err25
errOAAI
errZhang, Chi; Zhao, Peilin; Hao, Shuji; Soh, Yeng Chai; Lee, Bu Sung; Miao, Chunyan; Hoi, Steven C. H.
err分享
err收藏
Boosting methods for multi-class imbalanced data classification: an experimental review
err2020-09-01
err194
errOAAI
errTanha, Jafar; Abdi, Yousef; Samadi, Negin; Razzaghi, Nazila; Asadpour, Mohammad
err分享
err收藏
Smart manufacturing systems for Industry 4.0: Conceptual framework, scenarios, and future perspectives
err2018-01-23
err0
PREAI
errPai Zheng; Honghui wang; Zhiqian Sang; Ray Y. Zhong; Yongkui Liu; Chao Liu; Khamdi Mubarok; Shiqiang Yu; Xun Xu
err分享
err收藏
学者 查看更多内容