arrow
Return

Boosting for Distributed Online Convex Optimization

delete2023-08-01
delete1
delete
OA
AI
Y
Yuhan Hu
Y
Yawei Zhao *
L
Lailong Luo
DOI:10.26599/TST.2022.9010041delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Decentralized Online Learning (DOL) extends online learning to the domain of distributed networks. However, limitations of local data in decentralized settings lead to a decrease in the accuracy of decisions or models compared to centralized methods. Considering the increasing requirement to achieve a high-precision model or decision with distributed data resources in a network, applying ensemble methods is attempted to achieve a superior model or decision with only transferring gradients or models. A new boosting method, namely Boosting for Distributed Online Convex Optimization (BD-OCO), is designed to realize the application of boosting in distributed scenarios. BD-OCO achieves the regret upper bound O O(M + N /MN T) , where M measures the size of the distributed network and N is the number of Weak Learners (WLs) in each node. The core idea of BD-OCO is to apply the local model to train a strong global one. BD-OCO is evaluated on the basis of eight different real-world datasets. Numerical results show that BD-OCO achieves excellent performance in accuracy and convergence, and is robust to the size of the distributed network.
Keywords:
distributed Online Convex Optimization (OCO)
online boosting
Online Gradient Boosting (OGB)

Journal

T
Tsinghua Science and Technology
IF:
3.5
Papers:
987
Citations:
2.5K

Organization

D
Dongguan University of Technology
Scholars:
5.2K
Papers: 4.5K
Citations: 7.8K
N
national university of defense technology - china
Scholars:
1.8W
Papers: 1.4W
Citations: 9
Cited Papers

Cited Papers

errShare
errSave
Controlled Anisotropic Growth of Co‐Fe‐P from Co‐Fe‐O Nanoparticles
err2015-06-26
err0
errOAAI
errAdriana Mendoza‐Garcia; Huiyuan Zhu; Yongsheng Yu; Qing Li; Lin Zhou; Dong Su; Matthew J. Kramer; Shouheng Sun
errShare
errSave
Distributed online gradient boosting on data stream over multi-agent networks
err2021-12-01
err5
PREAI
errAn, Xibin; Hu, Chen; Liu, Gang; Lin, Haoshen
errShare
errSave
Distributed multi-task classification: a decentralized online learning approach
err2017-11-02
err25
errOAAI
errZhang, Chi; Zhao, Peilin; Hao, Shuji; Soh, Yeng Chai; Lee, Bu Sung; Miao, Chunyan; Hoi, Steven C. H.
errShare
errSave
Boosting methods for multi-class imbalanced data classification: an experimental review
err2020-09-01
err194
errOAAI
errTanha, Jafar; Abdi, Yousef; Samadi, Negin; Razzaghi, Nazila; Asadpour, Mohammad
errShare
errSave
Smart manufacturing systems for Industry 4.0: Conceptual framework, scenarios, and future perspectives
err2018-01-23
err0
PREAI
errPai Zheng; Honghui wang; Zhiqian Sang; Ray Y. Zhong; Yongkui Liu; Chao Liu; Khamdi Mubarok; Shiqiang Yu; Xun Xu
errShare
errSave
errShare
errSave
researcher View more