arrow
返回

Huber loss based distributed robust learning algorithm for random vector functional-link network

delete2022-12-26
delete3
PRE
AI
X
Xie, Jin
L
Liu, Sanyang
C
Chen, Jiaxi *
J
Jia, Jinping
DOI:10.1007/s10462-022-10362-7delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this paper, we propose two algorithms based on the random vector functional link network (RVFLN) and alternating direction method of multipliers algorithm to solve distributed learning (DL) problems with datasets containing outliers. In distributed scenarios, training datasets are separately divided and stored on each node of the communication network and cannot be shared or collected over the communication network due to privacy preserving policy and network environmental restrictions. Thus, each node of the communication network only deals with local data and shares updated output weights of the global RVFLN model with its neighbors. However, the majority of existing DL algorithms are not robust enough when the dataset contain outliers. To overcome the this drawback, we intend to apply the L-1 norm and Huber based error terms to the global loss function and propose the corresponding distributed robust learning algorithms and denote them as the L-1-DRVFL and Huber-DRVFL algorithms, respectively. The proposed algorithms work in fully distributed manner and are privacy-preserving methods. Experiments show that the proposed algorithms are robust and efficient in distributed learning with data including outliers. Moreover, the Huber-DRVFL algorithm is more stable than the L-1-DRVFL algorithm when the parameters vary.
Keyword:
Distributed learning
Distributed robust learning
Random vector functional link network
Huber loss function
Alternating direction method of multipliers

期刊

Artificial Intelligence Review 封面图
Artificial Intelligence Review
IF:
13.9
论文数:
6.1K
被引数:
1.9W

机构

X
Xidian University
学者数:
2.4W
论文数: 1.9W
被引数: 9.7K
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Combat-Related Traumatic Brain Injury and Its Implications to Military Healthcare
err2010-12-01
err0
PREAI
errKimberly S. Meyer; Donald W. Marion; Helen Coronel; Michael S. Jaffee
err分享
err收藏
学者 查看更多内容