arrow
返回

Distributed multi-task classification: a decentralized online learning approach

delete2017-11-02
delete25
delete
OA
AI
C
Chi Zhang
P
Peilin Zhao *
S
Shuji Hao
Y
Yeng Chai Soh
B
Bu‐Sung Lee
C
Chunyan Miao
S
Steven C. H. Hoi *
DOI:10.1007/s10994-017-5676-ydelete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Although dispersing one single task to distributed learning nodes has been intensively studied by the previous research, multi-task learning on distributed networks is still an area that has not been fully exploited, especially under decentralized settings. The challenge lies in the fact that different tasks may have different optimal learning weights while communication through the distributed network forces all tasks to converge to an unique classifier. In this paper, we present a novel algorithm to overcome this challenge and enable learning multiple tasks simultaneously on a decentralized distributed network. Specifically, the learning framework can be separated into two phases: (i) multi-task information is shared within each node on the first phase; (ii) communication between nodes then leads the whole network to converge to a common minimizer. Theoretical analysis indicates that our algorithm achieves a regret bound when compared with the best classifier in hindsight, which is further validated by experiments on both synthetic and real-world datasets.
Keyword:
Decentralized distributed learning
Multi-task learning
Online learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Machine Learning 封面图
Machine Learning
IF:
2.9
论文数:
2.7K
被引数:
3.4W

机构

A
a*star - institute of high performance computing (ihpc)
学者数:
1.5K
论文数: 1.3K
被引数: 3
N
Nanyang Technological University
学者数:
4.9W
论文数: 4.8W
被引数: 8.1W
A
agency for science technology & research (a*star)
学者数:
2.2W
论文数: 1.9W
被引数: 57
S
south china university of technology
学者数:
6.8W
论文数: 5.1W
被引数: 85
学者 查看更多机构
引用论文

引用论文

Targeting Notch signaling in pancreatic cancer
err2010-04-14
err0
PREAI
errElodie Ristorcelli; Dominique Lombardo
err分享
err收藏
Substance Use Among High-School Students: Relationships with Temperament, Personality Traits, and Parental Care Perception
err2004-02-25
err0
PREAI
errG. Gerra; L. Angioni; A. Zaimovic; G. Moi; M. Bussandri; S. Bertacca; G. Santoro; S. Gardini; R. Caccavari; M. A. Nicoli
err分享
err收藏
Substance P in an argentaffin carcinoid of the caecum: Biochemical and biological characterization
err1981-01-01
err0
PREAI
errM. Ratzenhofer; R. Gamse; H. H�fler; L. Aub�ck; H. Popper; P. Pohl; F. Lembeck
err分享
err收藏
Detection of Antibodies Directed against a Liver-Specific Membrane Lipoprotein in Patients with Acute and Chronic Active Hepatitis
err1978-07-06
err0
PREAI
errDonald M. Jensen; Ian G. McFarlane; Bernard S. Portmann; A. L. W. F. Eddleston; Roger Williams
err分享
err收藏
学者 查看更多内容