arrow
Return

A Regularization Framework for Learning Over Multitask Graphs

delete2019-02-01
delete14
delete
OA
AI
R
Roula Nassif *
S
Stefan Vlaski
C
Cédric Richard
A
Ali H. Sayed
DOI:10.1109/LSP.2018.2889267delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This letter proposes a general regularization framework for inference over multitask networks. The optimization approach relies on minimizing a global cost consisting of the aggregate sum of individual costs regularized by a term that allows to incorporate global information about the graph structure and the individual parameter vectors into the solution of the inference problem. An adaptive strategy, which responds to streaming data and employs stochastic approximations in place of actual gradient vectors, is devised and studied. Methods allowing the distributed implementation of the regularization step are also discussed. This letter shows how to blend real-time adaptation with graph filtering and a generalized regularization framework to result in a graph diffusion strategy for distributed learning over multitask networks.
Keywords:
Multitask graphs
spectral based regularization
gradient noise
distributed implementation

Journal

IEEE Signal Processing Magazine cover
IEEE Signal Processing Magazine
IF:
9.6
Papers:
1.1W
Citations:
1.7W

Organization

E
Ecole Polytechnique Federale de Lausanne
Scholars:
1.7W
Papers: 1.3W
Citations: 25
S
swiss federal institutes of technology domain
Scholars:
9.0W
Papers: 8.0W
Citations: 163