arrow
Return

Communication-efficient distributed multi-task learning with matrix sparsity regularization

delete2019-10-07
delete11
delete
OA
AI
Q
Qiang Zhou
Y
Yu Chen
S
Sinno Jialin Pan *
DOI:10.1007/s10994-019-05847-6delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
This work focuses on distributed optimization for multi-task learning with matrix sparsity regularization. We propose a fast communication-efficient distributed optimization method for solving the problem. With the proposed method, training data of different tasks can be geo-distributed over different local machines, and the tasks can be learned jointly through the matrix sparsity regularization without a need to centralize the data. We theoretically prove that our proposed method enjoys a fast convergence rate for different types of loss functions in the distributed environment. To further reduce the communication cost during the distributed optimization procedure, we propose a data screening approach to safely filter inactive features or variables. Finally, we conduct extensive experiments on both synthetic and real-world datasets to demonstrate the effectiveness of our proposed method.
Keywords:
Distributed learning
Multi-task learning
Acceleration
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.6K
Citations:
3.4W

Organization

N
Nanyang Technological University
Scholars:
4.9W
Papers: 4.8W
Citations: 8.1W