.png){kind=icon}
返回
Distributed Clustering for Cooperative Multi-Task Learning Networks
.png){kind=icon}
PRE
AI
DOI：10.1109/TNSE.2023.3276854.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Distributed learning enables collaborative training of machine learning models across multiple agents by exchanging model parameters without sharing local data. Each agent generates data from distinct but related distributions, and multi-task learning can be effectively used to model related tasks. This article focuses on clustered multi-task learning, where agents are partitioned into clusters with distinct objectives, and agents in the same cluster share the same objective. The structure of such clusters is unknown apriori. Cooperation with the agents in the same cluster is beneficial and improves the overall learning performance. However, indiscriminate cooperation of agents with different objectives leads to undesired outcomes. Accurately capturing the clustering structure benefits the cooperation and offers many practical benefits; for instance, it helps advertising companies better target their ads. This article proposes an adaptive clustering method that allows distributed agents to learn the most appropriate neighbors to collaborate with and form clusters. We prove the convergence of every agent towards its objective and analyze the network learning performance using the proposed clustering method. Further, we present a method of computing combination weights that approximately optimizes the network's learning performance to determine how one should aggregate the neighbors' model parameters after the clustering step. The theoretical analysis is well-validated by the evaluation results using target localization and digits classification, showing that the proposed clustering method outperforms existing distributed clustering methods as well as the case where agents do not cooperate.
Keyword:
Distributed clustering
distributed cooperative learning
multi-agent networks
multi-task learning
期刊
I
IF:
7.9
论文数:
2.6K
被引数:
10.0K
机构
引用论文
分享收藏Automated detection scheme for acute myocardial infarction using convolutional neural network and long short-term memory.png)
PLOS ONE
OAAI
PLOS ONEIF0
OAAI分享收藏A Multiple Gradient Descent Design for Multi-Task Learning on Edge Computing: Multi-Objective Machine Learning Approach边缘计算多任务学习的多梯度下降设计: 多目标机器学习方法
PREAI
分享收藏
查看更多内容