arrow
返回

Network Support for High-Performance Distributed Machine Learning

delete2023-02-01
delete7
delete
OA
AI
F
Francesco Malandrino *
C
Carla Fabiana Chiasserini
N
Nuria Molner
A
Antonio de la Oliva
DOI:10.1109/TNET.2022.3189077delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The traditional approach to distributed machine learning is to adapt learning algorithms to the network, e.g., reducing updates to curb overhead. Networks based on intelligent edge, instead, make it possible to follow the opposite approach, i.e., to define the logical network topology around the learning task to perform, so as to meet the desired learning performance. In this paper, we propose a system model that captures such aspects in the context of supervised machine learning, accounting for both learning nodes (that perform computations) and information nodes (that provide data). We then formulate the problem of selecting (i) which learning and information nodes should cooperate to complete the learning task, and (ii) the number of epochs to run, in order to minimize the learning cost while meeting the target prediction error and execution time. After proving important properties of the above problem, we devise an algorithm, named DoubleClimb, that can find a 1 + 1/vertical bar I vertical bar-competitive solution (with I being the set of information nodes), with cubic worst-case complexity. Our performance evaluation, leveraging a real-world network topology and considering both classification and regression tasks, also shows that DoubleClimb closely matches the optimum, outperforming state-of-the-art alternatives.
Keyword:
Task analysis
Topology
Network topology
Data models
Costs
Machine learning
Training
Network orchestration
machine learning
edge computing

期刊

I
IEEE-ACM Transactions on Networking
IF:
3.6
论文数:
4.4K
被引数:
9.5K

机构

U
Universidad Carlos III de Madrid
学者数:
5.5K
论文数: 5.7K
被引数: 4.5K
C
consiglio nazionale delle ricerche (cnr)
学者数:
6.2W
论文数: 5.7W
被引数: 48
引用论文

引用论文

Rhodococcus equi infection in patients with AIDS
err1992-03-01
err0
PREAI
errMichel Drancourt; Eric Bonnet; Hervé Gallais; Yves Peloux; Didier Raoult
err分享
err收藏
Toward Self-Learning Edge Intelligence in 6G迈向6g中的自我学习边缘智能
err2020-12-01
err99
PREAI
errXiao, Yong; Shi, Guangming; Li, Yingyu; Saad, Walid; Poor, H. Vincent
err分享
err收藏
err分享
err收藏
Adaptive Federated Learning in Resource Constrained Edge Computing Systems资源受限边缘计算系统中的自适应联合学习
err2019-06-01
err1.4K
errOAAI
errWang, Shiqiang; Tuor, Tiffany; Salonidis, Theodoros; Leung, Kin K.; Makaya, Christian; He, Ting; Chan, Kevin
err分享
err收藏
学者 查看更多内容