arrow
Return

Federated Clouds for Efficient Multitasking in Distributed Artificial Intelligence Applications

delete2023-04-01
delete4
PRE
AI
李岳瑾 cover
李岳瑾 (Yuejin Li)
K
Kai Hwang *
K
Kefan Shuai
Z
Zhengdao Li
A
Albert Y. Zomaya
DOI:10.1109/TCC.2022.3184157delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Distributed cloud/edge resources are needed to execute pervasive artificial intelligence tasks, collectively. The AI workload and data sets have variable multitasking granularity, privacy constraints, and communication latency concerns. This article presents a novel federated cloud/edge (FCE) framework, illustrated by distributed medical image processing across multiple hospital sites. This federated cloud system appeals to train many machine learning models efficiently with workload balancing and reduced communication overheads. We tested the FCE model on a multi-cloud platform recently built at the Chinese University of Hong Kong in Shenzhen. We claim three distinct advantages in using the FCE system. First, our federated cloud system results in 41.3% reduction in total AI processing time in large-scale ML/DL experiments. Second, high machine model accuracy was achieved at 87% level in telemedicine experiments. The virtual graph helps reduce internode traffic latencies to avoid ML inference slowdowns. Third, the system can tolerate multiple cloud failures to enter a graceful degradation mode in case of node failures. The scalable performance gains in AI processing speed, model accuracy, and fault tolerance make our federated clouds a truly viable approach to solving massive AI multitasking problems in pervasive AI applications.
Keywords:
Cloud computing
Hospitals
Computational modeling
Servers
Atmospheric modeling
Training
Software defined networking
Cloud computing
federated machine learning
graphs and networks
latency reduction
and fault tolerance

Journal

I
IEEE Transactions on Cloud Computing
IF:
5
Papers:
1.8K
Citations:
4.3K

Organization

U
University of Sydney
Scholars:
6.5W
Papers: 6.2W
Citations: 90
T
The Chinese University of Hong Kong, Shenzhen
Scholars:
4.3K
Papers: 4.0K
Citations: 7