Federated Clouds for Efficient Multitasking in Distributed Artificial Intelligence Applications

Yuejin Li

doi:10.1109/TCC.2022.3184157

Return

Federated Clouds for Efficient Multitasking in Distributed Artificial Intelligence Applications

2023-04-01

PRE

DOI：10.1109/TCC.2022.3184157

Original

Original request for help

Save

Abstract

En 中文

Distributed cloud/edge resources are needed to execute pervasive artificial intelligence tasks, collectively. The AI workload and data sets have variable multitasking granularity, privacy constraints, and communication latency concerns. This article presents a novel federated cloud/edge (FCE) framework, illustrated by distributed medical image processing across multiple hospital sites. This federated cloud system appeals to train many machine learning models efficiently with workload balancing and reduced communication overheads. We tested the FCE model on a multi-cloud platform recently built at the Chinese University of Hong Kong in Shenzhen. We claim three distinct advantages in using the FCE system. First, our federated cloud system results in 41.3% reduction in total AI processing time in large-scale ML/DL experiments. Second, high machine model accuracy was achieved at 87% level in telemedicine experiments. The virtual graph helps reduce internode traffic latencies to avoid ML inference slowdowns. Third, the system can tolerate multiple cloud failures to enter a graceful degradation mode in case of node failures. The scalable performance gains in AI processing speed, model accuracy, and fault tolerance make our federated clouds a truly viable approach to solving massive AI multitasking problems in pervasive AI applications.

Keywords:

Cloud computing

Hospitals

Computational modeling

Servers

Atmospheric modeling

Training

Software defined networking

Cloud computing

federated machine learning

graphs and networks

latency reduction