Efficient Client Selection Based on Contextual Combinatorial Multi-Arm Bandits

doi:10.1109/TWC.2022.3232891

Efficient Client Selection Based on Contextual Combinatorial Multi-Arm Bandits

2023-08-01

11

PRE

AI

DOI：10.1109/TWC.2022.3232891

Original

Original request for help

Save

Abstract

En 中文

To overcome the challenge of limited bandwidth, client selection has been considered an effective method for optimizing Federated Learning (FL). However, since the volatility of the learning environment, the available clients exhibit some volatility over the training process in terms of client population, client data, training status, and transmitting status, which greatly increases the difficulty of client selection. To find a practical solution, we explore a client selection problem in volatile federated learning (Volatile FL). Specifically, we first derive the convergence analysis for non-convex and strongly convex cases to illustrate the main factors affecting the convergence speed. Then, we introduce the client utility to quantify the client's contribution to model training and discuss the key problems of client selection in Volatile FL. For an efficient settlement, we propose CU-CS, a Combinatorial Multi-Arm Bandit (C(2)MAB) based decision scheme for the proposed selection problem. Theoretically, we prove that the regret of CU-CS is strictly bounded by a finite constant, justifying its theoretical feasibility. The experimental results demonstrate that our method significantly boosts FL by speeding up model convergence, promoting model accuracy, and reducing energy consumption.

Keywords:

Volatile federated learning

client selection

set volatility

statistical volatility

training volatility

transmitting volatility

contextual combinatorial multi-arm bandit

Efficient Client Selection Based on Contextual Combinatorial Multi-Arm Bandits

Abstract

Journal

Organization