arrow
返回

Node selection using adversarial expert-based multi-armed bandits in distributed computing

delete2025-03-01
delete0
delete
OA
AI
S
Saleh ALFahad *
P
Parambath, Shameem Puthiya
C
Christos Anagnostopoulos
K
Kostas Kolomvatsos
DOI:10.1007/s00607-025-01443-wdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The edge computing (EC) paradigm enhances the Quality of Service of distributed computing applications by bringing computation closer to data sources, such as sensors, IoT devices, and local servers, instead of relying solely on centralized data centers (e.g., the Cloud). In EC environments, node selection refers to the problem of determining which distributed computing nodes should be selected for performing computing tasks taking into consideration the heterogeneity of factors like limited resources, network context, and node's computational capabilities. Evidently, node selection affects the efficiency and performance of EC environments. Recent node selection strategies rely on either heuristic or optimization methods, which inherently assume static environments. However, distributed environments consist of highly heterogeneous and dynamic systems. Addressing such a dynamic nature requires node selection strategies that leverage real-time feedback information. In this paper, we propose sequential learning-based algorithms based on multi-armed bandit (MAB) systems to deal with the node selection problem. Unlike previous MAB approaches, we contribute novel MAB algorithms for node selection using deep learning expert models. To tackle the inherent uncertainty associated with nodes, we introduce ExpGradBand, a novel expert-based gradient MAB algorithm, which leverages the selection efficiency of gradient bandits with the historic contextual information. Furthermore, we evaluate and compare ExpGradBand with various MAB approaches and baselines found in the literature with and without contextual information. Our evaluation study includes comprehensive experiments that assess the performance of these methods in settings with delayed or lost contextual feedback.
Keyword:
Edge computing
Node selection
Multi-armed bandits
Non-stochastic bandits

期刊

C
Computing
IF:
2.8
论文数:
2.3K
被引数:
3.5K

机构

U
university of glasgow
学者数:
3.5W
论文数: 3.1W
被引数: 37
引用论文

引用论文

暂无论文信息