Reinforcement Learning for Server-Aware Offloading in Multi-Tier Multi-Instance Computing Architecture

Afzal Badshah

doi:10.1145/3776562

Reinforcement Learning for Server-Aware Offloading in Multi-Tier Multi-Instance Computing Architecture

2026-02-01

3

PRE

AI

A

Afzal Badshah *

F

Fernandez-Garcia, Raul *

DOI：10.1145/3776562

Original request for help

Save

Abstract

En 中文

Task offloading in distributed computing involves complex tradeoffs among delay, scalability, cost, and resource utilization. Cloud platforms face long communication delays, while edge nodes have constrained capacity. Static, rule-based schedulers cannot adapt to fluctuating loads or per-instance heterogeneity. Similarly, Reinforcement Learning (RL) schemes typically address only a single layer or assume homogeneous servers, overlooking the hierarchical and multi-instance nature of deployments. To address these challenges, we introduce a server-aware Proximal Policy Optimization (PPO) framework that performs fine-grained offloading across a three-tier (Edge, Regional, Cloud) multi-instance architecture. We formulate offloading as a Markov cost, and energy metrics. The PPO agent learns to offload tasks to the best server in real time. Our developed RegionalEdgeSimPy simulation shows that PPO agent makes optimal offloading choices for over 90% of tasks, keeping each server near; however, below a 70% utilization. This optimized decision making drives up to 66.9% delay reduction, 78.6% energy savings, and 47.8% cost reductions relative to cloud-only and edge-only baselines.

Keywords:

Edge Computing

Cloud Computing

Offloading

Reinforcement Learning

Reinforcement Learning for Server-Aware Offloading in Multi-Tier Multi-Instance Computing Architecture

Abstract

Journal

Organization