arrow
Return

Event-Driven Double Dueling Deep Q-Learning for Efficient Serverless Edge Function Offloading and Scheduling

delete2026-06-15
delete0
PRE
AI
M
Manish Pandey
Y
Youngwoo Kwon
DOI:10.1109/tcc.2026.3703387delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Serverless edge computing combines the scalability and cost-efficiency of serverless platforms with the low-latency benefits of edge systems. However, the limited computational capacity of individual edge nodes and frequent cold starts often lead to long waiting times and missed deadlines. Although horizontal offloading can alleviate local overload, conventional heuristics rely on static metrics and neglect critical conditions such as queue buildup, warm containers, and memory allocation, which frequently shift bottlenecks to neighboring nodes. This paper proposes a cooperative serverless edge architecture that integrates intelligent horizontal offloading with an adaptive in-node scheduling layer. A Double Dueling Deep Q-Learning (D3QL) agent guides task placement based on real-time feedback, while the scheduler at the chosen node prioritizes requests to increase warm-start reuse and protect deadline-sensitive workloads. The scheduler’s decisions flow back into the agent, forming a continuous improvement loop between global and local control. Evaluations using production Azure and Alibaba traces show that our method consistently outperforms baseline approaches, achieving higher task completion and guarantee rates, reduced memory consumption, and improved warm-start ratios. Using a one-hour Azure invocation trace on OpenWhisk, our method achieves 67.46% higher task completion than local execution.
Keywords:
Serverless computing
edge computing
reinforcement learning
horizontal offloading
task scheduling

Journal

I
IEEE Transactions on Cloud Computing
IF:
5
Papers:
1.8K
Citations:
4.3K

Organization

K
Kyungpook National University
Scholars:
3.4K
Papers: 1.5K
Citations: 1.7W
Cited Papers

Cited Papers

No cited papers available