arrow
返回

Optimal differentiated threshold characterization for multi-task stochastic deadline scheduling with queuing

delete2024-05-01
delete0
PRE
AI
J
Jiangliang Jin
Y
Yunjian Xu *
DOI:10.1016/j.automatica.2024.111545delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We study the dynamic scheduling of multiple deadline constrained tasks in a serving system with N servers and a public queue with M positions. Under stochastic task arrivals and processing costs (with possibly unknown dynamics), we seek to minimize the long-term expected system cost (the sum of task processing cost and penalty cost resulting from missing tasks' deadlines). To mitigate the curse of dimensionality in the action space, we propose a new approach that utilizes optimal policy characterizations to reduce the action space dimensionality without loss of optimality. For a general setting with preemptive/non-preemptive queuing, we establish the optimality of deadline differentiated threshold policies under arbitrary system dynamics. Integrating the established optimal policy characterizations into the proximal policy optimization (PPO) method, the proposed approach is scalable in M+N. Numerical results demonstrate that the proposed approach significantly outperforms the classical PPO method and other priority rule based PPO approaches, in real-world applications including electric vehicle charging and live streaming scheduling. (c) 2024 Elsevier Ltd. All rights reserved.
Keyword:
Dynamic programming
Deep reinforcement learning
Queuing
Stochastic deadline scheduling
Electric vehicle charging

期刊

Automatica 封面图
Automatica
IF:
5.9
论文数:
1.2W
被引数:
5.2W

机构

C
Chinese University of Hong Kong
学者数:
3.4W
论文数: 3.2W
被引数: 5.6W
D
Donghua University
学者数:
2.0W
论文数: 1.4W
被引数: 2.9W
引用论文

引用论文

err分享
err收藏
Model-Free Real-Time EV Charging Scheduling Based on Deep Reinforcement Learning
err2019-09-01
err268
PREAI
errWan, Zhiqiang; Li, Hepeng; He, Haibo; Prokhorov, Danil
err分享
err收藏
err分享
err收藏
Multimedia Resource Allocation in mmWave 5G Networks
err2015-01-01
err48
errOAAI
errScott-Hayward, Sandra; Garcia-Palacios, Emiliano
err分享
err收藏
When Edge Computing Meets Microgrid: A Deep Reinforcement Learning Approach
err2019-10-01
err49
PREAI
errMunir, Md. Shirajum; Abedin, Sarder Fakhrul; Tran, Nguyen H.; Hong, Choong Seon
err分享
err收藏
err分享
err收藏
学者 查看更多内容