arrow
Return

Cost-Optimized Server Allocation and Request Routing in Cloud Systems Using Different Service Classes

delete2026-01-22
delete0
PRE
AI
N
Niklas Carlsson
D
D. L. Eager
DOI:10.1109/TCC.2026.3657060delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Cloud systems offer scalable and flexible infrastructure but can become expensive if the resource usage is not optimized. To help reduce service delivery costs, this paper presents cost-optimized load-balancing policies for several service classes and uses these to provide valuable system insights. Leveraging a comprehensive system model and considering diverse workload and system parameters, we explore the interplay between resource allocation, request routing, and system performance. Specifically, for each service class, our policies (1) determine the ideal server allocation strategy and (2) identify the most suitable replica site for each incoming request. By deriving optimized policies for different service models and conducting a comparative evaluation, we offer insights into optimal request routing strategies as well as when basic policies are optimal, perform close to optimal, or when more advanced policies are needed. Our findings contribute to improved load-balancing techniques in cloud computing, facilitating enhanced performance and efficiency in distributed environments.
Keywords:
Cloud computing
edge cloud
replica servers
optimization
server allocation
request routing
M/M/1
M/D/ $\infty$ ∞

Journal

I
IEEE Transactions on Cloud Computing
IF:
5
Papers:
1.8K
Citations:
4.3K

Organization

L
linkoping university
Scholars:
1.0K
Papers: 456
Citations: 0
U
University of Saskatchewan
Scholars:
1.5W
Papers: 1.4W
Citations: 1.7W