arrow
Return

Intent-Based Resource Allocation in Edge and Cloud Computing Using Reinforcement Learning

delete2025-10-04
delete0
PRE
AI
D
Dimitrios Konidaris
P
Polyzois Soumplis
A
Andreas Varvarigos
P
Panagiotis Kokkinos *
DOI:10.3390/a18100627delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Managing resource use in cloud and edge environments is crucial for optimizing performance and efficiency. Traditionally, this process is performed with detailed knowledge of the available infrastructure while being application-specific. However, it is common that users cannot accurately specify their applications' low-level requirements, and they tend to overestimate them-a problem further intensified by their lack of detailed knowledge on the infrastructure's characteristics. In this context, resource orchestration mechanisms perform allocations based on the provided worst-case assumptions, with a direct impact on the performance of the whole infrastructure. In this work, we propose a resource orchestration mechanism based on intents, in which users provide their high-level workload requirements by specifying their intended preferences for how the workload should be managed, such as prioritizing high capacity, low cost, or other criteria. Building on this, the proposed mechanism dynamically assigns resources to applications through a Reinforcement Learning method leveraging the feedback from the users and infrastructure providers' monitoring system. We formulate the respective problem as a discrete-time, finite horizon Markov decision process. Initially, we solve the problem using a tabular Q-learning method. However, due to the large state space inherent in real-world scenarios, we also employ Deep Reinforcement Learning, utilizing a neural network for the Q-value approximation. The presented mechanism is capable of continuously adapting the manner in which resources are allocated based on feedback from users and infrastructure providers. A series of simulation experiments were conducted to demonstrate the applicability of the proposed methodologies in intent-based resource allocation, examining various aspects and characteristics and performing comparative analysis.
Keywords:
resource allocation
intents
cloud computing
Q-learning
deep reinforcement learning
neural networks

Journal

Algorithms cover
Algorithms
IF:
2.1
Papers:
631
Citations:
5.4K

Organization

H
harokopio university athens
Scholars:
2.1K
Papers: 1.7K
Citations: 16
N
National Technical University of Athens
Scholars:
9.7K
Papers: 9.5K
Citations: 8.2K
U
University of Peloponnese
Scholars:
870
Papers: 763
Citations: 531
researcher View more organizations