arrow
Return

Data Microservice Composition Optimization Using Deep Reinforcement Learning

delete2025-12-07
delete0
PRE
AI
A
Abdelhamid Malki
M
Mimoun Malki
S
Sidi Mohamed Benslimane
DOI:10.1016/j.future.2025.108290delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The rise of microservice architectures has revolutionized the design of large-scale, distributed applications by enabling modular, loosely coupled services. However, composing data-intensive queries across multiple microservices introduces significant challenges, particularly regarding execution latency, memory usage, and load balancing. API Composition Pattern and existing approaches often rely on static orchestration and overlook critical runtime dynamics such as instance heterogeneity and memory constraints at the gateway. This paper introduces DQL-Comp, a deep reinforcement learning framework that dynamically generates optimized execution composition plans for data microservice queries. DQL-Comp formulates microservice composition as a sequential decision-making problem and integrates graph neural networks, attention mechanisms, and Deep Q-Learning to jointly optimize microservice instance selection, execution ordering, and join strategy. Through a real-world benchmark, including a microservice application built on the IMDB dataset, our approach demonstrates superior performance in reducing latency, balancing load, and minimizing memory violations, significantly outperforming heuristic and learning-based baselines.

Journal

F
Future Generation Computer Systems
IF:
0
Papers:
642
Citations:
0

Organization

L
labri laboratory
Scholars:
9
Papers: 6
Citations: 0
Cited Papers

Cited Papers

Dependency-Aware Microservice Deployment for Edge Computing: A Deep Reinforcement Learning Approach With Network Representation
err2024-12-01
err0
PREAI
errWang, Chenyang; Yu, Hao; Li, Xiuhua; Ma, Fei; Wang, Xiaofei; Taleb, Tarik; Leung, Victor C. M.
errShare
errSave
errShare
errSave
Microservices based architectures for IoT systems- State-of-the-art review
err2023-10-01
err8
PREAI
errSiddiqui, Hassaan; Khendek, Ferhat; Toeroe, Maria
errShare
errSave
Top-k query optimization over data services
err2020-12-01
err6
PREAI
errMalki, Abdelhamid; Benslimane, Sidi-Mohamed; Malki, Mimoun; Barhamgi, Mahmoud; Benslimane, Djamal
errShare
errSave
Towards resource-efficient reactive and proactive auto-scaling for microservice architectures
err2025-07-01
err0
errOAAI
errAhmad, Hussain; Treude, Christoph; Wagner, Markus; Szabo, Claudia
errShare
errSave
Human-level control through deep reinforcement learning
err2015-02-25
err0
PREAI
errVolodymyr Mnih; Koray Kavukcuoglu; David Silver; Andrei A. Rusu; Joel Veness; Marc G. Bellemare; Alex Graves; Martin Riedmiller; Andreas K. Fidjeland; Georg Ostrovski; Stig Petersen; Charles Beattie; Amir Sadik; Ioannis Antonoglou; Helen King; Dharshan Kumaran; Daan Wierstra; Shane Legg; Demis Hassabis
errShare
errSave
researcher View more