.png){kind=icon}
.png){kind=icon}
Return
Predicting and mitigating early job failures in cloud data centers
.png){kind=icon}
OA
AI
L
Z
C
C
DOI：10.1186/s13677-026-00961-y.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
The rapid development of cloud technologies has driven substantial growth in the scale and computational capacity of data centers. However, frequent workload failures under high-concurrency conditions have become a major performance bottleneck, causing resource waste and reduced operational efficiency. Meanwhile, evolving data center architectures, resource management policies, and workload characteristics have rendered existing failure analysis and prediction methods less effective and less interpretable, while traditional early-termination-based mitigation strategies often overlook the potential debugging value of failed workloads, negatively impacting user experience. To address these challenges, this study systematically analyzes workload failure patterns using the Google Cluster Trace (e-cluster) data across multiple dimensions, including job attributes, resource allocation and usage, job dependencies, and server characteristics. Interpretable failure rules are constructed using Rule-based Representation Learner (RRL), revealing that scheduling class and priority are among the key factors influencing failures, and that server instance failures exhibit a bimodal distribution. Based on these empirical findings, 51 features are extracted from the e-cluster data, and 14 key features are selected via random forest feature importance and Spearman correlation analysis to develop an early failure prediction framework based on XGBoost using the selected workload features. Experimental evaluation demonstrates that the framework achieves a weighted AUC of 0.9993 and a weighted F1 score of 0.9936 across different stages of the instance lifecycle. Furthermore, the prediction framework is integrated with an active cloning mechanism to mitigate the impact of predicted instance failures. Results show that the integrated mitigation mechanism achieves a median speedup of 26% for failed instances under low additional overhead.
Keywords:
Data center workloads
Failure analysis
Early failure prediction
Failure mitigation
Journal
J
IF:
4.3
Papers:
724
Citations:
2.2K