arrow
返回

Anomaly Detection in Cloud Computing using Knowledge Graph Embedding and Machine Learning Mechanisms

delete2023-12-29
delete9
delete
OA
AI
K
Katerina Mitropoulou *
P
Panagiotis Kokkinos
P
Polyzois Soumplis
E
Emmanouel Varvarigos
DOI:10.1007/s10723-023-09727-1delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The orchestration of cloud computing infrastructures is challenging, considering the number, heterogeneity and dynamicity of the involved resources, along with the highly distributed nature of the applications that use them for computation and storage. Evidently, the volume of relevant monitoring data can be significant, and the ability to collect, analyze, and act on this data in real time is critical for the infrastructure's efficient use. In this study, we introduce a novel methodology that adeptly manages the diverse, dynamic, and voluminous nature of cloud resources and the applications that they support. We use knowledge graphs to represent computing and storage resources and illustrate the relationships between them and the applications that utilize them. We then train GraphSAGE to acquire vector-based representations of the infrastructures' properties, while preserving the structural properties of the graph. These are efficiently provided as input to two unsupervised machine learning algorithms, namely CBLOF and Isolation Forest, for the detection of storage and computing overusage events, where CBLOF demonstrates better performance across all our evaluation metrics. Following the detection of such events, we have also developed appropriate re-optimization mechanisms that ensure the performance of the served applications. Evaluated in a simulated environment, our methods demonstrate a significant advancement in anomaly detection and infrastructure optimization. The results underscore the potential of this closed-loop operation in dynamically adapting to the evolving demands of cloud infrastructures. By integrating data representation and machine learning methods with proactive management strategies, this research contributes substantially to the field of cloud computing, offering a scalable, intelligent solution for modern cloud infrastructures.
Keyword:
Cloud computing
Resource allocation
Knowledge graphs
Anomaly detection

期刊

Journal of Grid Computing 封面图
Journal of Grid Computing
IF:
2.9
论文数:
761
被引数:
1.2K

机构

N
National Technical University of Athens
学者数:
9.7K
论文数: 9.5K
被引数: 8.2K
引用论文

引用论文

Towards energy-autonomous wake-up receiver using Visible Light Communication
err2016-01-01
err0
errOAAI
errJoyce Sariol Ramos; Ilker Demirkol; Josep Paradells; Daniel Vossing; Karim M. Gad; Martin Kasemann
err分享
err收藏
Edge Computing for Autonomous Driving: Opportunities and Challenges自动驾驶的边缘计算: 机遇与挑战
err2019-08-01
err396
PREAI
errLiu, Shaoshan; Liu, Liangkai; Tang, Jie; Yu, Bo; Wang, Yifan; Shi, Weisong
err分享
err收藏
Learning a Health Knowledge Graph from Electronic Medical Records
err2017-07-20
err281
errOAAI
errRotmensch, Maya; Halpern, Yoni; Tlimat, Abdulhakim; Horng, Steven; Sontag, David
err分享
err收藏
Exocam: Mars in a box to simulate soil-atmosphere interactions
err2001-01-01
err0
PREAI
errP. Rannou; E. Chassefière; T. Encrenaz; S. Erard; J.M. Génin; J. Ingrin; A. Jambon; J.P. Jolivet; F. Raulin; P. Renault; P. Rochette; A. Person; J.M. Siguier; D. Toublanc
err分享
err收藏
Hybrid Regression Model for Link Dimensioning in Spectrally-Spatially Flexible Optical Networks
err2022-01-01
err4
errOAAI
errWojciechowski, Szymon; Goscien, Roza; Ksieniewicz, Pawel; Walkowiak, Krzysztof
err分享
err收藏
学者 查看更多内容