arrow
返回

Virtual Machine Proactive Fault Tolerance Using Log-Based Anomaly Detection

delete2024-01-01
delete0
delete
OA
AI
P
Pratheek Senevirathne
C
Cooray, Samindu
J
J. Dinal Herath
D
Dinuni Fernando *
DOI:10.1109/ACCESS.2024.3506833delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Virtual Machine (VM) fault tolerance ensures high availability in cloud computing environments. Proactive fault tolerance strategies avert service disruptions by detecting potential failures before they occur and migrating the VMs to healthy hosts. In this paper, we propose Virtual Machine Proactive Fault Tolerance using Log-based Anomaly Detection (VMFT-LAD), a semi-supervised, real-time log anomaly detection model capable of detecting failures ahead of time to provide effective VM fault tolerance. VMFT-LAD leverages the efficiency of the Matrix Profile for anomaly detection and the log inference capability of Large Language Models (LLMs) to identify potential VM failures early, while minimizing false positives. Our improved Matrix Profile enables VMFT-LAD to continuously learn and identify potential failures, including unforeseen fault types, with minimal human intervention. Additionally, its semi-supervised nature eliminates the need for labeled failure data. Extensive evaluations on several datasets, using two distinct criteria to validate anomaly detection and early failure detection capabilities, demonstrate VMFT-LAD's outstanding performance. VMFT-LAD achieves a Numenta Anomaly Benchmark (NAB) standard score of 90.74 for predicting failures in advance, with a high early detection rate of 96.28% and a low false positive rate of 0.02%, enabling accurate and timely VM migration before failures occur.
Keyword:
Fault tolerant systems
Fault tolerance
Anomaly detection
Cloud computing
Adaptation models
Real-time systems
Time series analysis
Software
Servers
Fault diagnosis
Adaptive learning
anomaly detection
cloud computing
fault tolerance
large language models
log analysis
matrix profile
natural language processing
proactive migration
virtual machines

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

U
University of Colombo
学者数:
2.2K
论文数: 1.4K
被引数: 4
引用论文

引用论文

Tungstate can substitute for molybdate in sustaining growth of Methanobacterium thermoautotrophicum
err1994-03-01
err0
PREAI
errPeter A. Bertram; Ruth A. Schmitz; Dietmar Linder; Rudolf K. Thauer
err分享
err收藏
Electric-field dependence of absorption spectra of polymer ion-hemicyanine dye complexes
err1990-12-01
err0
PREAI
errS. Nomura; T. Kobayashi; H. Matsuda; S. Okada; H. Nakanishi; H. Tomiyama
err分享
err收藏
Heme Oxygenase-1 Deficiency Diminishes Methicillin-Resistant Staphylococcus aureus Clearance Due to Reduced TLR9 Expression in Pleural Mesothelial Cells
err2017-01-04
err0
errOAAI
errSatindra Gahlot; Najmunnisa Nasreen; Judith A. Johnson; Steven A. Sahn; Kamal A. Mohammed
err分享
err收藏
High precision photon flux determination for photon tagging experiments高精度光子通量测定用于光子标记实验
err2014-12-01
err0
PREAI
errA. Teymurazyan; A. Ahmidouch; P. Ambrozewicz; A. Asratyan; K. Baker; L. Benton; V. Burkert; E. Clinton; P. Cole; P. Collins; D. Dale; S. Danagoulian; G. Davidenko; R. Demirchyan; A. Deur; A. Dolgolenko; G. Dzyubenko; R. Ent; A. Evdokimov; J. Feng; M. Gabrielyan; L. Gan; A. Gasparian; A. Glamazdin; V. Goryachev; K. Hardy; J. He; M. Ito; L. Jiang; D. Kashy; M. Khandaker; A. Kolarkar; M. Konchatnyi; A. Korchin; W. Korsch; O. Kosinov; S. Kowalski; M. Kubantsev; V. Kubarovsky; I. Larin; D. Lawrence; X. Li; P. Martel; V. Matveev; D. McNulty; B. Mecking; B. Milbrath; R. Minehart; R. Miskimen; V. Mochalov; I. Nakagawa; S. Overby; E. Pasyuk; M. Payen; R. Pedroni; Y. Prok; B. Ritchie; C. Salgado; A. Shahinyan; A. Sitnikov; D. Sober; S. Stepanyan; W. Stevens; J. Underwood; A. Vasiliev; V. Vishnyakov; M. Wood; S. Zhou
err分享
err收藏
V-Recover: Virtual Machine Recovery When Live Migration Fails
err2023-07-01
err3
PREAI
errFernando, Dinuni; Terner, Jonathan; Yang, Ping; Gopalan, Kartik
err分享
err收藏
err分享
err收藏
学者 查看更多内容