arrow
Return

A robust Wide & Deep learning framework for log-based anomaly detection

delete2024-03-01
delete1
PRE
AI
W
Weina Niu
X
Xuhan Liao
S
Shiping Huang
李裕东 cover
李裕东 (Yudong Li)
X
Xiaosong Zhang
B
Beibei Li *
DOI:10.1016/j.asoc.2024.111314delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Log -based anomaly detections have shown huge commercial potential in system maintenance. However, existing methods encounter two practical challenges. Firstly, they struggle to maintain consistent performance when dealing with evolving logs over time. Secondly, they face difficulties in effectively detecting frequency anomalies, such as abnormal system resource usage and abnormal system operating frequencies. In this paper, we propose a robust log -based anomaly detection framework using Wide & Deep learning called WDLog. Particularly, we enhance the processing of template semantic information by building upon the Drain algorithm, then we introduce invariant features and statistical features and propose a multi -feature anomaly detection method based on the Wide & Deep framework. The experimental results on HDFS and BGL datasets demonstrate the promising performance of WDLog compared to state-of-the-art methods in terms of anomaly detection effectiveness. Furthermore, WDLog exhibits robustness to evolving logs, achieving F1 -scores of over 90% under different degrees of log variation.
Keywords:
Log-based anomaly detection
Log templates extraction
Semantic information
Multi-features
Deep learning

Journal

Applied Soft Computing cover
Applied Soft Computing
IF:
6.6
Papers:
1.4W
Citations:
4.8W

Organization

S
sichuan university
Scholars:
12.1W
Papers: 7.8W
Citations: 100
Cited Papers

Cited Papers

Electric-field dependence of absorption spectra of polymer ion-hemicyanine dye complexes
err1990-12-01
err0
PREAI
errS. Nomura; T. Kobayashi; H. Matsuda; S. Okada; H. Nakanishi; H. Tomiyama
errShare
errSave
Atrial fibrillation and cognitive function in patients with heart failure: a systematic review and meta-analysis
err2016-11-15
err0
PREAI
errPavlos G. Myserlis; Antonia Malli; Dimitrios K. Kalaitzoglou; Grigorios Kalaitzidis; Michael Miligkos; Damianos G. Kokkinidis; Andreas P. Kalogeropoulos
errShare
errSave
Towards Automated Log Parsing for Large-Scale Log Data Analysis
err2018-11-01
err132
PREAI
errHe, Pinjia; Zhu, Jieming; He, Shilin; Li, Jian; Lyu, Michael R.
errShare
errSave
Mapping monoaminergic neurons with [3H]reserpine by autoradiography
err1979-07-01
err0
PREAI
errJ.G. Richards; M. Da Prada; J. Wu¨rsch; H.P. Lorez; L. Pieri
errShare
errSave
errShare
errSave
Gradient-based learning applied to document recognition
err1998-01-01
err3.8W
PREAI
errLecun, Y; Bottou, L; Bengio, Y; Haffner, P
errShare
errSave
HDAC1 and HDAC2 Restrain the Intestinal Inflammatory Response by Regulating Intestinal Epithelial Cell Differentiation
err2013-09-05
err0
errOAAI
errNaomie Turgeon; Mylène Blais; Julie-Moore Gagné; Véronique Tardif; François Boudreau; Nathalie Perreault; Claude Asselin
errShare
errSave
researcher View more