arrow
返回

DeepSyslog: Deep Anomaly Detection on Syslog Using Sentence Embedding and Metadata

delete2022-01-01
delete19
delete
OA
AI
周俊伟 封面图
周俊伟 (Junwei Zhou) *
Y
Yijia Qian
Q
Qingtian Zou
P
Peng Liu
J
Jianwen Xiang
DOI:10.1109/TIFS.2022.3201379delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Anomaly events indicating the unhealthy status of the computer system are recorded in the system log (Syslog). Therefore, Syslog-based anomaly event detection is crucial for diagnosing system issues and problems. However, existing log-based anomaly detection approaches use raw and unstructured log entries independently and incompletely, i.e., without considering the context of each event and event metadata in the logs. They employ incomplete representation of unstructured log data, limiting the deep learning model's capacity in the early stage, which tends to omit anomaly events and cause false alarms. In this work, we propose DeepSyslog, which represents Syslog with the context of log events and event metadata in the logs. Inspired by the sequence nature of the log stream, we employ unsupervised sentence embedding to extract the semantic and context information hidden in the log stream, rather than word embedding or one-hot embedding, which only capture the similarities between log words. The sentence embedding is further integrated with event metadata to form complete representations of Syslog, which can distinguish the anomaly caused by the correlated log entries and exceptional event metadata in the log. The simulation results on widely used log datasets show that DeepSyslog achieves high performance compared with the existing log-based anomaly event detection approaches.
Keyword:
Metadata
Anomaly detection
Feature extraction
Semantics
Indexes
History
Event detection
Anomaly detection
sentence embedding
event metadata

期刊

IEEE Transactions on Information Forensics and Security 封面图
IEEE Transactions on Information Forensics and Security
IF:
8
论文数:
5.3K
被引数:
2.3W

机构

P
pennsylvania commonwealth system of higher education (pcshe)
学者数:
12.9W
论文数: 11.7W
被引数: 177
W
Wuhan University of Technology
学者数:
3.4W
论文数: 2.4W
被引数: 4.4W
引用论文

引用论文

Electric-field dependence of absorption spectra of polymer ion-hemicyanine dye complexes
err1990-12-01
err0
PREAI
errS. Nomura; T. Kobayashi; H. Matsuda; S. Okada; H. Nakanishi; H. Tomiyama
err分享
err收藏
Donor pretreatment using the aerosolized prostacyclin analogue iloprost optimizes postischemic function of non heart beating donor lungs
err2003-01-01
err0
PREAI
errT Wittwer; U.F.W Franke; T Sandhaus; A Schuette; S Richter; J.M Albes; T Mueller; H Schubert; T Wahlers
err分享
err收藏
err分享
err收藏
Human cochlear changes in noise induced hearing loss
err2009-01-05
err0
PREAI
errTrevor J. I. Mcgill; Harold F. Schuknecht
err分享
err收藏
Understanding the Milieu Experiences of Patients on an Acute Inpatient Psychiatric Unit
err2010-08-01
err0
PREAI
errCatherine A. Thibeault; Kenneth Trudeau; Marguerite d’Entremont; Teresa Brown
err分享
err收藏
Mapping monoaminergic neurons with [3H]reserpine by autoradiography
err1979-07-01
err0
PREAI
errJ.G. Richards; M. Da Prada; J. Wu¨rsch; H.P. Lorez; L. Pieri
err分享
err收藏
学者 查看更多内容