arrow
返回

LayerLog: Log sequence anomaly detection based on hierarchical semantics

delete2023-01-01
delete11
PRE
AI
C
Chunkai Zhang
X
Xinyu Wang
H
Hongye Zhang
J
Jiahua Zhang
H
Hanyu Zhang
C
Chuanyi Liu
P
Peiyi Han *
DOI:10.1016/j.asoc.2022.109860delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
System logs record the running status of systems, and log anomaly detection can help locate anomalies timely to reduce error time and ensure normal operation. Logs in text format contain abundant semantic information. Still, the methods based on log count vector and log key sequence do not take into account the semantics of log data, causing a high missing detection rate. And existing log semantics-based methods fail to fully consider the semantic information among words, logs, and log sequences. Besides, current methods require the usage of Log Parser in preprocessing, which could negatively impact detection accuracy and cause semantic loss. In this paper, we discover the three -layered structure of log data, named the Word Log-Log Sequencehierarchy, and propose LayerLog, a novel framework for log sequence anomaly detection based on the hierarchical semantics of log data. Without Log Parser in preprocessing phase, LayerLog can effectively extract semantic features from each layer and is the first framework to consider the semantics of words, logs, and log sequence. What is more, LayerLog can detect execution order anomaly, operation anomaly, and incomplete anomaly of log sequence simultaneously in an end-to-end way. We have evaluated sufficient experiments on two commonly-used public datasets and the experimental results confirm the effectiveness of LayerLog. (c) 2022 Elsevier B.V. All rights reserved.
Keyword:
Anomaly detection
Log parser
?Word-Log-Log Sequence?hierarchy

期刊

Applied Soft Computing 封面图
Applied Soft Computing
IF:
6.6
论文数:
1.4W
被引数:
4.8W

机构

H
harbin institute of technology
学者数:
8.0W
论文数: 6.6W
被引数: 66
引用论文

引用论文

Towards Automated Log Parsing for Large-Scale Log Data Analysis
err2018-11-01
err132
PREAI
errHe, Pinjia; Zhu, Jieming; He, Shilin; Li, Jian; Lyu, Michael R.
err分享
err收藏
Mapping monoaminergic neurons with [3H]reserpine by autoradiography
err1979-07-01
err0
PREAI
errJ.G. Richards; M. Da Prada; J. Wu¨rsch; H.P. Lorez; L. Pieri
err分享
err收藏
Establishment of the scleral cartilage in the chick
err1975-10-01
err0
PREAI
errPatricia A. Stewart; David J. McCallion
err分享
err收藏
Logram: Efficient Log Parsing Using n-Gram Dictionaries
err2020-01-01
err84
errOAAI
errDai, Hetong; Li, Heng; Chen, Che Shao; Shang, Weiyi; Chen, Tse-Hsun
err分享
err收藏
Synthesis and characterization of novel nanocomposite membrane of sodium titanate/Nafion®
err2011-06-01
err0
PREAI
errYongsheng Wei; Liangbo Shen; Fanghui Wang; Wein-Duo Yang; Hong Zhu; Zhongming Wang; Kefei Han
err分享
err收藏
Production of selected cosmogenic radionuclides by muons
err2002-06-01
err0
PREAI
errB Heisinger; D Lal; A.J.T Jull; P Kubik; S Ivy-Ochs; S Neumaier; K Knie; V Lazarev; E Nolte
err分享
err收藏
没有更多内容