.png){kind=icon}
返回
Self-supervised log parsing using semantic contribution difference
.png){kind=icon}
PRE
AI
DOI：10.1016/j.jss.2023.111646.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Logs can help developers to promptly diagnose software system failures. Log parsers, which parse semi-structured logs into structured log templates, are the first component for automated log analysis. However, almost all existing log parsers have poor generalization ability and only work well for specific systems. In addition, some parsers cannot perform well based on partial data training and cannot support out-of-vocabulary (OOV) words. These limitations can cause erroneous log parsing results. We observe that logs are presented as semi-structured natural language, and we can treat log parsing as a natural language processing task. Thus, we propose Semlog, a novel log parser, requiring no domain knowledge about specific systems. For a log, constant and variable words contribute differently to the semantics of a log. We pretrain a self-attention based model to craft their semantic contribution difference, and then extract log templates based on the pretrained model. We have conducted extensive experiments on 16 benchmark datasets, and the results show that Semlog outperforms the state-of-the-art parsers in terms of average parsing accuracy, reaching 0.987.(c) 2023 Elsevier Inc. All rights reserved.
Keyword:
Log parsing
Deep learning
Log semantics
Self-attention
期刊
IF:
4.1
论文数:
5.5K
被引数:
8.4K
机构
引用论文
.png){kind=icon}
Failure prediction based on log files using Random Indexing and Support Vector Machines基于随机索引和支持向量机的日志文件故障预测
PREAI
分享收藏
分享收藏分享收藏
查看更多内容