arrow
Return

Multi-source data based anomaly detection through temporal and spatial characteristics

delete2024-03-01
delete3
PRE
AI
P
Peng Xu *
Z
Zhongbao Zhang
K
Kai Zhao
DOI:10.1016/j.eswa.2023.121675delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Anomaly detection is vital in complex distributed systems. However, existing methods did not take into full account the temporal and spatial characteristics of data from multiple sources in the system. That will lead to less accurate of anomaly detection. To address this limitation, in this paper we propose a multi-source data based anomaly detection method through temporal and spatial characteristics. Specifically, we first considered the spatial characteristics. We propose a Transformer encoder to parse log templates and output template vectors, then an attention-based CNN is introduced to obtain the spatial characteristics from traces. Next, we considered the temporal characteristics. We propose Bi-LSTM network to obtain the temporal characteristics of multi-source data of the distributed systems, followed by anomaly detection. Finally, extensive comparative experiments verify the effectiveness of our method, the F1-score reaches 0.859 and improves by 2.14% compared to state-of-the-art methods.
Keywords:
Anomaly detection
Log
Distributed systems
LSTM
CNN

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
3.0W
Citations:
10.2W

Organization

B
beijing university of posts & telecommunications
Scholars:
1.4W
Papers: 1.2W
Citations: 9
Cited Papers

Cited Papers

Electric-field dependence of absorption spectra of polymer ion-hemicyanine dye complexes
err1990-12-01
err0
PREAI
errS. Nomura; T. Kobayashi; H. Matsuda; S. Okada; H. Nakanishi; H. Tomiyama
errShare
errSave
Experiential Learning Spaces for Industrial Engineering Education
err2019-10-01
err0
PREAI
errDavid Ernesto Salinas-Navarro; Claudia Lizette Garay-Rondero; Ericka Zulema Rodriguez Calvo
errShare
errSave
Atrial fibrillation and cognitive function in patients with heart failure: a systematic review and meta-analysis
err2016-11-15
err0
PREAI
errPavlos G. Myserlis; Antonia Malli; Dimitrios K. Kalaitzoglou; Grigorios Kalaitzidis; Michael Miligkos; Damianos G. Kokkinidis; Andreas P. Kalogeropoulos
errShare
errSave
An efficient image segmentation method for skin cancer imaging using improved golden jackal optimization algorithm
err2022-10-01
err100
PREAI
errHoussein, Essam H.; Abdelkareem, Doaa A.; Emam, Marwa M.; Hameed, Mohamed Abdel; Younan, Mina
errShare
errSave
Dashboard Design Patterns
err2022-01-01
err0
errOAAI
errBenjamin Bach; Euan Freeman; Alfie Abdul-Rahman; Cagatay Turkay; Saiful Khan; Yulei Fan; Min Chen
errShare
errSave
researcher View more