arrow
Return

GRAND: GAN-based software runtime anomaly detection method using trace information

delete2024-01-01
delete1
PRE
AI
S
Shiyi Kong
J
Jun Ai *
M
Minyan Lu
Y
Yiang Gong
DOI:10.1016/j.neunet.2023.10.036delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Software runtime anomaly detection can detect manifestations (known as anomalies) caused by faults in complex systems before they lead to failure. Whereas most existing methods use external performance indicators, this study uses internal execution traces to reveal failures not only related to software performance issues but also functional errors. A neural network model called GRAND, which combines a variational autoencoder and a generative adversarial network, is proposed to mine anomalies in the execution trace. Cassandra, a widely used database system, was used as a representation to conduct the empirical study. The dataset was collected under a well-designed operational profile that contained 5180 time series, each containing more than ten million data points. GRAND achieved a higher detection performance than the other two SOTA baseline models, with a 99% F1-score compared with 93% and 87%. Ablation studies show that the workload information used in GRAND can determine whether the current internal status is consistent with the task, thus achieving a 16% improvement in the F1-score. The attention mechanism used for data fusion can achieve a 32% improvement in the F1-score.
Keywords:
Software anomaly detection
Internal execution trace
Unsupervised learning
VAE
GAN

Journal

Neural Networks cover
Neural Networks
IF:
6.3
Papers:
8.2K
Citations:
3.0W

Organization

B
Beihang University
Scholars:
5.2W
Papers: 4.1W
Citations: 37
Cited Papers

Cited Papers

A best practice guide to resource forecasting for computing systems
err2007-12-01
err54
PREAI
errHoffmann, Guenther A.; Trivedi, Kishor S.; Malek, Miroslaw
errShare
errSave
Log message anomaly detection with fuzzy C-means and MLP
err2022-04-04
err5
PREAI
errFarzad, Amir; Gulliver, T. Aaron
errShare
errSave
Predicting Node Failures in an Ultra-Large-Scale Cloud Computing Platform: An AIOps Solution
err2020-04-29
err38
PREAI
errLi, Yangguang; Jiang, Zhen Ming (Jack); Li, Heng; Hassan, Ahmed E.; He, Cheng; Huang, Ruirui; Zeng, Zhengda; Wang, Mian; Chen, Pinan
errShare
errSave
GAN-based anomaly detection: A review
err2022-07-01
err193
PREAI
errXia, Xuan; Pan, Xizhou; Li, Nan; He, Xing; Ma, Lin
errShare
errSave
AutoLog: Anomaly detection by deep autoencoding of system logs
err2022-04-01
err33
PREAI
errCatillo, Marta; Pecchia, Antonio; Villano, Umberto
errShare
errSave
A comparative evaluation of outlier detection algorithms: Experiments and analyses
err2018-02-01
err335
PREAI
errDomingues, Remi; Filippone, Maurizio; Michiardi, Pietro; Zouaoui, Jihane
errShare
errSave
Rectal distension: The effect on bladder function
err2011-01-25
err0
PREAI
errD.C. Panayi; V. Khullar; G.A. Digesu; M. Spiteri; C. Hendricken; R. Fernando
errShare
errSave
Runtime Monitoring of Software Execution Trace: Method and Tools
err2020-01-01
err6
errOAAI
errKong, Shiyi; Lu, Minyan; Li, Luyi; Gao, Lihua
errShare
errSave
researcher View more