arrow
Return

Multi-Channel Multi-Scale Convolution Attention Variational Autoencoder (MCA-VAE): An Interpretable Anomaly Detection Algorithm Based on Variational Autoencoder

delete2024-08-16
delete0
delete
OA
AI
J
J L Liu
Y
Yuchen Huang
D
Dizhi Wu
Y
Yuchen Yang
Y
Yanru Chen
L
Liangyin Chen
Y
Yuanyuan Zhang *
DOI:10.3390/s24165316delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
With the rapid development of industry, the risks factories face are increasing. Therefore, the anomaly detection algorithms deployed in factories need to have high accuracy, and they need to be able to promptly discover and locate the specific equipment causing the anomaly to restore the regular operation of the abnormal equipment. However, the neural network models currently deployed in factories cannot effectively capture both temporal features within dimensions and relationship features between dimensions; some algorithms that consider both types of features lack interpretability. Therefore, we propose a high-precision, interpretable anomaly detection algorithm based on variational autoencoder (VAE). We use a multi-scale local weight-sharing convolutional neural network structure to fully extract the temporal features within each dimension of the multi-dimensional time series. Then, we model the features from various aspects through multiple attention heads, extracting the relationship features between dimensions. We map the attention output results to the latent space distribution of the VAE and propose an optimization method to improve the reconstruction performance of the VAE, detecting anomalies through reconstruction errors. Regarding anomaly interpretability, we utilize the VAE probability distribution characteristics, decompose the obtained joint probability density into conditional probabilities on each dimension, and calculate the anomaly score, which provides helpful value for technicians. Experimental results show that our algorithm performed best in terms of F1 score and AUC value. The AUC value for anomaly detection is 0.982, and the F1 score is 0.905, which is 4% higher than the best-performing baseline algorithm, Transformer with a Discriminator for Anomaly Detection (TDAD). It also provides accurate anomaly interpretation capability.
Keywords:
industrial control systems
anomaly detection
variational autoencoder
anomaly interpretation

Journal

Sensors cover
Sensors
IF:
3.5
Papers:
7.2W
Citations:
20.9W

Organization

E
east china normal university
Scholars:
3.1W
Papers: 2.1W
Citations: 25
S
sichuan university
Scholars:
12.1W
Papers: 7.8W
Citations: 100
Cited Papers

Cited Papers

Unsupervised Anomaly Detection for IoT-Based Multivariate Time Series: Existing Solutions, Performance Analysis and Future Directions
errSENSORS
IF3.5
err2023-03-06
err30
errOAAI
errBelay, Mohammed Ayalew; Blakseth, Sindre Stenen; Rasheed, Adil; Salvo Rossi, Pierluigi
errShare
errSave
errShare
errSave
LSTM-Based VAE-GAN for Time-Series Anomaly Detection
errSENSORS
IF3.5
err2020-07-03
err118
errOAAI
errNiu, Zijian; Yu, Ke; Wu, Xiaofei
errShare
errSave
GRU-Based Interpretable Multivariate Time Series Anomaly Detection in Industrial Control System
err2023-04-01
err37
PREAI
errTang, Chaofan; Xu, Lijuan; Yang, Bo; Tang, Yongwei; Zhao, Dawei
errShare
errSave
Prognostic impact of salvage treatment on hearing recovery in patients with sudden sensorineural hearing loss refractory to systemic corticosteroids: A retrospective observational study
err2016-10-01
err0
PREAI
errTakayuki Nakagawa; Michio Yamamoto; Kozo Kumakawa; Shin-ichi Usami; Naohito Hato; Keiji Tabuchi; Mariko Takahashi; Keizo Fujiwara; Akira Sasaki; Shizuo Komune; Norio Yamamoto; Harukazu Hiraumi; Tatsunori Sakamoto; Akira Shimizu; Juichi Ito
errShare
errSave
researcher View more