.png){kind=icon}
返回
CSCAD: Correlation Structure-Based Collective Anomaly Detection in Complex System
.png){kind=icon}
OA
AI
DOI：10.1109/TKDE.2022.3154166.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Detecting anomalies in large complex systems is a critical and challenging task. The difficulties arise from several aspects. First, collecting ground truth labels or prior knowledge for anomalies is hard in real-world systems, which often lead to limited or no anomaly labels in the dataset. Second, anomalies in large systems usually occur in a collective manner due to the underlying dependency structure among devices or sensors. Lastly, real-time anomaly detection for high-dimensional data requires efficient algorithms that are capable of handling different types of data (i.e. continuous and discrete). We propose a correlation structure-based collective anomaly detection (CSCAD) model for high-dimensional anomaly detection problem in large systems, which is also generalizable to semi-supervised or supervised settings. Our framework utilize graph convolutional network combining a variational autoencoder to jointly exploit the feature space correlation and reconstruction deficiency of samples to perform anomaly detection. We propose an extended mutual information (EMI) metric to mine the internal correlation structure among different data features, which enhances the data reconstruction capability of CSCAD. The reconstruction loss and latent standard deviation vector of a sample obtained from reconstruction network can be perceived as two natural anomalous degree measures. An anomaly discriminating network can then be trained using low anomalous degree samples as positive samples, and high anomalous degree samples as negative samples. Experimental results on five public datasets demonstrate that our approach consistently outperforms all the competing baselines.
Keyword:
Anomaly detection
Correlation
Sensors
Feature extraction
Data models
Loss measurement
Complex systems
complex system
correlation mining
unsupervised learning
urban computing
variational autoencoder
期刊
IF:
10.4
论文数:
6.8K
被引数:
3.2W
机构
引用论文
.png){kind=icon}
分享收藏Electrothermal Model for Power LEDs Based on the Equivalent Resistance Concept for LED Driver Design基于LED驱动器设计的等效电阻概念的功率LED电热模型
PREAI
分享收藏分享收藏Under time pressure, the exogenous modulation of saccade plans is ubiquitous, intricate, and lawful
OAAI
OAAI分享收藏A Flying Squirrel Search Optimization for MPPT Under Partial Shaded Photovoltaic System局部遮挡光伏系统MPPT的飞鼠搜索优化
PREAI
分享收藏
查看更多内容