arrow
返回

Deep probabilistic graphical modeling for robust multivariate time series anomaly detection with missing data

delete2023-10-01
delete10
PRE
AI
Y
Yang Jing-yu
Z
Zuogong Yue
Y
Ye Yuan *
DOI:10.1016/j.ress.2023.109410delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multivariate time series anomaly detection with missing data is one of the most pending issues for industrial monitoring. Due to scarcity of labeled anomalies, most advanced data-driven anomaly detection approaches fall in the unsupervised learning paradigm. As a premise in the presence of missing data, one needs to improve the data quality through data imputation with a separate model. Our concern lies in the consistency between data imputation and unsupervised learning for robust anomaly detection, regarding accurately discovering the spatiotemporal dependence among multiple variables over time. However, the existing practice tends to overlook this consistency and decouple the training process for these two closely linked tasks. This article novelly proposes a probabilistic multivariate time series anomaly detection framework that unifies data imputation and unsupervised learning. A deep probabilistic graphical model abbreviated SCNF is first devised for unsupervised density estimation. A tailored expectation maximization-based optimization scheme is then developed to achieve the joint training of data imputation and unsupervised learning with missing data. The efficacy is experimentally corroborated in several industrial applications, including chemical process, water treatment and network traffic. Briefly, the joint training framework enhances the AUROC of SCNF by averagely 6.34% for three applications under 50% data missing rate.
Keyword:
Multivariate time series
Anomaly detection
Missing data
Probabilistic graphical model
Expectation maximization

期刊

R
Reliability Engineering and System Safety
IF:
11
论文数:
9.0K
被引数:
4.2W

机构

暂无机构信息
引用论文

引用论文

Uncertainty Analysis of Stray Field Measurements by Quantitative Magnetic Force Microscopy定量磁力显微镜测量杂散场的不确定度分析
err2020-01-01
err5
errOAAI
errHu, Xiukun; Dai, Gaoliang; Sievers, Sibylle; Scarioni, Alexander Fernandez; Neu, Volker; Bieler, Mark; Schumacher, Hans Werner
err分享
err收藏
err分享
err收藏
A Dual-Isolation-Forests-Based Attack Detection Framework for Industrial Control Systems
err2020-01-01
err55
errOAAI
errElnour, Mariam; Meskin, Nader; Khan, Khaled; Jain, Raj
err分享
err收藏
学者 查看更多内容