返回
Layer-constrained variational autoencoding kernel density estimation model for anomaly detection
DOI:10.1016/j.knosys.2020.105753.png)
摘要
En 中文
Unsupervised techniques typically rely on the probability density distribution of the data to detect anomalies, where objects with low probability density are considered to be abnormal. However, modeling the density distribution of high dimensional data is known to be hard, making the problem of detecting anomalies from high-dimensional data challenging. The state-of-the-art methods solve this problem by first applying dimension reduction techniques to the data and then detecting anomalies in the low dimensional space. Unfortunately, the low dimensional space does not necessarily preserve the density distribution of the original high dimensional data. This jeopardizes the effectiveness of anomaly detection. In this work, we propose a novel high dimensional anomaly detection method called LAKE. The key idea of LAKE is to unify the representation learning capacity of layer-constrained variational autoencoder with the density estimation power of kernel density estimation (KDE). Then a probability density distribution of the high dimensional data can be learned, which is able to effectively separate the anomalies out. LAKE successfully consolidates the merits of the two worlds, namely layer-constrained variational autoencoder and KDE by using a probability density-aware strategy in the training process of the autoencoder. Extensive experiments on six public benchmark datasets demonstrate that our method significantly outperforms the state-of-the-art methods in detecting anomalies and achieves up to 37% improvement in F-1 score. (C) 2020 Elsevier B.V. All rights reserved.
Keyword:
Anomaly detection
Variational autoencoder
Kernel density estimation
Layer constraint
Deep learning
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
K
IF:
7.6
论文数:
1.2W
被引数:
4.5W
机构
引用论文
A comparative evaluation of outlier detection algorithms: Experiments and analyses
PATTERN RECOGNITION
IF7.6
Similarity learning with joint transfer constraints for person re-identification基于联合迁移约束的相似性学习在人员再识别中的应用
PATTERN RECOGNITION
IF7.6
High-dimensional and large-scale anomaly detection using a linear one-class SVM with deep learning基于深度学习的线性单类SVM的高维大规模异常检测
PATTERN RECOGNITION
IF7.6
Maximal granularity structure and generalized multi-view discriminant analysis for person re-identification
PATTERN RECOGNITION
IF7.6
Particle swarm approach to the optimisation of trenched cantilever‐based MEMS piezoelectric energy harvesters基于悬臂的MEMS压电能量采集器优化的粒子群方法
Multiple metric learning based on bar-shape descriptor for person re-identification
PATTERN RECOGNITION
IF7.6

