arrow
返回

Layer-constrained variational autoencoding kernel density estimation model for anomaly detection

delete2020-05-01
delete20
PRE
AI
P
Peng Lv
Y
Yanwei Yu *
Y
Yangyang Fan
X
Xianfeng Tang
仝向荣 (Xiangrong Tong)
DOI:10.1016/j.knosys.2020.105753delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Unsupervised techniques typically rely on the probability density distribution of the data to detect anomalies, where objects with low probability density are considered to be abnormal. However, modeling the density distribution of high dimensional data is known to be hard, making the problem of detecting anomalies from high-dimensional data challenging. The state-of-the-art methods solve this problem by first applying dimension reduction techniques to the data and then detecting anomalies in the low dimensional space. Unfortunately, the low dimensional space does not necessarily preserve the density distribution of the original high dimensional data. This jeopardizes the effectiveness of anomaly detection. In this work, we propose a novel high dimensional anomaly detection method called LAKE. The key idea of LAKE is to unify the representation learning capacity of layer-constrained variational autoencoder with the density estimation power of kernel density estimation (KDE). Then a probability density distribution of the high dimensional data can be learned, which is able to effectively separate the anomalies out. LAKE successfully consolidates the merits of the two worlds, namely layer-constrained variational autoencoder and KDE by using a probability density-aware strategy in the training process of the autoencoder. Extensive experiments on six public benchmark datasets demonstrate that our method significantly outperforms the state-of-the-art methods in detecting anomalies and achieves up to 37% improvement in F-1 score. (C) 2020 Elsevier B.V. All rights reserved.
Keyword:
Anomaly detection
Variational autoencoder
Kernel density estimation
Layer constraint
Deep learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

K
Knowledge-Based Systems
IF:
7.6
论文数:
1.2W
被引数:
4.5W

机构

Y
Yantai University
学者数:
8.4K
论文数: 5.7K
被引数: 9.9K
S
shanghai jiao tong university
学者数:
15.7W
论文数: 11.7W
被引数: 159
O
ocean university of china
学者数:
3.1W
论文数: 2.0W
被引数: 21
P
pennsylvania commonwealth system of higher education (pcshe)
学者数:
12.9W
论文数: 11.7W
被引数: 177
学者 查看更多机构
引用论文

引用论文

IoT Based Design of Air Quality Monitoring System Web Server for Android Platform
err2021-02-09
err0
PREAI
errKoel Datta Purkayastha; Ritesh Kishore Mishra; Arunava Shil; Sambhu Nath Pradhan
err分享
err收藏
A comparative evaluation of outlier detection algorithms: Experiments and analyses
err2018-02-01
err335
PREAI
errDomingues, Remi; Filippone, Maurizio; Michiardi, Pietro; Zouaoui, Jihane
err分享
err收藏
err分享
err收藏
Maximal granularity structure and generalized multi-view discriminant analysis for person re-identification
err2018-07-01
err32
PREAI
errZhao, Cairong; Wang, Xuekuan; Miao, Duoqian; Wang, Hanli; Zheng, Weishi; Xu, Yong; Zhang, David
err分享
err收藏
Robust Model Fitting Based on Greedy Search and Specified Inlier Threshold
err2019-10-01
err17
PREAI
errLai, Taotao; Fujita, Hamido; Yang, Changcai; Li, Qiming; Chen, Riqing
err分享
err收藏
Multiple metric learning based on bar-shape descriptor for person re-identification
err2017-11-01
err24
PREAI
errZhao, Cairong; Wang, Xuekuan; Wong, Wai Keung; Zheng, Weishi; Yang, Jian; Miao, Duoqian
err分享
err收藏
f-AnoGAN: Fast unsupervised anomaly detection with generative adversarial networksF-anogan: 基于生成对抗网络的快速无监督异常检测
err2019-05-01
err815
PREAI
errSchlegl, Thomas; Seebock, Philipp; Waldstein, Sebastian M.; Langs, Georg; Schmidt-Erfurth, Ursula
err分享
err收藏
学者 查看更多内容