arrow
Return

Improved autoencoder for unsupervised anomaly detection

delete2021-07-26
delete55
delete
OA
AI
Z
Zhen Cheng *
S
Siwei Wang
P
Pei Zhang
S
Siqi Wang
Xinwang Liu cover
Xinwang Liu (Xinwang Liu)
E
En Zhu
DOI:10.1002/int.22582delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Deep autoencoder-based methods are the majority of deep anomaly detection. An autoencoder learning on training data is assumed to produce higher reconstruction error for the anomalous samples than the normal samples and thus can distinguish anomalies from normal data. However, this assumption does not always hold in practice, especially in unsupervised anomaly detection, where the training data is anomaly contaminated. We observe that the autoencoder generalizes so well on the training data that it can reconstruct both the normal data and the anomalous data well, leading to poor anomaly detection performance. Besides, we find that anomaly detection performance is not stable when using reconstruction error as anomaly score, which is unacceptable in the unsupervised scenario. Because there are no labels to guide on selecting a proper model. To mitigate these drawbacks for autoencoder-based anomaly detection methods, we propose an Improved AutoEncoder for unsupervised Anomaly Detection (IAEAD). Specifically, we manipulate feature space to make normal data points closer using anomaly detection-based loss as guidance. Different from previous methods, by integrating the anomaly detection-based loss and autoencoder's reconstruction loss, IAEAD can jointly optimize for anomaly detection tasks and learn representations that preserve the local data structure to avoid feature distortion. Experiments on five image data sets empirically validate the effectiveness and stability of our method.
Keywords:
autoencoder
deep learning
unsupervised anomaly detection
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

International Journal of Intelligent Systems cover
International Journal of Intelligent Systems
IF:
3.7
Papers:
3.1K
Citations:
8.1K

Organization

N
national university of defense technology - china
Scholars:
1.8W
Papers: 1.4W
Citations: 9
Cited Papers

Cited Papers

Inhibition of Sirtuin 3 prevents titanium particle-induced bone resorption and osteoclastsogenesis via suppressing ERK and JNK signaling
err2021-01-01
err0
errOAAI
errNing Li; Xiaoping Li; Kai Zheng; Jiaxiang Bai; Weicheng Zhang; Houyi Sun; Gaoran Ge; Wei Wang; Zhen Wang; Ye Gu; Yi Xue; Yaozeng Xu; Dechun Geng; Jun Zhou
errShare
errSave
Unsupervised Outlier Detection via Transformation Invariant Autoencoder
err2021-01-01
err11
errOAAI
errCheng, Zhen; Zhu, En; Wang, Siqi; Zhang, Pei; Li, Wang
errShare
errSave
errShare
errSave
A Flying Squirrel Search Optimization for MPPT Under Partial Shaded Photovoltaic System
err2021-08-01
err0
PREAI
errNagendra Singh; Krishna Kumar Gupta; Sanjay K. Jain; Niraj Kumar Dewangan; Pallavee Bhatnagar
errShare
errSave
Learning Compact Multifeature Codes for Palmprint Recognition From a Single Training Image per Palm
err2021-01-01
err40
PREAI
errFei, Lunke; Zhang, Bob; Zhang, Lin; Jia, Wei; Wen, Jie; Wu, Jigang
errShare
errSave
errShare
errSave
Gradient-based learning applied to document recognition
err1998-01-01
err3.8W
PREAI
errLecun, Y; Bottou, L; Bengio, Y; Haffner, P
errShare
errSave
researcher View more