arrow
返回

Autoencoder-Like Knowledge Distillation Network for Anomaly Detection

delete2023-01-01
delete2
delete
OA
AI
C
Caie Xu
B
Bingyan Wang
D
Dandan Ni
J
Jin Gan
M
Mingyang Wu
周
周武杰 (Wujie Zhou) *
DOI:10.1109/ACCESS.2023.3314199delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Anomaly detection is a crucial research field in computer vision with diverse applications in practical scenarios. The common anomaly detection methods employed currently consist of autoencoders, generative adversarial networks, and knowledge distillation (KD) models. However, the teacher and student models in KD might not always yield distinct representations to signify anomalies due to their similar model structure and data flow. This study proposes a novel autoencoder-like KD model based on the attention mechanism for anomaly detection. The pre-trained teacher model incorporates a dual attention module as the encoder, while the student model integrates the same dual attention module as the decoder. The teacher guides the student to learn the feature knowledge of the input image. To connect the teacher-student model, a BottleNeck module is employed, converting the features extracted from the teacher model into more compact latent codes for precise restoration by the student model, thereby achieving anomaly detection. In general, the proposed model exhibits superior performance compared to other existing anomaly detection models on specific datasets. Experimental results demonstrate that the proposed model attains the state-of-the-art (SOTA) performance in anomaly detection on the public dataset MVTec. It achieves an average AUC of 98.2% and 98.0% at sample and pixel levels, respectively.
Keyword:
Anomaly detection
dual attention
knowledge distillation
teacher-student

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

University of California System 封面图
University of California System
学者数:
37.7W
论文数: 33.8W
被引数: 6.6K
Z
zhejiang university
学者数:
17.7W
论文数: 12.1W
被引数: 152
引用论文

引用论文

Synthese, Struktur und einige Eigenschaften von 1,2,3‐Benzodithiazolium‐Salzen
err2006-01-23
err0
PREAI
errJan W. Bats; Hartmut Fuess; Karl L. Weber; Herbert W. Roesky
err分享
err收藏
err分享
err收藏
A Pilot Study of the Efficacy of the Unified Protocol for Transdiagnostic Treatment of Emotional Disorders in Treating Posttraumatic Psychopathology: A Randomized Controlled Trial
err2021-01-16
err0
errOAAI
errMeaghan L. O'Donnell; Winnie Lau; Katherine Chisholm; James Agathos; Jonathon Little; Sonia Terhaag; Rachel Brand; Andrea Putica; Alexander C. N. Holmes; Lynda Katona; Kim L. Felmingham; Kim Murray; Fardous Hosseiny; Matthew W. Gallagher
err分享
err收藏
err分享
err收藏
Graph Attention Guidance Network With Knowledge Distillation for Semantic Segmentation of Remote Sensing Images
err2023-01-01
err17
PREAI
errZhou, Wujie; Fan, Xiaomin; Yan, Weiqing; Shan, Shengdao; Jiang, Qiuping; Hwang, Jenq-Neng
err分享
err收藏
err分享
err收藏
学者 查看更多内容