arrow
返回

Unsupervised Visual Anomaly Detection Using Self-Supervised Pre-Trained Transformer

delete2024-01-01
delete0
delete
OA
AI
J
Jun‐Hyung Kim
G
Goo‐Rak Kwon *
DOI:10.1109/ACCESS.2024.3454753delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In the various industrial manufacturing processes, the automatic visual inspection system is an essential part as it reduces the chances of delivering defective products and the cost of training and hiring experts for manual inspection. In this work, we propose a new unsupervised anomaly detection method inspired by the masked language model for the automatic visual inspection system. The proposed method consists of an image tokenizer and two subnetworks, a reconstruction subnetwork, and a segmentation subnetwork. We adopt a pre-trained self-supervised vision Transformer model to use it as an image tokenizer. Our first subnetwork is trained to predict the anomaly-free patch tokens and the second subnetwork is trained to produce anomaly segmentation results from both the reconstructed and input patch tokens. During training, only the two subnetworks are optimized, and parameters of an image tokenizer are frozen. Experimental results show that the proposed method exhibits better performance than conventional methods in detecting defective products by achieving 99.05% I-AUROC on MVTecAD dataset and 94.8% I-AUROC on BTAD.
Keyword:
Image reconstruction
Image segmentation
Transformers
Computational modeling
Location awareness
Feature extraction
Anomaly detection
Data augmentation
Self-supervised learning
data-augmentation
self-supervised learning
transformer

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

C
Chosun University
学者数:
3.8K
论文数: 4.3K
被引数: 2.9K
引用论文

引用论文

Mixed-Gas Separation Properties of Phosphazene Polymer Membranes
err1993-01-01
err0
PREAI
errE. S. Peterson; M. L. Stone; R. R. McCaffrey; D. G. Cummings
err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
Intra-Abdominal Splenosis Mimicking Metastatic Cancer
err2011-03-01
err0
PREAI
errNicholas J. Short; Teresa G. Hayes; Peeyush Bhargava
err分享
err收藏
Forgetting in Alzheimer's disease: Is it fast? Is it affected by repeated retrieval?
err2020-02-01
err0
errOAAI
errAndreea Stamate; Robert H. Logie; Alan D. Baddeley; Sergio Della Sala
err分享
err收藏
学者 查看更多内容