arrow
Return

CAM-guided Multi-Path Decoding U-Net with Triplet Feature Regularization for Defect Detection and Segmentation

delete2021-09-01
delete32
PRE
AI
D
Dongyun Lin *
李益群 (Yiqun Li)
T
Tin Lay Nwe
Z
Zaw Min Oo
DOI:10.1016/j.knosys.2021.107272delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Automated defect detection and segmentation from high-resolution industrial images is an essential and challenging task. In this paper, we design a novel CNN network called Class Activation Map Guided U-Net (CAM-UNet) to address this task. The proposed network can be trained under the real-world industrial condition that sufficient normal (defect-free) images and a small number of annotated anomalous images are available. Technically, we first modify and pretrain the encoder of a VGG-16 backboned U-Net to classify normal and anomalous images. After pretraining, the class activation maps (CAMs) can be generated as the guidance to localize the defective regions within anomalous images. Secondly, we propose a novel Triplet Feature Regularization (TFR) module to facilitate the encoder network to simultaneously generate consistent representations of normal regions and discriminative representations between normal and defective regions. Finally, we propose a multi path decoding (MPD) module consisting of multiple decoding subnetworks. The subnetworks are trained by minimizing three different segmentation losses and their outputs are aggregated to generate the predicted defective masks. Extensive experiments are conducted on the publicly available industrial datasets MVTec AD and MTSD to demonstrate the superiority of the proposed method over multiple competing methods in both industrial defect detection and segmentation tasks. (C) 2021 Elsevier B.V. All rights reserved.
Keywords:
Defect detection and segmentation
Multi-path decoding
Triplet feature regularization
U-Net

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.2W
Citations:
4.5W

Organization

A
agency for science technology & research (a*star)
Scholars:
2.2W
Papers: 1.9W
Citations: 57