arrow
返回

ETDNet: Efficient Transformer-Based Detection Network for Surface Defect Detection

delete2023-01-01
delete21
PRE
AI
H
Hantao Zhou
R
Rui Yang
胡润泽 封面图
胡润泽 (Runze Hu) *
C
Chang Shu
李
李秀 (Xiu Li) *
DOI:10.1109/TIM.2023.3307753delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep learning (DL)-based surface defect detectors play a crucial role in ensuring product quality during inspection processes. However, accurately and efficiently detecting defects remain challenging due to specific characteristics inherent in defective images, involving a high degree of foreground-background similarity, scale variation, and shape variation. To address this challenge, we propose an efficient transformer-based detection network, ETDNet, consisting of three novel designs to achieve superior performance. First, ETDNet takes a lightweight vision transformer (ViT) to extract representative global features. This approach ensures an accurate feature characterization of defects even with similar backgrounds. Second, a channel-modulated feature pyramid network (CM-FPN) is devised to fuse multilevel features and maintain critical information from corresponding levels. Finally, a novel task-oriented decoupled (TOD) head is introduced to tackle inconsistent representation between classification and regression tasks. The TOD head employs a local feature representation (LFR) module to learn object-aware local features and introduces a global feature representation (GFR) module, based on the attention mechanism, to learn content-aware global features. By integrating these two modules into the head, ETDNet can effectively classify and perceive defects with varying shapes and scales. Extensive experiments on various defect detection datasets demonstrate the effectiveness of the proposed ETDNet. For instance, it achieves AP 46.7% (versus 45.9%) and AP50 80.2% (versus 79.1%) with 49 frames/s on NEU-DET. The code is available at https://github.com/zht8506/ETDNet.
Keyword:
Feature extraction
Transformers
Task analysis
Detectors
Head
Shape
Deep learning
Attention mechanism
feature fusion
surface defect detection
task-oriented decoupled (TOD) head
transformer

期刊

IEEE Transactions on Instrumentation and Measurement 封面图
IEEE Transactions on Instrumentation and Measurement
IF:
5.9
论文数:
2.0W
被引数:
5.8W

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
B
beijing institute of technology
学者数:
5.5W
论文数: 4.0W
被引数: 63
T
Tsinghua Shenzhen International Graduate School
学者数:
6.8K
论文数: 4.9K
被引数: 9
学者 查看更多机构
引用论文

引用论文

Simplified protocol for DNA extraction and amplification of 2 molecular markers to detect and type Giardia duodenalis
err2014-01-01
err0
PREAI
errCarla Fernanda Uda-Shimoda; Cristiane Maria Colli; Mariana Felgueira Pavanelli; Ana Lúcia Falavigna-Guilherme; Mônica Lúcia Gomes
err分享
err收藏
A Real-Time Steel Surface Defect Detection Approach With High Accuracy一种高精度的钢材表面缺陷实时检测方法
err2022-01-01
err50
PREAI
errWang, Wenyan; Mi, Chunfeng; Wu, Ziheng; Lu, Kun; Long, Hongming; Pan, Baigen; Li, Dan; Zhang, Jun; Chen, Peng; Wang, Bing
err分享
err收藏
err分享
err收藏
学者 查看更多内容