arrow
返回

Attention-Based Multiscale Feature Fusion for Efficient Surface Defect Detection

delete2024-01-01
delete4
PRE
AI
Y
Yuhao Zhao
Q
Qing Liu
苏
苏虎 (Hu Su)
J
Jiabin Zhang
H
Hongxuan Ma
W
Wei Zou *
S
Song Liu *
DOI:10.1109/TIM.2024.3372229delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep-learning-based detection methods have been widely applied to industrial defect inspection. However, directly using vanilla detection methods fails to achieve satisfying performance due to the lack of identifiable features. In this article, a novel attention-based multiscale feature fusion module (AMFF) is proposed, aiming to enhance defect features and improve defect identification by leveraging attention mechanism in the feature fusion. AMFF includes self-enhanced attention module (SEAM) and cross-enhanced attention module (CEAM). SEAM is performed on a single feature map, which first adopts multiple dilation convolutions to enrich contextual information without compromising resolution and then utilizes the intralayer attention on the current feature map. CEAM takes both the current feature map and the adjacent feature map as input to perform cross-layer attention. The adjacent feature map is modulated with the guidance of the current feature map, which is then combined with the current feature map and the output of SEAM for final prediction. AMFF is utilized in current feature fusion networks, e.g., feature pyramid network (FPN) and path aggregation FPN (PAFPN), and is further integrated into prevalent detectors to guide them to pay more attention to defects rather than the background. Extensive experiments are conducted on two real industrial datasets released by Tianchi platform, i.e., fabric and aluminum defect datasets. For each dataset, 500 images are randomly selected for test and the rest for training. The proposed AMFF is demonstrated to significantly boost defect detection accuracy with acceptable computational cost, and the real-time performance could fully satisfy practical requirements.
Keyword:
Attention mechanism
feature enhancement
feature fusion
object detection
surface defect detection

期刊

IEEE Transactions on Instrumentation and Measurement 封面图
IEEE Transactions on Instrumentation and Measurement
IF:
5.9
论文数:
2.0W
被引数:
5.8W

机构

I
institute of automation, cas
学者数:
2.2K
论文数: 2.1K
被引数: 2
S
ShanghaiTech University
学者数:
9.7K
论文数: 5.9K
被引数: 1.6W
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Reference-Based Defect Detection Network
err2021-01-01
err26
errOAAI
errZeng, Zhaoyang; Liu, Bei; Fu, Jianlong; Chao, Hongyang
err分享
err收藏
学者 查看更多内容