Joining Spatial Deformable Convolution and a Dense Feature Pyramid for Surface Defect Detection

doi:10.1109/TIM.2024.3370962

Joining Spatial Deformable Convolution and a Dense Feature Pyramid for Surface Defect Detection

2024-01-01

4

PRE

AI

DOI：10.1109/TIM.2024.3370962

Original

Original request for help

Save

Abstract

En 中文

Although deep learning-based surface defect detection approaches have performed remarkably well in recent years, the complicated shapes and large size differences of surface defects still pose enormous challenges for most existing methods. To address these issues, we propose a novel surface defect detection method joining spatial deformable convolution (SDC) and a dense feature pyramid, named SDDF-Net. First, we construct a SDC-based feature extraction network, which uses a dynamic convolutional kernel with spatial information to increase the feature extraction capability of complicated defects. Second, we build a dense feature pyramid-based feature fusion network (DFPN) that fuses features from different network layers to improve the detection accuracy of multiscale defects. Third, we present a novel hybrid loss that combines complete intersection over union (IoU) loss and normalized Wasserstein distance (NWD) loss to enhance the defect recognition and location learning abilities of our method. Finally, we run our method on the NEU surface defect dataset (NEU-DET), DAGM2007 and DeepPCB datasets to conduct a comprehensive comparison with some state-of-the-art general object detection models and specialized surface defect detection methods. The experimental results show that the proposed SDDF-Net performs competitively in terms of detection accuracy and computational efficiency when compared with existing methods. This indicates that SDDF-Net achieves good results for surface defect detection and is qualified for real-time processing in industry.

Keywords:

Dense feature pyramid network (FPN)

feature extraction

spatial deformable convolution (SDC)

surface defect detection

Joining Spatial Deformable Convolution and a Dense Feature Pyramid for Surface Defect Detection

Abstract

Journal

Organization